Jul 31 10:32:52 devstack cinder-volume[77831]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 31 10:32:52 devstack cinder-volume[77831]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 31 10:32:52 devstack cinder-volume[77831]: we strongly recommend against using it for new projects. Jul 31 10:32:52 devstack cinder-volume[77831]: If you are already using Eventlet, we recommend migrating to a different Jul 31 10:32:52 devstack cinder-volume[77831]: framework. For more detail see Jul 31 10:32:52 devstack cinder-volume[77831]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 31 10:32:52 devstack cinder-volume[77831]: import eventlet # noqa Jul 31 10:32:54 devstack cinder-volume[77831]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77831) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 31 10:32:54 devstack cinder-volume[77831]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77831) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 31 10:32:54 devstack cinder-volume[77831]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77831) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 31 10:32:56 devstack cinder-volume[77831]: INFO dbcounter [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] Registered counter for database cinder Jul 31 10:32:56 devstack cinder-volume[77831]: DEBUG oslo_db.sqlalchemy.engines [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77831) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 10:32:56 devstack cinder-volume[77831]: DEBUG dbcounter [-] [77831] Writer thread running {{(pid=77831) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 31 10:32:56 devstack cinder-volume[77831]: INFO cinder.rpc [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 31 10:32:56 devstack cinder-volume[77831]: INFO cinder.rpc [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 31 10:32:56 devstack cinder-volume[77831]: DEBUG oslo_db.sqlalchemy.engines [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77831) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 10:32:56 devstack cinder-volume[77831]: INFO cinder.volume.manager [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] Determined volume DB was empty at startup. Jul 31 10:32:56 devstack cinder-volume[77831]: DEBUG cinder.volume.manager [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77831) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 31 10:32:56 devstack cinder-volume[77831]: INFO cinder.volume.manager [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 31 10:32:56 devstack cinder-volume[77831]: WARNING stevedore.named [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 31 10:32:56 devstack cinder-volume[77831]: WARNING castellan.key_manager [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 31 10:32:56 devstack cinder-volume[77831]: WARNING cinder.keymgr.conf_key_mgr [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 31 10:32:56 devstack cinder-volume[77831]: DEBUG cinder.volume.drivers.lvm [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77831) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 31 10:32:56 devstack cinder-volume[77831]: DEBUG oslo_concurrency.processutils [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77831) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_concurrency.processutils [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] CMD "cinder-rtstool verify" returned: 0 in 0.435s {{(pid=77831) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_db.sqlalchemy.engines [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77831) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 10:32:57 devstack cinder-volume[77831]: INFO cinder.rpc [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 31 10:32:57 devstack cinder-volume[77831]: INFO cinder.rpc [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 31 10:32:57 devstack cinder-volume[77831]: WARNING stevedore.named [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 31 10:32:57 devstack cinder-volume[77831]: WARNING castellan.key_manager [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 31 10:32:57 devstack cinder-volume[77831]: INFO cinder.volume.manager [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_db.sqlalchemy.engines [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77831) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 10:32:57 devstack cinder-volume[77831]: INFO oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] Starting 1 workers Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] Started child 77986 {{(pid=77831) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] Full set of CONF: {{(pid=77831) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] ******************************************************************************** {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] Configuration options gathered from: {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] ================================================================================ {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] allow_availability_zone_fallback = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] allow_compression_on_image_upload = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] allowed_direct_url_schemes = [] {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] api_rate_limit = True {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] auth_strategy = keystone {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] az_cache_duration = 3600 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_availability_zone = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_host = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_name = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_stats_polling_interval = 60 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backup_api_class = cinder.backup.api.API {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backup_name_template = backup-%s {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backup_use_same_host = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backup_use_temp_snapshot = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] chap_password = **** {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] chap_username = {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cinder_internal_tenant_project_id = c07150e871bd4109b1095ba6bac152e4 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cinder_internal_tenant_user_id = 919160d555e64942a3f9db0e95a0a2c0 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cloned_volume_same_az = True {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cluster = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] compression_format = gzip {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] compute_api_class = cinder.compute.nova.API {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] config_dir = [] {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] config_source = [] {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] control_exchange = openstack {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] debug = True {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] default_availability_zone = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] default_group_type = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77986]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] default_volume_type = lvmdriver-1 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] disk_geometry = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] driver_client_cert = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] driver_client_cert_key = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] driver_data_namespace = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] driver_ssl_cert_path = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] driver_ssl_cert_verify = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] driver_use_ssl = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] enable_force_upload = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] enable_new_services = True {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] enable_unsupported_driver = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] enabled_backends = ['lvmdriver-1'] {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] enforce_multipath_for_image_xfer = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] filter_function = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] glance_api_insecure = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] glance_api_servers = ['http://192.168.122.164/image'] {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] glance_api_ssl_compression = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] glance_ca_certificates_file = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] glance_catalog_info = image:glance:publicURL {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] glance_certfile = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] glance_keyfile = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] glance_num_retries = 3 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] glance_request_timeout = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] goodness_function = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] graceful_shutdown_timeout = 5 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] group_api_class = cinder.group.api.API {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] host = devstack {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] image_compress_on_upload = True {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] image_conversion_address_space_limit = 1 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] image_conversion_cpu_limit = 60 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] image_conversion_disable = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] image_upload_use_cinder_backend = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] image_upload_use_internal_tenant = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] image_volume_cache_enabled = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] image_volume_cache_max_count = 0 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] image_volume_cache_max_size_gb = 0 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] init_host_max_objects_retrieval = 0 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] instance_format = [instance: %(uuid)s] {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] iscsi_target_flags = {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] iscsi_write_cache = on {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] iser_helper = tgtadm {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] iser_ip_address = 192.168.122.164 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] iser_port = 3260 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] log_color = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] log_config_append = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] log_dir = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] log_file = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] log_options = True {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] log_rotate_interval = 1 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] log_rotate_interval_type = days {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] log_rotation_type = none {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] max_age = 0 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] max_logfile_count = 30 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] max_logfile_size_mb = 200 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] max_over_subscription_ratio = 20.0 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] message_reap_interval = 86400 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] message_ttl = 2592000 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] migration_create_volume_timeout_secs = 300 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] monkey_patch = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] monkey_patch_modules = [] {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] my_ip = 192.168.122.164 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] no_snapshot_gb_quota = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] num_iser_scan_tries = 3 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] num_shell_tries = 3 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] num_volume_device_scan_tries = 3 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] nvmeof_conn_info_version = 1 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] nvmet_ns_id = 10 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] nvmet_port_id = 1 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] osapi_max_limit = 1000 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] osapi_volume_ext_list = [] {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] osapi_volume_listen = 0.0.0.0 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] osapi_volume_listen_port = 8776 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] osapi_volume_use_ssl = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] osapi_volume_workers = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] per_volume_size_limit = -1 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] periodic_fuzzy_delay = 60 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] periodic_interval = 60 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] project_id_regex = [0-9a-f\-]+ {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] public_endpoint = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] publish_errors = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] quota_backup_gigabytes = 1000 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] quota_backups = 10 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] quota_gigabytes = 1000 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] quota_groups = 10 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] quota_snapshots = 10 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] quota_volumes = 10 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] rate_limit_burst = 0 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] rate_limit_except_level = CRITICAL {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] rate_limit_interval = 0 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] reinit_driver_count = 3 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] replication_device = **** {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] report_discard_supported = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] report_interval = 120 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] reservation_clean_interval = 86400 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] reservation_expire = 86400 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] reserved_image_namespaces = [] {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] reserved_percentage = 0 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] rpc_response_timeout = 120 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] run_external_periodic_tasks = True {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] scst_target_driver = iscsi {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] scst_target_iqn_name = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] service_down_time = 720 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] shell_completion = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] snapshot_name_template = snapshot-%s {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] snapshot_same_host = True {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] split_loggers = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] state_path = /opt/stack/data/cinder {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] storage_availability_zone = nova {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] storage_protocol = iSCSI {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] syslog_log_facility = LOG_USER {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] target_helper = lioadm {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] target_ip_address = 192.168.122.164 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] target_port = 3260 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] target_protocol = iscsi {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] target_secondary_ip_addresses = [] {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] trace_flags = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] transfer_api_class = cinder.transfer.api.API {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] transport_url = **** {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] until_refresh = 0 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] use_chap_auth = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] use_default_quota_class = True {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] use_journal = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] use_json = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] use_multipath_for_image_xfer = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] use_stderr = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] use_syslog = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] verify_glance_signatures = enabled {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] volume_api_class = cinder.volume.api.API {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] volume_backend_name = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] volume_clear = zero {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] volume_clear_ionice = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] volume_clear_size = 0 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] volume_copy_bps_limit = 0 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] volume_dd_blocksize = 1M {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] volume_name_template = volume-%s {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] volume_service_inithost_offload = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] volume_usage_audit_period = month {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] zoning_mode = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_concurrency.disable_process_locking = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] keystone_authtoken.auth_section = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] keystone_authtoken.auth_type = password {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] keystone_authtoken.auth_version = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] keystone_authtoken.cache = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] keystone_authtoken.certfile = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] keystone_authtoken.delay_auth_decision = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] keystone_authtoken.http_connect_timeout = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] keystone_authtoken.include_service_catalog = True {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] keystone_authtoken.insecure = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] keystone_authtoken.interface = public {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] keystone_authtoken.keyfile = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] keystone_authtoken.memcache_password = {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] keystone_authtoken.memcache_username = {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] keystone_authtoken.region_name = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] keystone_authtoken.service_token_roles_required = True {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] keystone_authtoken.service_type = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] keystone_authtoken.token_cache_time = 300 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.164/identity {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cache.backend = dogpile.cache.null {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cache.backend_argument = **** {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cache.backend_expiration_time = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cache.config_prefix = cache.oslo {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cache.debug_cache_backend = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cache.enable_retry_client = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cache.enable_socket_keepalive = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cache.enabled = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77986]: INFO cinder.volume.manager [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 31 10:32:57 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cache.expiration_time = 600 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cache.hashclient_dead_timeout = 60.0 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cache.hashclient_retry_attempts = 2 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cache.memcache_dead_retry = 300 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cache.memcache_pool_maxsize = 10 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cache.memcache_sasl_enabled = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cache.memcache_servers = ['localhost:11211'] {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cache.password = **** {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cache.proxies = [] {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cache.redis_db = 0 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cache.redis_sentinel_service_name = mymaster {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cache.redis_server = localhost:6379 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cache.retry_attempts = 2 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cache.retry_delay = 0.0 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cache.socket_keepalive_count = 1 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cache.socket_keepalive_idle = 1 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cache.socket_keepalive_interval = 1 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cache.socket_timeout = 1.0 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cache.tls_allowed_ciphers = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cache.tls_cafile = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cache.tls_certfile = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cache.tls_enabled = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cache.tls_keyfile = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cache.username = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] coordination.backend_url = **** {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] database.asyncio_connection = **** {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] database.asyncio_slave_connection = **** {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] database.backend = sqlalchemy {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] database.connection = **** {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] database.connection_debug = 0 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] database.connection_parameters = {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] database.connection_recycle_time = 3600 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] database.connection_trace = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] database.db_inc_retry_interval = True {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] database.db_max_retries = 20 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] database.db_max_retry_interval = 10 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] database.db_retry_interval = 1 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] database.max_overflow = 50 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] database.max_pool_size = 5 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] database.max_retries = 10 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] database.mysql_sql_mode = TRADITIONAL {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] database.mysql_wsrep_sync_wait = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] database.pool_timeout = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] database.retry_interval = 10 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] database.slave_connection = **** {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] database.sqlite_synchronous = True {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] database.synchronous_reader = True {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] database.use_db_reconnect = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_metrics.metrics_process_name = {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] profiler.connection_string = messaging:// {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] profiler.enabled = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] profiler.es_doc_type = notification {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] profiler.es_scroll_size = 10000 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] profiler.es_scroll_time = 2m {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] profiler.filter_error_trace = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] profiler.hmac_keys = **** {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] profiler.sentinel_service_name = mymaster {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] profiler.socket_timeout = 0.1 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] profiler.trace_requests = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] profiler.trace_sqlalchemy = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] profiler_jaeger.process_tags = {} {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] profiler_jaeger.service_name_prefix = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] profiler_otlp.service_name_prefix = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_policy.enforce_new_defaults = True {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_policy.policy_default_rule = default {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_policy.policy_file = policy.yaml {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_policy.remote_timeout = 60.0 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] privsep_osbrick.capabilities = [21, 2] {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] privsep_osbrick.group = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] privsep_osbrick.helper_command = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] privsep_osbrick.user = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cinder_sys_admin.group = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cinder_sys_admin.helper_command = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] cinder_sys_admin.user = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] service_user.auth_section = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] service_user.auth_type = password {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] service_user.cafile = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] service_user.certfile = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.053s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:32:57 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] service_user.collect_timing = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] service_user.insecure = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] service_user.keyfile = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] service_user.send_service_user_token = True {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] service_user.split_loggers = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] service_user.timeout = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] glance.auth_section = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] glance.auth_type = password {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] glance.certfile = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] glance.collect_timing = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] glance.insecure = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] glance.keyfile = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] glance.region_name = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] glance.split_loggers = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] glance.timeout = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.backend_availability_zone = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.chap_password = **** {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.chap_username = {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.disk_geometry = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.driver_client_cert = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.driver_client_cert_key = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.driver_data_namespace = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.driver_use_ssl = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.enable_unsupported_driver = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.extra_capabilities = {} {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.filter_function = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.goodness_function = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.iscsi_target_flags = {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.iscsi_write_cache = on {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.iser_helper = tgtadm {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.iser_ip_address = 192.168.122.164 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.iser_port = 3260 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.lvm_mirrors = 0 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.lvm_share_target = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.lvm_type = auto {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.num_shell_tries = 3 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.nvmet_ns_id = 10 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.nvmet_port_id = 1 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.replication_device = **** {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.report_discard_supported = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.reserved_percentage = 0 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.scst_target_driver = iscsi {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.scst_target_iqn_name = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.storage_protocol = iSCSI {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.target_helper = tgtadm {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.target_ip_address = 192.168.122.164 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.target_port = 3260 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.target_protocol = iscsi {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.trace_flags = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.unique_fqdn_network = True {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.use_chap_auth = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.volume_backend_name = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.volume_clear = zero {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.volume_clear_ionice = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.volume_clear_size = 0 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.volume_group = cinder-volumes {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_reports.file_event_handler = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_reports.log_dir = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.backend_availability_zone = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.055s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:32:57 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.backend_host = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.chap_password = **** {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.chap_username = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.chiscsi_conf = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.disk_geometry = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.driver_client_cert = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.driver_data_namespace = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.driver_use_ssl = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.extra_capabilities = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.filter_function = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.goodness_function = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.iscsi_write_cache = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.iser_helper = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.iser_ip_address = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.iser_port = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.iser_target_prefix = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.lvm_conf_file = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.lvm_mirrors = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.lvm_share_target = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.lvm_type = auto {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.num_shell_tries = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.nvmet_ns_id = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.nvmet_port_id = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.replication_device = **** {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.report_discard_supported = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.reserved_percentage = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.scst_target_driver = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.storage_protocol = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.target_helper = lioadm {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.target_ip_address = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.target_port = 3260 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.target_protocol = iscsi {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.trace_flags = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.use_chap_auth = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.volume_clear = zero {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.volume_clear_size = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] lvmdriver-1.volumes_dir = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_rabbit.ssl = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_rabbit.ssl_version = {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_notifications.driver = [] {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_notifications.retry = -1 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] oslo_messaging_notifications.transport_url = **** {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] key_manager.fixed_key = **** {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] barbican.barbican_api_version = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] barbican.barbican_endpoint = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] barbican.barbican_endpoint_type = public {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] barbican.barbican_region_name = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] barbican.cafile = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] barbican.certfile = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] barbican.collect_timing = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] barbican.insecure = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] barbican.keyfile = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] barbican.number_of_retries = 60 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] barbican.retry_delay = 1 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] barbican.send_service_user_token = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] barbican.split_loggers = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.056s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] barbican.timeout = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] barbican.verify_ssl = True {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] barbican.verify_ssl_path = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] barbican_service_user.auth_section = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] barbican_service_user.auth_type = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] barbican_service_user.cafile = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] barbican_service_user.certfile = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] barbican_service_user.collect_timing = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] barbican_service_user.insecure = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] barbican_service_user.keyfile = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] barbican_service_user.split_loggers = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] barbican_service_user.timeout = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] vault.approle_role_id = **** {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] vault.approle_secret_id = **** {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] vault.auth_method = approle {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] vault.auth_path = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] vault.kv_mountpoint = secret {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] vault.kv_path = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] vault.kv_version = 2 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] vault.namespace = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] vault.root_token_id = **** {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] vault.ssl_ca_crt_file = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] vault.timeout = 60.0 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] vault.token_file = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] vault.token_role = None {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] vault.use_ssl = False {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:32:57 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] ******************************************************************************** {{(pid=77831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 31 10:32:57 devstack sudo[77990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 31 10:32:57 devstack sudo[77990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:32:57 devstack sudo[77990]: pam_unix(sudo:session): session closed for user root Jul 31 10:32:57 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.347s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:32:57 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:32:58 devstack sudo[78082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 10:32:58 devstack sudo[78082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:32:58 devstack sudo[78082]: pam_unix(sudo:session): session closed for user root Jul 31 10:32:58 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.357s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:32:58 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 10:32:58 devstack cinder-volume[77986]: INFO cinder.brick.local_dev.lvm [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 31 10:32:58 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:32:58 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:32:58 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:32:58 devstack sudo[78191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 10:32:58 devstack sudo[78191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:32:58 devstack sudo[78191]: pam_unix(sudo:session): session closed for user root Jul 31 10:32:58 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:32:58 devstack cinder-volume[77986]: DEBUG cinder.brick.local_dev.lvm [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77986) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 31 10:32:58 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:32:58 devstack sudo[78287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 10:32:58 devstack sudo[78287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:32:59 devstack sudo[78287]: pam_unix(sudo:session): session closed for user root Jul 31 10:32:59 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.506s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:32:59 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:32:59 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:32:59 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:32:59 devstack sudo[78475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 10:32:59 devstack sudo[78475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:32:59 devstack sudo[78475]: pam_unix(sudo:session): session closed for user root Jul 31 10:32:59 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.339s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:32:59 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:32:59 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:32:59 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:32:59 devstack sudo[78601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 31 10:32:59 devstack sudo[78601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:32:59 devstack sudo[78601]: pam_unix(sudo:session): session closed for user root Jul 31 10:32:59 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.274s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:32:59 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:32:59 devstack sudo[78604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 10:32:59 devstack sudo[78604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:33:00 devstack sudo[78604]: pam_unix(sudo:session): session closed for user root Jul 31 10:33:00 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.342s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:33:00 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:33:00 devstack sudo[78688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 10:33:00 devstack sudo[78688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:33:00 devstack sudo[78688]: pam_unix(sudo:session): session closed for user root Jul 31 10:33:00 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:33:00 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:33:00 devstack sudo[78691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:33:00 devstack sudo[78691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:33:00 devstack sudo[78691]: pam_unix(sudo:session): session closed for user root Jul 31 10:33:00 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.315s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:33:00 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:33:00 devstack sudo[78737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 10:33:00 devstack sudo[78737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:33:01 devstack sudo[78737]: pam_unix(sudo:session): session closed for user root Jul 31 10:33:01 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.336s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:33:01 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:33:01 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:33:01 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:33:01 devstack sudo[78784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 10:33:01 devstack sudo[78784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:33:01 devstack sudo[78784]: pam_unix(sudo:session): session closed for user root Jul 31 10:33:01 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:33:01 devstack cinder-volume[77986]: INFO cinder.volume.drivers.lvm [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 31 10:33:01 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:33:01 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:33:01 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:33:01 devstack sudo[78788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 10:33:01 devstack sudo[78788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:33:01 devstack sudo[78788]: pam_unix(sudo:session): session closed for user root Jul 31 10:33:01 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.313s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:33:01 devstack cinder-volume[77986]: DEBUG cinder.volume.drivers.lvm [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Updating volume stats {{(pid=77986) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 31 10:33:01 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:33:01 devstack sudo[78791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 10:33:01 devstack sudo[78791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:33:01 devstack sudo[78791]: pam_unix(sudo:session): session closed for user root Jul 31 10:33:01 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:33:01 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:33:02 devstack sudo[78794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:33:02 devstack sudo[78794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:33:02 devstack sudo[78794]: pam_unix(sudo:session): session closed for user root Jul 31 10:33:02 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:33:02 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:33:02 devstack sudo[78803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 10:33:02 devstack sudo[78803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:33:02 devstack sudo[78803]: pam_unix(sudo:session): session closed for user root Jul 31 10:33:02 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:33:02 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:33:02 devstack sudo[78806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:33:02 devstack sudo[78806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:33:02 devstack sudo[78806]: pam_unix(sudo:session): session closed for user root Jul 31 10:33:02 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:33:02 devstack cinder-volume[77986]: INFO cinder.volume.driver [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Driver hasn't implemented _init_vendor_properties() Jul 31 10:33:02 devstack cinder-volume[77986]: DEBUG cinder.volume.driver [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77986) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 31 10:33:02 devstack cinder-volume[77986]: DEBUG oslo_db.sqlalchemy.engines [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77986) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 10:33:02 devstack cinder-volume[77986]: DEBUG dbcounter [-] [77986] Writer thread running {{(pid=77986) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 31 10:33:02 devstack cinder-volume[77986]: DEBUG cinder.db.api [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Building query based on filter {{(pid=77986) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 31 10:33:02 devstack cinder-volume[77986]: DEBUG cinder.image.image_utils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77986) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 31 10:33:02 devstack cinder-volume[77986]: INFO cinder.keymgr.migration [None req-9c648e76-4ac2-4874-811d-1175c687c31c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 31 10:33:02 devstack cinder-volume[77986]: DEBUG cinder.volume.drivers.lvm [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Updating volume stats {{(pid=77986) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 31 10:33:02 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:33:02 devstack sudo[78809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 10:33:02 devstack sudo[78809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:33:03 devstack sudo[78809]: pam_unix(sudo:session): session closed for user root Jul 31 10:33:03 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:33:03 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:33:03 devstack sudo[78813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:33:03 devstack sudo[78813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:33:03 devstack sudo[78813]: pam_unix(sudo:session): session closed for user root Jul 31 10:33:03 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.304s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:33:03 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:33:03 devstack sudo[78818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 10:33:03 devstack sudo[78818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:33:03 devstack sudo[78818]: pam_unix(sudo:session): session closed for user root Jul 31 10:33:03 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:33:03 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:33:03 devstack sudo[78821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:33:03 devstack sudo[78821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:33:04 devstack sudo[78821]: pam_unix(sudo:session): session closed for user root Jul 31 10:33:04 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:33:04 devstack cinder-volume[77986]: DEBUG cinder.manager [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Notifying Schedulers of capabilities ... {{(pid=77986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:33:04 devstack cinder-volume[77986]: INFO cinder.volume.manager [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Driver initialization completed successfully. Jul 31 10:33:04 devstack cinder-volume[77986]: INFO cinder.manager [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Initiating service 2 cleanup Jul 31 10:33:04 devstack cinder-volume[77986]: INFO cinder.manager [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Service 2 cleanup completed. Jul 31 10:33:04 devstack cinder-volume[77986]: DEBUG cinder.service [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Creating RPC server for service cinder-volume {{(pid=77986) start /opt/stack/cinder/cinder/service.py:231}} Jul 31 10:33:04 devstack cinder-volume[77986]: DEBUG cinder.service [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77986) start /opt/stack/cinder/cinder/service.py:237}} Jul 31 10:33:04 devstack cinder-volume[77986]: INFO cinder.volume.manager [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 31 10:33:04 devstack cinder-volume[77986]: DEBUG cinder.volume.drivers.lvm [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Updating volume stats {{(pid=77986) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 31 10:33:04 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:33:04 devstack sudo[78826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 10:33:04 devstack sudo[78826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:33:04 devstack sudo[78826]: pam_unix(sudo:session): session closed for user root Jul 31 10:33:04 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:33:04 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:33:04 devstack sudo[78829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:33:04 devstack sudo[78829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:33:04 devstack sudo[78829]: pam_unix(sudo:session): session closed for user root Jul 31 10:33:04 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:33:04 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:33:04 devstack sudo[78832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 10:33:04 devstack sudo[78832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:33:05 devstack sudo[78832]: pam_unix(sudo:session): session closed for user root Jul 31 10:33:05 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:33:05 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:33:05 devstack sudo[78835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:33:05 devstack sudo[78835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:33:05 devstack sudo[78835]: pam_unix(sudo:session): session closed for user root Jul 31 10:33:05 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:33:05 devstack cinder-volume[77986]: INFO cinder.volume.manager [None req-3a95c03f-f33c-4f2c-8795-a3a9410e27be None None] Driver post RPC initialization completed successfully. Jul 31 10:33:07 devstack cinder-volume[77831]: DEBUG dbcounter [-] [77831] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77831) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:33:14 devstack cinder-volume[77986]: DEBUG dbcounter [-] [77986] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77986) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:33:15 devstack cinder-volume[77986]: DEBUG dbcounter [-] [77986] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=77986) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:33:37 devstack cinder-volume[77986]: DEBUG oslo_service.periodic_task [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] Running periodic task VolumeManager._thread_info {{(pid=77986) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:33:37 devstack cinder-volume[77986]: DEBUG cinder.volume.manager [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] thread count: 6 {{(pid=77986) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:33:37 devstack cinder-volume[77986]: DEBUG cinder.volume.manager [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] thread info: [<_MainThread(MainThread, started 132687558434944)>, , , , , ] {{(pid=77986) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:34:37 devstack cinder-volume[77986]: DEBUG oslo_service.periodic_task [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77986) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:34:37 devstack cinder-volume[77986]: DEBUG cinder.volume.drivers.lvm [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] Updating volume stats {{(pid=77986) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 31 10:34:37 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:34:37 devstack sudo[81484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 10:34:37 devstack sudo[81484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:34:37 devstack sudo[81484]: pam_unix(sudo:session): session closed for user root Jul 31 10:34:37 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:34:37 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:34:37 devstack sudo[81487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:34:37 devstack sudo[81487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:34:37 devstack sudo[81487]: pam_unix(sudo:session): session closed for user root Jul 31 10:34:37 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:34:37 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:34:37 devstack sudo[81490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 10:34:37 devstack sudo[81490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:34:38 devstack sudo[81490]: pam_unix(sudo:session): session closed for user root Jul 31 10:34:38 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:34:38 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:34:38 devstack sudo[81493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:34:38 devstack sudo[81493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:34:38 devstack sudo[81493]: pam_unix(sudo:session): session closed for user root Jul 31 10:34:38 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:34:38 devstack cinder-volume[77986]: DEBUG cinder.manager [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] Notifying Schedulers of capabilities ... {{(pid=77986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:34:38 devstack cinder-volume[77986]: DEBUG oslo_service.periodic_task [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] Running periodic task VolumeManager._thread_info {{(pid=77986) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:34:38 devstack cinder-volume[77986]: DEBUG cinder.volume.manager [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] thread count: 6 {{(pid=77986) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:34:38 devstack cinder-volume[77986]: DEBUG cinder.volume.manager [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] thread info: [<_MainThread(MainThread, started 132687558434944)>, , , , , ] {{(pid=77986) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:35:15 devstack cinder-volume[77986]: DEBUG dbcounter [-] [77986] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=77986) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:35:37 devstack cinder-volume[77986]: DEBUG oslo_service.periodic_task [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77986) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:35:37 devstack cinder-volume[77986]: DEBUG cinder.volume.drivers.lvm [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] Updating volume stats {{(pid=77986) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 31 10:35:37 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:35:37 devstack sudo[85154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 10:35:37 devstack sudo[85154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:35:37 devstack sudo[85154]: pam_unix(sudo:session): session closed for user root Jul 31 10:35:37 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:35:37 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:35:37 devstack sudo[85172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:35:37 devstack sudo[85172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:35:37 devstack sudo[85172]: pam_unix(sudo:session): session closed for user root Jul 31 10:35:37 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:35:37 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:35:37 devstack sudo[85196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 10:35:37 devstack sudo[85196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:35:38 devstack sudo[85196]: pam_unix(sudo:session): session closed for user root Jul 31 10:35:38 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:35:38 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:35:38 devstack sudo[85211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:35:38 devstack sudo[85211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:35:38 devstack sudo[85211]: pam_unix(sudo:session): session closed for user root Jul 31 10:35:38 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:35:38 devstack cinder-volume[77986]: DEBUG cinder.manager [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] Notifying Schedulers of capabilities ... {{(pid=77986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:35:38 devstack cinder-volume[77986]: DEBUG oslo_service.periodic_task [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] Running periodic task VolumeManager._thread_info {{(pid=77986) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:35:38 devstack cinder-volume[77986]: DEBUG cinder.volume.manager [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] thread count: 6 {{(pid=77986) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:35:38 devstack cinder-volume[77986]: DEBUG cinder.volume.manager [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] thread info: [<_MainThread(MainThread, started 132687558434944)>, , , , , ] {{(pid=77986) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:36:37 devstack cinder-volume[77986]: DEBUG oslo_service.periodic_task [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77986) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:36:37 devstack cinder-volume[77986]: DEBUG cinder.volume.drivers.lvm [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] Updating volume stats {{(pid=77986) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 31 10:36:37 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:36:37 devstack sudo[86775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 10:36:37 devstack sudo[86775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:36:37 devstack sudo[86775]: pam_unix(sudo:session): session closed for user root Jul 31 10:36:37 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:36:37 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:36:37 devstack sudo[86790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:36:37 devstack sudo[86790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:36:37 devstack sudo[86790]: pam_unix(sudo:session): session closed for user root Jul 31 10:36:37 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:36:37 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:36:37 devstack sudo[86793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 10:36:37 devstack sudo[86793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:36:38 devstack sudo[86793]: pam_unix(sudo:session): session closed for user root Jul 31 10:36:38 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:36:38 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:36:38 devstack sudo[86796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:36:38 devstack sudo[86796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:36:38 devstack sudo[86796]: pam_unix(sudo:session): session closed for user root Jul 31 10:36:38 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:36:38 devstack cinder-volume[77986]: DEBUG cinder.manager [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] Notifying Schedulers of capabilities ... {{(pid=77986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:36:38 devstack cinder-volume[77986]: DEBUG oslo_service.periodic_task [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] Running periodic task VolumeManager._thread_info {{(pid=77986) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:36:38 devstack cinder-volume[77986]: DEBUG cinder.volume.manager [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] thread count: 6 {{(pid=77986) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:36:38 devstack cinder-volume[77986]: DEBUG cinder.volume.manager [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] thread info: [<_MainThread(MainThread, started 132687558434944)>, , , , , ] {{(pid=77986) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:37:15 devstack cinder-volume[77986]: DEBUG dbcounter [-] [77986] Writing DB stats cinder:SELECT=1 {{(pid=77986) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:37:15 devstack cinder-volume[77986]: DEBUG dbcounter [-] [77986] Writing DB stats cinder:UPDATE=1 {{(pid=77986) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:37:37 devstack cinder-volume[77986]: DEBUG oslo_service.periodic_task [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77986) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:37:37 devstack cinder-volume[77986]: DEBUG cinder.volume.drivers.lvm [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] Updating volume stats {{(pid=77986) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 31 10:37:37 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:37:37 devstack sudo[88083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 10:37:37 devstack sudo[88083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:37:37 devstack cinder-volume[77831]: INFO oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] Caught SIGTERM, stopping children Jul 31 10:37:37 devstack cinder-volume[77831]: DEBUG oslo_concurrency.lockutils [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] Acquiring lock "singleton_lock" {{(pid=77831) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 31 10:37:37 devstack cinder-volume[77831]: DEBUG oslo_concurrency.lockutils [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] Acquired lock "singleton_lock" {{(pid=77831) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 31 10:37:37 devstack cinder-volume[77831]: DEBUG oslo_concurrency.lockutils [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] Releasing lock "singleton_lock" {{(pid=77831) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 31 10:37:37 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] Stop services. {{(pid=77831) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 31 10:37:37 devstack cinder-volume[77831]: DEBUG oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] Killing children. {{(pid=77831) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 31 10:37:37 devstack cinder-volume[77831]: INFO oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] Waiting on 1 children to exit Jul 31 10:37:37 devstack sudo[88083]: pam_unix(sudo:session): session closed for user root Jul 31 10:37:37 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:37:37 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:37:37 devstack sudo[88088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:37:37 devstack sudo[88088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:37:37 devstack sudo[88088]: pam_unix(sudo:session): session closed for user root Jul 31 10:37:37 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:37:37 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:37:37 devstack sudo[88091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 10:37:37 devstack sudo[88091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:37:38 devstack sudo[88091]: pam_unix(sudo:session): session closed for user root Jul 31 10:37:38 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:37:38 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:37:38 devstack sudo[88094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:37:38 devstack sudo[88094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:37:38 devstack sudo[88094]: pam_unix(sudo:session): session closed for user root Jul 31 10:37:38 devstack cinder-volume[77986]: DEBUG oslo_concurrency.processutils [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=77986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:37:38 devstack cinder-volume[77986]: DEBUG cinder.manager [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] Notifying Schedulers of capabilities ... {{(pid=77986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:37:38 devstack cinder-volume[77986]: DEBUG oslo_service.periodic_task [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] Running periodic task VolumeManager._thread_info {{(pid=77986) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:37:38 devstack cinder-volume[77986]: DEBUG cinder.volume.manager [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] thread count: 6 {{(pid=77986) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:37:38 devstack cinder-volume[77986]: DEBUG cinder.volume.manager [None req-932d2a61-e55b-4bb7-9815-902cf102b5f8 None None] thread info: [<_MainThread(MainThread, started 132687558434944)>, , , , , ] {{(pid=77986) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:37:39 devstack cinder-volume[77986]: DEBUG oslo_concurrency.lockutils [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] Acquiring lock "singleton_lock" {{(pid=77986) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 31 10:37:39 devstack cinder-volume[77986]: DEBUG oslo_concurrency.lockutils [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] Acquired lock "singleton_lock" {{(pid=77986) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 31 10:37:39 devstack cinder-volume[77986]: DEBUG oslo_concurrency.lockutils [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] Releasing lock "singleton_lock" {{(pid=77986) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 31 10:37:39 devstack cinder-volume[77986]: WARNING amqp [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 31 10:37:39 devstack cinder-volume[77986]: WARNING amqp [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 31 10:37:39 devstack cinder-volume[77831]: INFO oslo_service.backend._eventlet.service [None req-39e7a064-029a-4ea3-94cc-517795d204db None None] Child 77986 exited with status 0 Jul 31 10:37:39 devstack cinder-volume[88101]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 31 10:37:39 devstack cinder-volume[88101]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 31 10:37:39 devstack cinder-volume[88101]: we strongly recommend against using it for new projects. Jul 31 10:37:39 devstack cinder-volume[88101]: If you are already using Eventlet, we recommend migrating to a different Jul 31 10:37:39 devstack cinder-volume[88101]: framework. For more detail see Jul 31 10:37:39 devstack cinder-volume[88101]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 31 10:37:39 devstack cinder-volume[88101]: import eventlet # noqa Jul 31 10:37:41 devstack cinder-volume[88101]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88101) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 31 10:37:41 devstack cinder-volume[88101]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88101) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 31 10:37:41 devstack cinder-volume[88101]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88101) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 31 10:37:42 devstack cinder-volume[88101]: INFO dbcounter [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] Registered counter for database cinder Jul 31 10:37:42 devstack cinder-volume[88101]: DEBUG oslo_db.sqlalchemy.engines [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88101) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG dbcounter [-] [88101] Writer thread running {{(pid=88101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 31 10:37:43 devstack cinder-volume[88101]: INFO cinder.rpc [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 31 10:37:43 devstack cinder-volume[88101]: INFO cinder.rpc [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_db.sqlalchemy.engines [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88101) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 10:37:43 devstack cinder-volume[88101]: INFO cinder.volume.manager [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] Determined volume DB was empty at startup. Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG cinder.volume.manager [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88101) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 31 10:37:43 devstack cinder-volume[88101]: INFO cinder.volume.manager [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 31 10:37:43 devstack cinder-volume[88101]: WARNING stevedore.named [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 31 10:37:43 devstack cinder-volume[88101]: WARNING castellan.key_manager [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 31 10:37:43 devstack cinder-volume[88101]: WARNING cinder.keymgr.conf_key_mgr [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 31 10:37:43 devstack cinder-volume[88101]: INFO cinder.volume.manager [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_db.sqlalchemy.engines [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88101) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 10:37:43 devstack cinder-volume[88101]: INFO oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] Starting 1 workers Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] Started child 88319 {{(pid=88101) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] Full set of CONF: {{(pid=88101) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] ******************************************************************************** {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] Configuration options gathered from: {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] ================================================================================ {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] allow_availability_zone_fallback = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88319]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] allow_compression_on_image_upload = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] allowed_direct_url_schemes = [] {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] api_rate_limit = True {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] auth_strategy = keystone {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_availability_zone = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_host = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_name = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_stats_polling_interval = 60 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backup_api_class = cinder.backup.api.API {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backup_name_template = backup-%s {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backup_use_same_host = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backup_use_temp_snapshot = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] chap_password = **** {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] chap_username = {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cinder_internal_tenant_project_id = c07150e871bd4109b1095ba6bac152e4 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cinder_internal_tenant_user_id = 919160d555e64942a3f9db0e95a0a2c0 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cluster = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] compression_format = gzip {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] compute_api_class = cinder.compute.nova.API {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] config_dir = [] {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] config_source = [] {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] control_exchange = openstack {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] debug = True {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] default_availability_zone = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] default_group_type = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] default_volume_type = QuobyteHD {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] disk_geometry = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] driver_client_cert = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] driver_client_cert_key = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] driver_data_namespace = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] driver_ssl_cert_path = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] driver_ssl_cert_verify = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] driver_use_ssl = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] enable_new_services = True {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] enable_unsupported_driver = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] enabled_backends = ['QuobyteHD'] {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] enforce_multipath_for_image_xfer = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] filter_function = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] glance_api_insecure = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] glance_api_servers = ['http://192.168.122.164/image'] {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] glance_api_ssl_compression = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] glance_ca_certificates_file = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] glance_catalog_info = image:glance:publicURL {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] glance_certfile = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] glance_keyfile = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] glance_num_retries = 3 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] glance_request_timeout = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] goodness_function = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] graceful_shutdown_timeout = 5 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] group_api_class = cinder.group.api.API {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] host = devstack {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] image_compress_on_upload = True {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] image_conversion_address_space_limit = 1 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] image_conversion_cpu_limit = 60 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] image_conversion_disable = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] image_upload_use_cinder_backend = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] image_upload_use_internal_tenant = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] image_volume_cache_enabled = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] image_volume_cache_max_count = 0 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] image_volume_cache_max_size_gb = 0 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] init_host_max_objects_retrieval = 0 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] instance_format = [instance: %(uuid)s] {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] iscsi_target_flags = {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] iscsi_write_cache = on {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] iser_helper = tgtadm {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] iser_ip_address = 192.168.122.164 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] iser_port = 3260 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] log_color = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] log_config_append = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] log_dir = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] log_file = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] log_options = True {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] log_rotate_interval = 1 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] log_rotate_interval_type = days {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] log_rotation_type = none {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] max_age = 0 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] max_logfile_count = 30 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] max_logfile_size_mb = 200 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] max_over_subscription_ratio = 20.0 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88319]: INFO cinder.volume.manager [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] Starting volume driver QuobyteDriver (1.2) Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] message_reap_interval = 86400 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] message_ttl = 2592000 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88319]: DEBUG cinder.volume.drivers.remotefs [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88319) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] migration_create_volume_timeout_secs = 300 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] monkey_patch = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] monkey_patch_modules = [] {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] my_ip = 192.168.122.164 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] no_snapshot_gb_quota = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] num_iser_scan_tries = 3 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] num_shell_tries = 3 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] num_volume_device_scan_tries = 3 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] nvmeof_conn_info_version = 1 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] nvmet_ns_id = 10 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] nvmet_port_id = 1 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] osapi_max_limit = 1000 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] osapi_volume_ext_list = [] {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] osapi_volume_listen = 0.0.0.0 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] osapi_volume_listen_port = 8776 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] osapi_volume_use_ssl = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] osapi_volume_workers = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] per_volume_size_limit = -1 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] periodic_fuzzy_delay = 60 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] periodic_interval = 60 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] project_id_regex = [0-9a-f\-]+ {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] public_endpoint = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] publish_errors = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] quota_backup_gigabytes = 1000 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] quota_backups = 10 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] quota_gigabytes = 1000 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] quota_groups = 10 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] quota_snapshots = 10 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] quota_volumes = 10 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] rate_limit_burst = 0 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] rate_limit_except_level = CRITICAL {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] rate_limit_interval = 0 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] reinit_driver_count = 3 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] replication_device = **** {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] report_discard_supported = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] report_interval = 120 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] reservation_clean_interval = 86400 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] reservation_expire = 86400 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] reserved_image_namespaces = [] {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] reserved_percentage = 0 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] rpc_response_timeout = 120 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] run_external_periodic_tasks = True {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] scst_target_driver = iscsi {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] scst_target_iqn_name = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] service_down_time = 720 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] shell_completion = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] snapshot_name_template = snapshot-%s {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] split_loggers = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] state_path = /opt/stack/data/cinder {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] storage_availability_zone = nova {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] storage_protocol = iSCSI {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] syslog_log_facility = LOG_USER {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] target_helper = lioadm {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] target_ip_address = 192.168.122.164 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] target_port = 3260 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] target_protocol = iscsi {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] target_secondary_ip_addresses = [] {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] trace_flags = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] transfer_api_class = cinder.transfer.api.API {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] transport_url = **** {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] until_refresh = 0 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] use_chap_auth = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] use_default_quota_class = True {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] use_journal = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] use_json = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] use_multipath_for_image_xfer = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] use_stderr = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] use_syslog = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] verify_glance_signatures = enabled {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] volume_api_class = cinder.volume.api.API {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] volume_backend_name = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] volume_clear = zero {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] volume_clear_ionice = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] volume_clear_size = 0 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] volume_copy_bps_limit = 0 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] volume_dd_blocksize = 1M {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] volume_name_template = volume-%s {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] volume_service_inithost_offload = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] volume_usage_audit_period = month {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] zoning_mode = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_concurrency.disable_process_locking = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] keystone_authtoken.auth_section = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] keystone_authtoken.auth_type = password {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] keystone_authtoken.auth_version = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] keystone_authtoken.cache = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] keystone_authtoken.certfile = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] keystone_authtoken.delay_auth_decision = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] keystone_authtoken.http_connect_timeout = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] keystone_authtoken.include_service_catalog = True {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] keystone_authtoken.insecure = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] keystone_authtoken.interface = public {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] keystone_authtoken.keyfile = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] keystone_authtoken.memcache_password = {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] keystone_authtoken.memcache_username = {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] keystone_authtoken.region_name = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] keystone_authtoken.service_token_roles_required = True {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] keystone_authtoken.service_type = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] keystone_authtoken.token_cache_time = 300 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.164/identity {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88319]: DEBUG cinder.volume.drivers.quobyte [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88319) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cache.backend = dogpile.cache.null {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88319]: WARNING cinder.volume.drivers.quobyte [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 31 10:37:43 devstack cinder-volume[88319]: WARNING cinder.volume.drivers.quobyte [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cache.backend_argument = **** {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cache.backend_expiration_time = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cache.config_prefix = cache.oslo {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cache.debug_cache_backend = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cache.enable_retry_client = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88319]: DEBUG oslo_concurrency.processutils [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] Running cmd (subprocess): mount.quobyte {{(pid=88319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cache.enable_socket_keepalive = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cache.enabled = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cache.expiration_time = 600 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cache.hashclient_retry_attempts = 2 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cache.memcache_dead_retry = 300 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cache.memcache_pool_maxsize = 10 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cache.memcache_sasl_enabled = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cache.password = **** {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cache.proxies = [] {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cache.redis_db = 0 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cache.redis_sentinel_service_name = mymaster {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cache.redis_server = localhost:6379 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cache.retry_attempts = 2 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cache.retry_delay = 0.0 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cache.socket_keepalive_count = 1 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cache.socket_keepalive_idle = 1 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cache.socket_keepalive_interval = 1 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cache.socket_timeout = 1.0 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cache.tls_allowed_ciphers = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cache.tls_cafile = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cache.tls_certfile = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cache.tls_enabled = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cache.tls_keyfile = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cache.username = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] coordination.backend_url = **** {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] database.asyncio_connection = **** {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] database.asyncio_slave_connection = **** {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] database.backend = sqlalchemy {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] database.connection = **** {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] database.connection_debug = 0 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] database.connection_parameters = {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] database.connection_recycle_time = 3600 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] database.connection_trace = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] database.db_inc_retry_interval = True {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] database.db_max_retries = 20 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] database.db_max_retry_interval = 10 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] database.db_retry_interval = 1 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] database.max_overflow = 50 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] database.max_pool_size = 5 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] database.max_retries = 10 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] database.mysql_wsrep_sync_wait = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] database.pool_timeout = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] database.retry_interval = 10 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] database.slave_connection = **** {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] database.sqlite_synchronous = True {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] database.synchronous_reader = True {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] database.use_db_reconnect = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] profiler.connection_string = messaging:// {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] profiler.enabled = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] profiler.es_doc_type = notification {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] profiler.es_scroll_size = 10000 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] profiler.es_scroll_time = 2m {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] profiler.filter_error_trace = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] profiler.hmac_keys = **** {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] profiler.sentinel_service_name = mymaster {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] profiler.socket_timeout = 0.1 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] profiler.trace_requests = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] profiler.trace_sqlalchemy = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] profiler_jaeger.process_tags = {} {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] profiler_jaeger.service_name_prefix = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] profiler_otlp.service_name_prefix = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_policy.enforce_new_defaults = True {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_policy.policy_default_rule = default {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_policy.policy_file = policy.yaml {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_policy.remote_timeout = 60.0 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] privsep_osbrick.group = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] privsep_osbrick.helper_command = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] privsep_osbrick.user = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cinder_sys_admin.group = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cinder_sys_admin.helper_command = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] cinder_sys_admin.user = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] service_user.auth_section = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] service_user.auth_type = password {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] service_user.cafile = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] service_user.certfile = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] service_user.collect_timing = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] service_user.insecure = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] service_user.keyfile = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] service_user.send_service_user_token = True {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] service_user.split_loggers = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] service_user.timeout = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] glance.auth_section = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] glance.auth_type = password {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] glance.certfile = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] glance.collect_timing = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] glance.insecure = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] glance.keyfile = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] glance.region_name = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] glance.split_loggers = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] glance.timeout = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.backend_availability_zone = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.chap_password = **** {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.chap_username = {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.disk_geometry = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.driver_client_cert = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.driver_client_cert_key = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.driver_data_namespace = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.driver_use_ssl = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.enable_unsupported_driver = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.extra_capabilities = {} {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.filter_function = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.goodness_function = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.iscsi_target_flags = {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.iscsi_write_cache = on {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.iser_helper = tgtadm {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.iser_ip_address = 192.168.122.164 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.iser_port = 3260 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.nas_host = {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.nas_login = admin {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.nas_mount_options = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.nas_password = **** {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.nas_private_key = {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.nas_share_path = {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.nas_ssh_port = 22 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.num_shell_tries = 3 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.nvmet_port_id = 1 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.quobyte_client_cfg = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.quobyte_volume_url = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.replication_device = **** {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.report_discard_supported = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.reserved_percentage = 0 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.scst_target_driver = iscsi {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.scst_target_iqn_name = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.storage_protocol = iSCSI {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.target_helper = tgtadm {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.target_ip_address = 192.168.122.164 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.target_port = 3260 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.target_protocol = iscsi {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.trace_flags = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.unique_fqdn_network = True {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.use_chap_auth = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.volume_backend_name = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.volume_clear = zero {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.volume_clear_ionice = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.volume_clear_size = 0 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_reports.file_event_handler = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_reports.log_dir = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.backend_availability_zone = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.backend_host = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.chap_password = **** {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.chap_username = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.chiscsi_conf = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.disk_geometry = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.driver_client_cert = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.driver_client_cert_key = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.driver_data_namespace = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.driver_use_ssl = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.extra_capabilities = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.filter_function = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.goodness_function = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.iscsi_target_flags = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.iscsi_write_cache = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.iser_helper = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.iser_ip_address = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.iser_port = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.iser_target_prefix = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.nas_host = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.nas_login = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.nas_mount_options = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.nas_password = **** {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.nas_private_key = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.nas_share_path = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.nas_ssh_port = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.num_shell_tries = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.nvmet_ns_id = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.nvmet_port_id = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.replication_device = **** {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.report_discard_supported = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.reserved_percentage = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.scst_target_driver = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.storage_protocol = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.target_helper = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.target_ip_address = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.target_port = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.target_prefix = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.target_protocol = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.trace_flags = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.unique_fqdn_network = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.use_chap_auth = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.volume_clear = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.volume_clear_ionice = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.volume_clear_size = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] QuobyteHD.volumes_dir = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack quobyte-client[88320]: Reading configuration file: /etc/quobyte/client.cfg Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_rabbit.ssl = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack quobyte-client[88320]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_rabbit.ssl_version = {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_notifications.driver = [] {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_notifications.retry = -1 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] oslo_messaging_notifications.transport_url = **** {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] key_manager.fixed_key = **** {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] barbican.barbican_api_version = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] barbican.barbican_endpoint = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] barbican.barbican_endpoint_type = public {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] barbican.barbican_region_name = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] barbican.cafile = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] barbican.certfile = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] barbican.collect_timing = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] barbican.insecure = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] barbican.keyfile = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88319]: DEBUG oslo_concurrency.processutils [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] CMD "mount.quobyte" returned: 1 in 0.140s {{(pid=88319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] barbican.number_of_retries = 60 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] barbican.retry_delay = 1 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] barbican.send_service_user_token = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88319]: DEBUG oslo_concurrency.lockutils [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] barbican.split_loggers = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] barbican.timeout = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88319]: DEBUG oslo_concurrency.lockutils [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] barbican.verify_ssl = True {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88319]: DEBUG cinder.volume.drivers.quobyte [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=88319) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] barbican.verify_ssl_path = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] barbican_service_user.auth_section = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] barbican_service_user.auth_type = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88319]: INFO cinder.volume.drivers.quobyte [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c ... Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] barbican_service_user.cafile = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] barbican_service_user.certfile = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88319]: DEBUG oslo_concurrency.processutils [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 -c /etc/quobyte/client-cinder.cfg {{(pid=88319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] barbican_service_user.collect_timing = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] barbican_service_user.insecure = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] barbican_service_user.keyfile = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] barbican_service_user.split_loggers = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] barbican_service_user.timeout = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] vault.approle_role_id = **** {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] vault.approle_secret_id = **** {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] vault.auth_method = approle {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] vault.auth_path = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] vault.kv_mountpoint = secret {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] vault.kv_path = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] vault.kv_version = 2 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] vault.namespace = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] vault.root_token_id = **** {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] vault.ssl_ca_crt_file = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] vault.timeout = 60.0 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] vault.token_file = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] vault.token_role = None {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] vault.use_ssl = False {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:43 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] ******************************************************************************** {{(pid=88101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 31 10:37:43 devstack sudo[88321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 -c /etc/quobyte/client-cinder.cfg Jul 31 10:37:43 devstack sudo[88321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:37:44 devstack sudo[88321]: pam_unix(sudo:session): session closed for user root Jul 31 10:37:44 devstack cinder-volume[88319]: DEBUG oslo_concurrency.processutils [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.492s {{(pid=88319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:37:44 devstack cinder-volume[88319]: INFO cinder.volume.drivers.quobyte [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c succeeded Jul 31 10:37:44 devstack cinder-volume[88319]: DEBUG cinder.volume.drivers.quobyte [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=88319) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:37:44 devstack cinder-volume[88319]: DEBUG oslo_concurrency.lockutils [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.507s {{(pid=88319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:37:44 devstack cinder-volume[88319]: DEBUG oslo_concurrency.processutils [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=88319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:37:44 devstack sudo[88403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:37:44 devstack sudo[88403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:37:44 devstack sudo[88403]: pam_unix(sudo:session): session closed for user root Jul 31 10:37:44 devstack cinder-volume[88319]: DEBUG oslo_concurrency.processutils [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.248s {{(pid=88319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:37:44 devstack cinder-volume[88319]: INFO cinder.volume.driver [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] Driver hasn't implemented _init_vendor_properties() Jul 31 10:37:44 devstack cinder-volume[88319]: DEBUG cinder.volume.driver [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.752670288086, 'free_capacity_gb': 1775.752670288086, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88319) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 31 10:37:44 devstack cinder-volume[88319]: DEBUG oslo_db.sqlalchemy.engines [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 10:37:44 devstack cinder-volume[88319]: DEBUG dbcounter [-] [88319] Writer thread running {{(pid=88319) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 31 10:37:44 devstack cinder-volume[88319]: DEBUG cinder.db.api [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] Building query based on filter {{(pid=88319) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 31 10:37:44 devstack cinder-volume[88319]: DEBUG cinder.image.image_utils [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88319) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 31 10:37:44 devstack cinder-volume[88319]: INFO cinder.keymgr.migration [None req-749d3d3d-d895-4b82-8183-d8791ebcfc3e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 31 10:37:44 devstack cinder-volume[88319]: DEBUG oslo_concurrency.lockutils [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:37:44 devstack cinder-volume[88319]: DEBUG oslo_concurrency.lockutils [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:37:44 devstack cinder-volume[88319]: DEBUG cinder.volume.drivers.quobyte [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=88319) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:37:44 devstack cinder-volume[88319]: DEBUG cinder.volume.drivers.quobyte [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=88319) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:37:44 devstack cinder-volume[88319]: DEBUG oslo_concurrency.lockutils [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:37:44 devstack cinder-volume[88319]: DEBUG oslo_concurrency.processutils [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=88319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:37:44 devstack sudo[88414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:37:44 devstack sudo[88414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:37:44 devstack sudo[88414]: pam_unix(sudo:session): session closed for user root Jul 31 10:37:44 devstack cinder-volume[88319]: DEBUG oslo_concurrency.processutils [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.260s {{(pid=88319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:37:44 devstack cinder-volume[88319]: DEBUG cinder.manager [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] Notifying Schedulers of capabilities ... {{(pid=88319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:37:44 devstack cinder-volume[88319]: INFO cinder.volume.manager [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] Driver initialization completed successfully. Jul 31 10:37:44 devstack cinder-volume[88319]: INFO cinder.manager [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] Initiating service 3 cleanup Jul 31 10:37:44 devstack cinder-volume[88319]: INFO cinder.manager [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] Service 3 cleanup completed. Jul 31 10:37:44 devstack cinder-volume[88319]: DEBUG cinder.service [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] Creating RPC server for service cinder-volume {{(pid=88319) start /opt/stack/cinder/cinder/service.py:231}} Jul 31 10:37:44 devstack cinder-volume[88319]: DEBUG cinder.service [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88319) start /opt/stack/cinder/cinder/service.py:237}} Jul 31 10:37:45 devstack cinder-volume[88319]: INFO cinder.volume.manager [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 31 10:37:45 devstack cinder-volume[88319]: DEBUG oslo_concurrency.lockutils [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:37:45 devstack cinder-volume[88319]: DEBUG oslo_concurrency.lockutils [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:37:45 devstack cinder-volume[88319]: DEBUG cinder.volume.drivers.quobyte [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=88319) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:37:45 devstack cinder-volume[88319]: DEBUG cinder.volume.drivers.quobyte [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=88319) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:37:45 devstack cinder-volume[88319]: DEBUG oslo_concurrency.lockutils [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:37:45 devstack cinder-volume[88319]: DEBUG oslo_concurrency.processutils [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=88319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:37:45 devstack sudo[88426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:37:45 devstack sudo[88426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:37:45 devstack sudo[88426]: pam_unix(sudo:session): session closed for user root Jul 31 10:37:45 devstack cinder-volume[88319]: DEBUG oslo_concurrency.processutils [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.299s {{(pid=88319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:37:45 devstack cinder-volume[88319]: INFO cinder.volume.manager [None req-77b11388-dad5-434d-b892-5446090a2c52 None None] Driver post RPC initialization completed successfully. Jul 31 10:37:49 devstack cinder-volume[88101]: INFO oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] Caught SIGTERM, stopping children Jul 31 10:37:49 devstack cinder-volume[88101]: DEBUG oslo_concurrency.lockutils [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] Acquiring lock "singleton_lock" {{(pid=88101) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 31 10:37:49 devstack cinder-volume[88101]: DEBUG oslo_concurrency.lockutils [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] Acquired lock "singleton_lock" {{(pid=88101) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 31 10:37:49 devstack cinder-volume[88101]: DEBUG oslo_concurrency.lockutils [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] Releasing lock "singleton_lock" {{(pid=88101) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 31 10:37:49 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] Stop services. {{(pid=88101) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 31 10:37:49 devstack cinder-volume[88101]: DEBUG oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] Killing children. {{(pid=88101) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 31 10:37:49 devstack cinder-volume[88101]: INFO oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] Waiting on 1 children to exit Jul 31 10:37:53 devstack cinder-volume[88319]: DEBUG oslo_concurrency.lockutils [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] Acquiring lock "singleton_lock" {{(pid=88319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 31 10:37:53 devstack cinder-volume[88319]: DEBUG oslo_concurrency.lockutils [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] Acquired lock "singleton_lock" {{(pid=88319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 31 10:37:53 devstack cinder-volume[88319]: DEBUG oslo_concurrency.lockutils [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] Releasing lock "singleton_lock" {{(pid=88319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 31 10:37:53 devstack cinder-volume[88319]: WARNING amqp [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 31 10:37:53 devstack cinder-volume[88319]: WARNING amqp [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 31 10:37:53 devstack cinder-volume[88101]: INFO oslo_service.backend._eventlet.service [None req-73cb5eaa-df09-4014-90bc-6b14240da841 None None] Child 88319 exited with status 0 Jul 31 10:37:53 devstack cinder-volume[88785]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 31 10:37:53 devstack cinder-volume[88785]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 31 10:37:53 devstack cinder-volume[88785]: we strongly recommend against using it for new projects. Jul 31 10:37:53 devstack cinder-volume[88785]: If you are already using Eventlet, we recommend migrating to a different Jul 31 10:37:53 devstack cinder-volume[88785]: framework. For more detail see Jul 31 10:37:53 devstack cinder-volume[88785]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 31 10:37:53 devstack cinder-volume[88785]: import eventlet # noqa Jul 31 10:37:56 devstack cinder-volume[88785]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88785) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 31 10:37:56 devstack cinder-volume[88785]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88785) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 31 10:37:56 devstack cinder-volume[88785]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88785) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 31 10:37:57 devstack cinder-volume[88785]: INFO dbcounter [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] Registered counter for database cinder Jul 31 10:37:57 devstack cinder-volume[88785]: DEBUG oslo_db.sqlalchemy.engines [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88785) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG dbcounter [-] [88785] Writer thread running {{(pid=88785) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 31 10:37:58 devstack cinder-volume[88785]: INFO cinder.rpc [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 31 10:37:58 devstack cinder-volume[88785]: INFO cinder.rpc [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_db.sqlalchemy.engines [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88785) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 10:37:58 devstack cinder-volume[88785]: INFO cinder.volume.manager [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] Determined volume DB was empty at startup. Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG cinder.volume.manager [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88785) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 31 10:37:58 devstack cinder-volume[88785]: WARNING stevedore.named [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 31 10:37:58 devstack cinder-volume[88785]: WARNING castellan.key_manager [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 31 10:37:58 devstack cinder-volume[88785]: WARNING cinder.keymgr.conf_key_mgr [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 31 10:37:58 devstack cinder-volume[88785]: INFO cinder.volume.manager [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_db.sqlalchemy.engines [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88785) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 10:37:58 devstack cinder-volume[88785]: INFO oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] Starting 1 workers Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] Started child 89090 {{(pid=88785) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] Full set of CONF: {{(pid=88785) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] ******************************************************************************** {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] Configuration options gathered from: {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] ================================================================================ {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] allow_availability_zone_fallback = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] allow_compression_on_image_upload = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] allowed_direct_url_schemes = [] {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] api_rate_limit = True {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] auth_strategy = keystone {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_availability_zone = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[89090]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_host = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_name = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_stats_polling_interval = 60 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backup_api_class = cinder.backup.api.API {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backup_name_template = backup-%s {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backup_use_same_host = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backup_use_temp_snapshot = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] chap_password = **** {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] chap_username = {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cinder_internal_tenant_project_id = c07150e871bd4109b1095ba6bac152e4 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cinder_internal_tenant_user_id = 919160d555e64942a3f9db0e95a0a2c0 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cluster = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] compression_format = gzip {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] compute_api_class = cinder.compute.nova.API {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] config_dir = [] {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] config_source = [] {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] control_exchange = openstack {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] debug = True {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] default_availability_zone = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] default_group_type = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] default_volume_type = QuobyteHD {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] disk_geometry = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] driver_client_cert = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] driver_client_cert_key = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] driver_data_namespace = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] driver_ssl_cert_path = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] driver_ssl_cert_verify = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] driver_use_ssl = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] enable_new_services = True {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] enable_unsupported_driver = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] enabled_backends = ['QuobyteHD'] {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] enforce_multipath_for_image_xfer = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] filter_function = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] glance_api_insecure = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] glance_api_servers = ['http://192.168.122.164/image'] {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] glance_api_ssl_compression = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] glance_ca_certificates_file = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] glance_catalog_info = image:glance:publicURL {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] glance_certfile = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] glance_keyfile = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] glance_num_retries = 3 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] glance_request_timeout = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] goodness_function = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] graceful_shutdown_timeout = 5 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] group_api_class = cinder.group.api.API {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] host = devstack {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] image_compress_on_upload = True {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] image_conversion_address_space_limit = 1 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] image_conversion_cpu_limit = 60 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] image_conversion_disable = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] image_upload_use_cinder_backend = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] image_upload_use_internal_tenant = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] image_volume_cache_enabled = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] image_volume_cache_max_count = 0 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] image_volume_cache_max_size_gb = 0 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] init_host_max_objects_retrieval = 0 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] instance_format = [instance: %(uuid)s] {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] iscsi_target_flags = {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] iscsi_write_cache = on {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] iser_helper = tgtadm {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] iser_ip_address = 192.168.122.164 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] iser_port = 3260 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] log_color = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] log_config_append = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] log_dir = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] log_file = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] log_options = True {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] log_rotate_interval = 1 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] log_rotate_interval_type = days {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] log_rotation_type = none {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] max_age = 0 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] max_logfile_count = 30 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] max_logfile_size_mb = 200 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] max_over_subscription_ratio = 20.0 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] message_reap_interval = 86400 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] message_ttl = 2592000 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] migration_create_volume_timeout_secs = 300 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] monkey_patch = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] monkey_patch_modules = [] {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] my_ip = 192.168.122.164 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] no_snapshot_gb_quota = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] num_iser_scan_tries = 3 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] num_shell_tries = 3 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] num_volume_device_scan_tries = 3 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] nvmeof_conn_info_version = 1 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] nvmet_ns_id = 10 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] nvmet_port_id = 1 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack quobyte-client[89091]: Reading configuration file: /etc/quobyte/client.cfg Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] osapi_max_limit = 1000 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] osapi_volume_ext_list = [] {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] osapi_volume_listen = 0.0.0.0 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] osapi_volume_listen_port = 8776 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] osapi_volume_use_ssl = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack quobyte-client[89091]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] osapi_volume_workers = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] per_volume_size_limit = -1 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] periodic_fuzzy_delay = 60 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] periodic_interval = 60 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] project_id_regex = [0-9a-f\-]+ {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] public_endpoint = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] publish_errors = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] quota_backup_gigabytes = 1000 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] quota_backups = 10 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] quota_gigabytes = 1000 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] quota_groups = 10 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] quota_snapshots = 10 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] quota_volumes = 10 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] rate_limit_burst = 0 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] rate_limit_except_level = CRITICAL {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] rate_limit_interval = 0 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] reinit_driver_count = 3 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] replication_device = **** {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] report_discard_supported = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] Starting volume driver QuobyteDriver (1.2) Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] report_interval = 120 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] reservation_clean_interval = 86400 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] reservation_expire = 86400 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] reserved_image_namespaces = [] {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=89090) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] reserved_percentage = 0 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] rpc_response_timeout = 120 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] run_external_periodic_tasks = True {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] scst_target_driver = iscsi {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] scst_target_iqn_name = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] service_down_time = 720 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] shell_completion = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] snapshot_name_template = snapshot-%s {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] split_loggers = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] state_path = /opt/stack/data/cinder {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] storage_availability_zone = nova {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] storage_protocol = iSCSI {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] syslog_log_facility = LOG_USER {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] target_helper = lioadm {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] target_ip_address = 192.168.122.164 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] target_port = 3260 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] target_protocol = iscsi {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] target_secondary_ip_addresses = [] {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] trace_flags = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] transfer_api_class = cinder.transfer.api.API {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] transport_url = **** {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] until_refresh = 0 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] use_chap_auth = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] use_default_quota_class = True {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] use_journal = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] use_json = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] use_multipath_for_image_xfer = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] use_stderr = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] use_syslog = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] verify_glance_signatures = enabled {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] volume_api_class = cinder.volume.api.API {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] volume_backend_name = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] volume_clear = zero {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] volume_clear_ionice = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] volume_clear_size = 0 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] volume_copy_bps_limit = 0 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] volume_dd_blocksize = 1M {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] volume_name_template = volume-%s {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] volume_service_inithost_offload = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] volume_usage_audit_period = month {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] zoning_mode = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_concurrency.disable_process_locking = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] keystone_authtoken.auth_section = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] keystone_authtoken.auth_type = password {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] keystone_authtoken.auth_version = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] keystone_authtoken.cache = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] keystone_authtoken.certfile = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] keystone_authtoken.include_service_catalog = True {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] keystone_authtoken.insecure = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] keystone_authtoken.interface = public {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] keystone_authtoken.keyfile = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] keystone_authtoken.memcache_password = {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] keystone_authtoken.memcache_username = {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] keystone_authtoken.region_name = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] keystone_authtoken.service_token_roles_required = True {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] keystone_authtoken.service_type = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.164/identity {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cache.backend = dogpile.cache.null {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cache.backend_argument = **** {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cache.backend_expiration_time = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cache.config_prefix = cache.oslo {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cache.debug_cache_backend = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cache.enable_retry_client = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cache.enable_socket_keepalive = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cache.enabled = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cache.expiration_time = 600 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cache.hashclient_retry_attempts = 2 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cache.memcache_dead_retry = 300 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cache.memcache_pool_maxsize = 10 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack sudo[89092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cache.memcache_sasl_enabled = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cache.password = **** {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cache.proxies = [] {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cache.redis_db = 0 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack sudo[89092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cache.redis_server = localhost:6379 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cache.retry_attempts = 2 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cache.retry_delay = 0.0 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cache.socket_keepalive_count = 1 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cache.socket_keepalive_idle = 1 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cache.socket_keepalive_interval = 1 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cache.socket_timeout = 1.0 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cache.tls_allowed_ciphers = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cache.tls_cafile = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cache.tls_certfile = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cache.tls_enabled = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cache.tls_keyfile = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cache.username = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] coordination.backend_url = **** {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] database.asyncio_connection = **** {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] database.asyncio_slave_connection = **** {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] database.backend = sqlalchemy {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] database.connection = **** {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] database.connection_debug = 0 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] database.connection_parameters = {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] database.connection_recycle_time = 3600 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] database.connection_trace = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] database.db_inc_retry_interval = True {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] database.db_max_retries = 20 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] database.db_max_retry_interval = 10 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] database.db_retry_interval = 1 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] database.max_overflow = 50 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] database.max_pool_size = 5 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] database.max_retries = 10 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] database.mysql_wsrep_sync_wait = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] database.pool_timeout = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] database.retry_interval = 10 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] database.slave_connection = **** {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] database.sqlite_synchronous = True {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] database.synchronous_reader = True {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] database.use_db_reconnect = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] profiler.connection_string = messaging:// {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] profiler.enabled = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] profiler.es_doc_type = notification {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] profiler.es_scroll_size = 10000 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] profiler.es_scroll_time = 2m {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] profiler.filter_error_trace = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] profiler.hmac_keys = **** {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] profiler.sentinel_service_name = mymaster {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] profiler.socket_timeout = 0.1 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] profiler.trace_requests = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] profiler.trace_sqlalchemy = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] profiler_jaeger.process_tags = {} {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] profiler_jaeger.service_name_prefix = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] profiler_otlp.service_name_prefix = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_policy.enforce_new_defaults = True {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_policy.policy_default_rule = default {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_policy.policy_file = policy.yaml {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_policy.remote_timeout = 60.0 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] privsep_osbrick.group = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] privsep_osbrick.helper_command = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] privsep_osbrick.user = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cinder_sys_admin.group = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cinder_sys_admin.helper_command = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] cinder_sys_admin.user = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] service_user.auth_section = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] service_user.auth_type = password {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] service_user.cafile = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] service_user.certfile = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] service_user.collect_timing = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] service_user.insecure = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] service_user.keyfile = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] service_user.send_service_user_token = True {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] service_user.split_loggers = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] service_user.timeout = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] glance.auth_section = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] glance.auth_type = password {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] glance.certfile = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] glance.collect_timing = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] glance.insecure = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] glance.keyfile = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] glance.region_name = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] glance.split_loggers = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] glance.timeout = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.backend_availability_zone = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.chap_password = **** {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.chap_username = {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.disk_geometry = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.driver_client_cert = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.driver_client_cert_key = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.driver_data_namespace = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.driver_use_ssl = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.extra_capabilities = {} {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.filter_function = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.goodness_function = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.iscsi_target_flags = {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.iscsi_write_cache = on {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.iser_helper = tgtadm {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.iser_ip_address = 192.168.122.164 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.iser_port = 3260 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.nas_host = {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.nas_login = admin {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=89090) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.nas_mount_options = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.nas_password = **** {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.nas_private_key = {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.nas_share_path = {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.quobyte [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 31 10:37:58 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.quobyte [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 31 10:37:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] Running cmd (subprocess): mount.quobyte {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.nas_ssh_port = 22 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.num_shell_tries = 3 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.quobyte_client_cfg = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.quobyte_volume_url = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.replication_device = **** {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.report_discard_supported = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.reserved_percentage = 0 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.target_helper = tgtadm {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.target_ip_address = 192.168.122.164 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.target_port = 3260 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.target_protocol = iscsi {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.trace_flags = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.unique_fqdn_network = True {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.use_chap_auth = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.volume_backend_name = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.volume_clear = zero {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.volume_clear_ionice = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.volume_clear_size = 0 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_reports.file_event_handler = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_reports.log_dir = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.backend_availability_zone = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.backend_host = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.chap_password = **** {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.chap_username = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.chiscsi_conf = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.disk_geometry = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.driver_client_cert = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.driver_client_cert_key = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.driver_data_namespace = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.driver_use_ssl = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.extra_capabilities = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.filter_function = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.goodness_function = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.iscsi_target_flags = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.iscsi_write_cache = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.iser_helper = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.iser_ip_address = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.iser_port = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.iser_target_prefix = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.nas_host = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.nas_login = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.nas_mount_options = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.nas_password = **** {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.nas_private_key = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.nas_share_path = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.nas_ssh_port = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.num_shell_tries = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.nvmet_ns_id = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.nvmet_port_id = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.replication_device = **** {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.report_discard_supported = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.reserved_percentage = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.scst_target_driver = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.storage_protocol = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.target_helper = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.target_ip_address = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.target_port = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.target_prefix = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.target_protocol = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.trace_flags = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.unique_fqdn_network = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.use_chap_auth = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.volume_clear = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.volume_clear_ionice = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.volume_clear_size = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] QuobyteHD.volumes_dir = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_rabbit.ssl = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_notifications.driver = [] {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_notifications.retry = -1 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] key_manager.fixed_key = **** {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] barbican.barbican_api_version = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] barbican.barbican_endpoint = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] barbican.barbican_endpoint_type = public {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] barbican.barbican_region_name = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] barbican.cafile = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] barbican.certfile = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] barbican.collect_timing = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] barbican.insecure = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] barbican.keyfile = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] barbican.number_of_retries = 60 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] barbican.retry_delay = 1 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] barbican.send_service_user_token = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] barbican.split_loggers = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] barbican.timeout = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] barbican.verify_ssl = True {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] barbican.verify_ssl_path = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] barbican_service_user.auth_section = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] barbican_service_user.auth_type = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] barbican_service_user.cafile = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] barbican_service_user.certfile = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] barbican_service_user.collect_timing = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] barbican_service_user.insecure = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] barbican_service_user.keyfile = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] barbican_service_user.split_loggers = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] barbican_service_user.timeout = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] vault.approle_role_id = **** {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] vault.approle_secret_id = **** {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] vault.auth_method = approle {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] vault.auth_path = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] vault.kv_mountpoint = secret {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] vault.kv_path = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] vault.kv_version = 2 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] vault.namespace = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] vault.root_token_id = **** {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] vault.ssl_ca_crt_file = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] vault.timeout = 60.0 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] vault.token_file = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] vault.token_role = None {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] vault.use_ssl = False {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:37:58 devstack cinder-volume[88785]: DEBUG oslo_service.backend._eventlet.service [None req-37c7257d-16f4-4ab6-a855-7782b67531a8 None None] ******************************************************************************** {{(pid=88785) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 31 10:37:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] CMD "mount.quobyte" returned: 1 in 0.105s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:37:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:37:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:37:58 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:37:58 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:37:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:37:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:37:59 devstack sudo[89092]: pam_unix(sudo:session): session closed for user root Jul 31 10:37:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.287s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:37:59 devstack cinder-volume[89090]: INFO cinder.volume.driver [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] Driver hasn't implemented _init_vendor_properties() Jul 31 10:37:59 devstack cinder-volume[89090]: DEBUG cinder.volume.driver [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.752670288086, 'free_capacity_gb': 1775.752670288086, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89090) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 31 10:37:59 devstack cinder-volume[89090]: DEBUG oslo_db.sqlalchemy.engines [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89090) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 10:37:59 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writer thread running {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 31 10:37:59 devstack cinder-volume[89090]: DEBUG cinder.db.api [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] Building query based on filter {{(pid=89090) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 31 10:37:59 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=89090) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 31 10:37:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:37:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:37:59 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:37:59 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:37:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:37:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:37:59 devstack cinder-volume[89090]: INFO cinder.keymgr.migration [None req-e4e7c7c1-7ecd-4e25-8f60-ef8ac8340bf8 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 31 10:37:59 devstack sudo[89101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:37:59 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:37:59 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root Jul 31 10:37:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.290s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:37:59 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:37:59 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] Driver initialization completed successfully. Jul 31 10:37:59 devstack cinder-volume[89090]: INFO cinder.manager [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] Initiating service 3 cleanup Jul 31 10:37:59 devstack cinder-volume[89090]: INFO cinder.manager [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] Service 3 cleanup completed. Jul 31 10:37:59 devstack cinder-volume[89090]: DEBUG cinder.service [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] Creating RPC server for service cinder-volume {{(pid=89090) start /opt/stack/cinder/cinder/service.py:231}} Jul 31 10:37:59 devstack cinder-volume[89090]: DEBUG cinder.service [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=89090) start /opt/stack/cinder/cinder/service.py:237}} Jul 31 10:37:59 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 31 10:37:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:37:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:37:59 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:37:59 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:37:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:37:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:37:59 devstack sudo[89111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:37:59 devstack sudo[89111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:37:59 devstack sudo[89111]: pam_unix(sudo:session): session closed for user root Jul 31 10:37:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.240s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:37:59 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-a5954ea4-5637-4d5f-ab63-1e2778e3d4d7 None None] Driver post RPC initialization completed successfully. Jul 31 10:38:08 devstack cinder-volume[88785]: DEBUG dbcounter [-] [88785] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88785) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:38:09 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:38:09 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=4 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:38:45 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager._thread_info {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:38:45 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread count: 6 {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:38:45 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread info: [<_MainThread(MainThread, started 134005426110592)>, , , , , ] {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:39:18 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-db37f55f-fbc3-4f95-a92b-b9508e52c942 tempest-DeleteServersTestJSON-819418394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:39:18 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-db37f55f-fbc3-4f95-a92b-b9508e52c942 tempest-DeleteServersTestJSON-819418394 None] Flow 'volume_create_manager' (319b3fd9-73f9-4179-99cf-e0493b2f8abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:39:18 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-db37f55f-fbc3-4f95-a92b-b9508e52c942 tempest-DeleteServersTestJSON-819418394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d325b16-7eaf-4217-adf2-59defe4b63d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:39:18 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-db37f55f-fbc3-4f95-a92b-b9508e52c942 tempest-DeleteServersTestJSON-819418394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d325b16-7eaf-4217-adf2-59defe4b63d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1839344965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13989110-bab0-411d-88a0-a3a3f8c24d2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='324cfc126e3a4053b06d7db9bfadd9d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:39:18Z,use_quota=True,user_id='cc3c6e97dcbb4688a20459b37b3b3d9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:39:18 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-db37f55f-fbc3-4f95-a92b-b9508e52c942 tempest-DeleteServersTestJSON-819418394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e45ae4fd-e8d9-4726-a679-fac950669cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:39:18 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-db37f55f-fbc3-4f95-a92b-b9508e52c942 tempest-DeleteServersTestJSON-819418394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e45ae4fd-e8d9-4726-a679-fac950669cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:39:18 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-db37f55f-fbc3-4f95-a92b-b9508e52c942 tempest-DeleteServersTestJSON-819418394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c74fb0f-10db-474c-a7d3-2cc5dced84f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:39:18 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-db37f55f-fbc3-4f95-a92b-b9508e52c942 tempest-DeleteServersTestJSON-819418394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c74fb0f-10db-474c-a7d3-2cc5dced84f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13989110-bab0-411d-88a0-a3a3f8c24d2e', 'volume_name': 'volume-13989110-bab0-411d-88a0-a3a3f8c24d2e', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:39:18 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-db37f55f-fbc3-4f95-a92b-b9508e52c942 tempest-DeleteServersTestJSON-819418394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f10a745e-4b29-4e55-a87b-ce7e6feb662c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:39:18 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-db37f55f-fbc3-4f95-a92b-b9508e52c942 tempest-DeleteServersTestJSON-819418394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f10a745e-4b29-4e55-a87b-ce7e6feb662c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:39:18 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-db37f55f-fbc3-4f95-a92b-b9508e52c942 tempest-DeleteServersTestJSON-819418394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff5c9c54-0449-4767-899c-4b1616d827f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:39:18 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-db37f55f-fbc3-4f95-a92b-b9508e52c942 tempest-DeleteServersTestJSON-819418394 None] Volume 13989110-bab0-411d-88a0-a3a3f8c24d2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13989110-bab0-411d-88a0-a3a3f8c24d2e', 'volume_size': 1} Jul 31 10:39:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-db37f55f-fbc3-4f95-a92b-b9508e52c942 tempest-DeleteServersTestJSON-819418394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:39:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-db37f55f-fbc3-4f95-a92b-b9508e52c942 tempest-DeleteServersTestJSON-819418394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:39:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-db37f55f-fbc3-4f95-a92b-b9508e52c942 tempest-DeleteServersTestJSON-819418394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1839344965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13989110-bab0-411d-88a0-a3a3f8c24d2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='324cfc126e3a4053b06d7db9bfadd9d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:39:18Z,use_quota=True,user_id='cc3c6e97dcbb4688a20459b37b3b3d9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:39:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-db37f55f-fbc3-4f95-a92b-b9508e52c942 tempest-DeleteServersTestJSON-819418394 None] Creating volume 13989110-bab0-411d-88a0-a3a3f8c24d2e {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:39:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-db37f55f-fbc3-4f95-a92b-b9508e52c942 tempest-DeleteServersTestJSON-819418394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:39:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-db37f55f-fbc3-4f95-a92b-b9508e52c942 tempest-DeleteServersTestJSON-819418394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:39:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-db37f55f-fbc3-4f95-a92b-b9508e52c942 tempest-DeleteServersTestJSON-819418394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:39:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-db37f55f-fbc3-4f95-a92b-b9508e52c942 tempest-DeleteServersTestJSON-819418394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:39:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-db37f55f-fbc3-4f95-a92b-b9508e52c942 tempest-DeleteServersTestJSON-819418394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:39:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-db37f55f-fbc3-4f95-a92b-b9508e52c942 tempest-DeleteServersTestJSON-819418394 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:39:18 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-db37f55f-fbc3-4f95-a92b-b9508e52c942 tempest-DeleteServersTestJSON-819418394 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:39:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-db37f55f-fbc3-4f95-a92b-b9508e52c942 tempest-DeleteServersTestJSON-819418394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13989110-bab0-411d-88a0-a3a3f8c24d2e 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:39:18 devstack sudo[89750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13989110-bab0-411d-88a0-a3a3f8c24d2e 1073741824 Jul 31 10:39:18 devstack sudo[89750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:39:19 devstack sudo[89750]: pam_unix(sudo:session): session closed for user root Jul 31 10:39:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-db37f55f-fbc3-4f95-a92b-b9508e52c942 tempest-DeleteServersTestJSON-819418394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13989110-bab0-411d-88a0-a3a3f8c24d2e 1073741824" returned: 0 in 1.417s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:39:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-db37f55f-fbc3-4f95-a92b-b9508e52c942 tempest-DeleteServersTestJSON-819418394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13989110-bab0-411d-88a0-a3a3f8c24d2e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:39:19 devstack sudo[90075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13989110-bab0-411d-88a0-a3a3f8c24d2e Jul 31 10:39:19 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:39:20 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root Jul 31 10:39:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-db37f55f-fbc3-4f95-a92b-b9508e52c942 tempest-DeleteServersTestJSON-819418394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13989110-bab0-411d-88a0-a3a3f8c24d2e" returned: 0 in 0.338s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:39:20 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-db37f55f-fbc3-4f95-a92b-b9508e52c942 tempest-DeleteServersTestJSON-819418394 None] <== create_volume: return (1846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:39:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-db37f55f-fbc3-4f95-a92b-b9508e52c942 tempest-DeleteServersTestJSON-819418394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.853s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:39:20 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-db37f55f-fbc3-4f95-a92b-b9508e52c942 tempest-DeleteServersTestJSON-819418394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff5c9c54-0449-4767-899c-4b1616d827f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13989110-bab0-411d-88a0-a3a3f8c24d2e', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:39:20 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-db37f55f-fbc3-4f95-a92b-b9508e52c942 tempest-DeleteServersTestJSON-819418394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff05fc5d-95a6-4799-8e37-e068929870fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:39:20 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-db37f55f-fbc3-4f95-a92b-b9508e52c942 tempest-DeleteServersTestJSON-819418394 None] Volume volume-13989110-bab0-411d-88a0-a3a3f8c24d2e (13989110-bab0-411d-88a0-a3a3f8c24d2e): created successfully Jul 31 10:39:20 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-db37f55f-fbc3-4f95-a92b-b9508e52c942 tempest-DeleteServersTestJSON-819418394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff05fc5d-95a6-4799-8e37-e068929870fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:39:20 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-db37f55f-fbc3-4f95-a92b-b9508e52c942 tempest-DeleteServersTestJSON-819418394 None] Flow 'volume_create_manager' (319b3fd9-73f9-4179-99cf-e0493b2f8abf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:39:20 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-db37f55f-fbc3-4f95-a92b-b9508e52c942 tempest-DeleteServersTestJSON-819418394 None] Created volume successfully. Jul 31 10:39:26 devstack cinder-volume[89090]: WARNING py.warnings [req-92b60e79-5f8c-49b1-b398-0ebef5bff574 req-252a6db7-270a-4cf4-b549-63f76e634df7 tempest-DeleteServersTestJSON-819418394 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 31 10:39:26 devstack cinder-volume[89090]: .first() Jul 31 10:39:26 devstack cinder-volume[89090]: Jul 31 10:39:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-92b60e79-5f8c-49b1-b398-0ebef5bff574 req-252a6db7-270a-4cf4-b549-63f76e634df7 tempest-DeleteServersTestJSON-819418394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:39:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-92b60e79-5f8c-49b1-b398-0ebef5bff574 req-252a6db7-270a-4cf4-b549-63f76e634df7 tempest-DeleteServersTestJSON-819418394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:39:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-92b60e79-5f8c-49b1-b398-0ebef5bff574 req-252a6db7-270a-4cf4-b549-63f76e634df7 tempest-DeleteServersTestJSON-819418394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:39:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-92b60e79-5f8c-49b1-b398-0ebef5bff574 req-252a6db7-270a-4cf4-b549-63f76e634df7 tempest-DeleteServersTestJSON-819418394 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c', 'name': 'volume-13989110-bab0-411d-88a0-a3a3f8c24d2e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fa0d93c3-9167-4748-886b-d94447565bfc', 'enforce_multipath': True} {{(pid=89090) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:39:27 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-92b60e79-5f8c-49b1-b398-0ebef5bff574 req-252a6db7-270a-4cf4-b549-63f76e634df7 tempest-DeleteServersTestJSON-819418394 None] attachment_update completed successfully. Jul 31 10:39:31 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-c76beb57-3fae-4fd5-b170-7c9f5aa3b72e tempest-VolumesAdminNegativeTest-853461656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:39:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c76beb57-3fae-4fd5-b170-7c9f5aa3b72e tempest-VolumesAdminNegativeTest-853461656 None] Flow 'volume_create_manager' (4ab4d213-0d80-4c5b-ac4d-30207970b13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:39:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c76beb57-3fae-4fd5-b170-7c9f5aa3b72e tempest-VolumesAdminNegativeTest-853461656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8df3f5dc-cd84-423f-a3ae-b71b193786eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:39:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c76beb57-3fae-4fd5-b170-7c9f5aa3b72e tempest-VolumesAdminNegativeTest-853461656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8df3f5dc-cd84-423f-a3ae-b71b193786eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-399594457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6654b54-f09d-4aa9-b7bb-e3aa67a4bc06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de771cf6432c4cc9982363961f149f60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:39:31Z,use_quota=True,user_id='856906e0726a457a83c56c86bfb069a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:39:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c76beb57-3fae-4fd5-b170-7c9f5aa3b72e tempest-VolumesAdminNegativeTest-853461656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a337e1f-6d3a-4b8a-bf9c-008a744c798d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:39:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c76beb57-3fae-4fd5-b170-7c9f5aa3b72e tempest-VolumesAdminNegativeTest-853461656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a337e1f-6d3a-4b8a-bf9c-008a744c798d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:39:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c76beb57-3fae-4fd5-b170-7c9f5aa3b72e tempest-VolumesAdminNegativeTest-853461656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15195bb8-a053-4e5c-9395-7af9ce3c20e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:39:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c76beb57-3fae-4fd5-b170-7c9f5aa3b72e tempest-VolumesAdminNegativeTest-853461656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15195bb8-a053-4e5c-9395-7af9ce3c20e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6654b54-f09d-4aa9-b7bb-e3aa67a4bc06', 'volume_name': 'volume-a6654b54-f09d-4aa9-b7bb-e3aa67a4bc06', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:39:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c76beb57-3fae-4fd5-b170-7c9f5aa3b72e tempest-VolumesAdminNegativeTest-853461656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34bf454d-c1e4-44f8-a28e-c554f3f1bd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:39:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c76beb57-3fae-4fd5-b170-7c9f5aa3b72e tempest-VolumesAdminNegativeTest-853461656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34bf454d-c1e4-44f8-a28e-c554f3f1bd25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:39:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c76beb57-3fae-4fd5-b170-7c9f5aa3b72e tempest-VolumesAdminNegativeTest-853461656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d469e0c-07df-46b5-8248-ec298b72c812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:39:31 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-c76beb57-3fae-4fd5-b170-7c9f5aa3b72e tempest-VolumesAdminNegativeTest-853461656 None] Volume a6654b54-f09d-4aa9-b7bb-e3aa67a4bc06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6654b54-f09d-4aa9-b7bb-e3aa67a4bc06', 'volume_size': 1} Jul 31 10:39:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c76beb57-3fae-4fd5-b170-7c9f5aa3b72e tempest-VolumesAdminNegativeTest-853461656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:39:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c76beb57-3fae-4fd5-b170-7c9f5aa3b72e tempest-VolumesAdminNegativeTest-853461656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:39:31 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c76beb57-3fae-4fd5-b170-7c9f5aa3b72e tempest-VolumesAdminNegativeTest-853461656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-399594457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6654b54-f09d-4aa9-b7bb-e3aa67a4bc06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de771cf6432c4cc9982363961f149f60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:39:31Z,use_quota=True,user_id='856906e0726a457a83c56c86bfb069a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:39:31 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-c76beb57-3fae-4fd5-b170-7c9f5aa3b72e tempest-VolumesAdminNegativeTest-853461656 None] Creating volume a6654b54-f09d-4aa9-b7bb-e3aa67a4bc06 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:39:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c76beb57-3fae-4fd5-b170-7c9f5aa3b72e tempest-VolumesAdminNegativeTest-853461656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:39:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c76beb57-3fae-4fd5-b170-7c9f5aa3b72e tempest-VolumesAdminNegativeTest-853461656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:39:31 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c76beb57-3fae-4fd5-b170-7c9f5aa3b72e tempest-VolumesAdminNegativeTest-853461656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:39:31 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c76beb57-3fae-4fd5-b170-7c9f5aa3b72e tempest-VolumesAdminNegativeTest-853461656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:39:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c76beb57-3fae-4fd5-b170-7c9f5aa3b72e tempest-VolumesAdminNegativeTest-853461656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:39:31 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c76beb57-3fae-4fd5-b170-7c9f5aa3b72e tempest-VolumesAdminNegativeTest-853461656 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:39:31 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-c76beb57-3fae-4fd5-b170-7c9f5aa3b72e tempest-VolumesAdminNegativeTest-853461656 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:39:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c76beb57-3fae-4fd5-b170-7c9f5aa3b72e tempest-VolumesAdminNegativeTest-853461656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a6654b54-f09d-4aa9-b7bb-e3aa67a4bc06 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:39:31 devstack sudo[90672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a6654b54-f09d-4aa9-b7bb-e3aa67a4bc06 1073741824 Jul 31 10:39:31 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:39:32 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root Jul 31 10:39:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c76beb57-3fae-4fd5-b170-7c9f5aa3b72e tempest-VolumesAdminNegativeTest-853461656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a6654b54-f09d-4aa9-b7bb-e3aa67a4bc06 1073741824" returned: 0 in 1.010s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:39:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c76beb57-3fae-4fd5-b170-7c9f5aa3b72e tempest-VolumesAdminNegativeTest-853461656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a6654b54-f09d-4aa9-b7bb-e3aa67a4bc06 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:39:32 devstack sudo[90705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a6654b54-f09d-4aa9-b7bb-e3aa67a4bc06 Jul 31 10:39:32 devstack sudo[90705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:39:33 devstack sudo[90705]: pam_unix(sudo:session): session closed for user root Jul 31 10:39:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c76beb57-3fae-4fd5-b170-7c9f5aa3b72e tempest-VolumesAdminNegativeTest-853461656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a6654b54-f09d-4aa9-b7bb-e3aa67a4bc06" returned: 0 in 1.127s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:39:33 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c76beb57-3fae-4fd5-b170-7c9f5aa3b72e tempest-VolumesAdminNegativeTest-853461656 None] <== create_volume: return (2270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:39:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c76beb57-3fae-4fd5-b170-7c9f5aa3b72e tempest-VolumesAdminNegativeTest-853461656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.276s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:39:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c76beb57-3fae-4fd5-b170-7c9f5aa3b72e tempest-VolumesAdminNegativeTest-853461656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d469e0c-07df-46b5-8248-ec298b72c812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6654b54-f09d-4aa9-b7bb-e3aa67a4bc06', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:39:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c76beb57-3fae-4fd5-b170-7c9f5aa3b72e tempest-VolumesAdminNegativeTest-853461656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aa37075-be32-4e13-ab37-e3f558c9acca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:39:33 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-c76beb57-3fae-4fd5-b170-7c9f5aa3b72e tempest-VolumesAdminNegativeTest-853461656 None] Volume volume-a6654b54-f09d-4aa9-b7bb-e3aa67a4bc06 (a6654b54-f09d-4aa9-b7bb-e3aa67a4bc06): created successfully Jul 31 10:39:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c76beb57-3fae-4fd5-b170-7c9f5aa3b72e tempest-VolumesAdminNegativeTest-853461656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aa37075-be32-4e13-ab37-e3f558c9acca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:39:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c76beb57-3fae-4fd5-b170-7c9f5aa3b72e tempest-VolumesAdminNegativeTest-853461656 None] Flow 'volume_create_manager' (4ab4d213-0d80-4c5b-ac4d-30207970b13b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:39:34 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-c76beb57-3fae-4fd5-b170-7c9f5aa3b72e tempest-VolumesAdminNegativeTest-853461656 None] Created volume successfully. Jul 31 10:39:35 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9bd2aaa8-ff94-4e99-aef0-62ede8a22995 tempest-VolumesAdminNegativeTest-853461656 None] Acquiring lock "cinder-a6654b54-f09d-4aa9-b7bb-e3aa67a4bc06-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:39:35 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9bd2aaa8-ff94-4e99-aef0-62ede8a22995 tempest-VolumesAdminNegativeTest-853461656 None] Lock "cinder-a6654b54-f09d-4aa9-b7bb-e3aa67a4bc06-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:39:35 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9bd2aaa8-ff94-4e99-aef0-62ede8a22995 tempest-VolumesAdminNegativeTest-853461656 None] Acquiring lock "cinder-quobyte-a6654b54-f09d-4aa9-b7bb-e3aa67a4bc06" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:39:35 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9bd2aaa8-ff94-4e99-aef0-62ede8a22995 tempest-VolumesAdminNegativeTest-853461656 None] Lock "cinder-quobyte-a6654b54-f09d-4aa9-b7bb-e3aa67a4bc06" acquired by "delete_volume" :: waited 0.034s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:39:35 devstack cinder-volume[89090]: INFO oslo.privsep.daemon [None req-9bd2aaa8-ff94-4e99-aef0-62ede8a22995 tempest-VolumesAdminNegativeTest-853461656 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpzezk8w39/privsep.sock'] Jul 31 10:39:35 devstack sudo[90758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpzezk8w39/privsep.sock Jul 31 10:39:35 devstack sudo[90758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:39:36 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-cd7aa86b-66f7-4a53-9f6a-a6054819774a req-7bea0569-3603-4e84-8a3f-b5dd705f3b91 tempest-DeleteServersTestJSON-819418394 None] Terminate volume connection completed successfully. Jul 31 10:39:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-cd7aa86b-66f7-4a53-9f6a-a6054819774a req-7bea0569-3603-4e84-8a3f-b5dd705f3b91 tempest-DeleteServersTestJSON-819418394 None] Deleting attachment fa0d93c3-9167-4748-886b-d94447565bfc. {{(pid=89090) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:39:37 devstack cinder-volume[89090]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 31 10:39:37 devstack cinder-volume[89090]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 31 10:39:37 devstack cinder-volume[89090]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 31 10:39:37 devstack cinder-volume[89090]: WARNING oslo.privsep.daemon [-] privsep log: Jul 31 10:39:37 devstack cinder-volume[89090]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 31 10:39:37 devstack cinder-volume[89090]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 31 10:39:37 devstack cinder-volume[89090]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 31 10:39:37 devstack cinder-volume[89090]: WARNING oslo.privsep.daemon [-] privsep log: Jul 31 10:39:37 devstack cinder-volume[89090]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 31 10:39:38 devstack sudo[90758]: pam_unix(sudo:session): session closed for user root Jul 31 10:39:38 devstack cinder-volume[89090]: INFO oslo.privsep.daemon [None req-9bd2aaa8-ff94-4e99-aef0-62ede8a22995 tempest-VolumesAdminNegativeTest-853461656 None] Spawned new privsep daemon via rootwrap Jul 31 10:39:38 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [None req-9bd2aaa8-ff94-4e99-aef0-62ede8a22995 tempest-VolumesAdminNegativeTest-853461656 None] Accepted privsep connection to /tmp/tmpzezk8w39/privsep.sock {{(pid=89090) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 31 10:39:38 devstack cinder-volume[89090]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 31 10:39:38 devstack cinder-volume[89090]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 31 10:39:38 devstack cinder-volume[89090]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 31 10:39:38 devstack cinder-volume[89090]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 90769 Jul 31 10:39:38 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a47540a-a048-4d4f-97df-f196d10ba0d7]: (2,) {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:39:38 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbf4840-4889-40a2-8a72-f5353621f4dd]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:39:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9bd2aaa8-ff94-4e99-aef0-62ede8a22995 tempest-VolumesAdminNegativeTest-853461656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a6654b54-f09d-4aa9-b7bb-e3aa67a4bc06 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:39:38 devstack sudo[90771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a6654b54-f09d-4aa9-b7bb-e3aa67a4bc06 Jul 31 10:39:38 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:39:38 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root Jul 31 10:39:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9bd2aaa8-ff94-4e99-aef0-62ede8a22995 tempest-VolumesAdminNegativeTest-853461656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a6654b54-f09d-4aa9-b7bb-e3aa67a4bc06" returned: 0 in 0.693s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:39:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9bd2aaa8-ff94-4e99-aef0-62ede8a22995 tempest-VolumesAdminNegativeTest-853461656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a6654b54-f09d-4aa9-b7bb-e3aa67a4bc06 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:39:38 devstack sudo[90776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a6654b54-f09d-4aa9-b7bb-e3aa67a4bc06 Jul 31 10:39:38 devstack sudo[90776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:39:39 devstack sudo[90776]: pam_unix(sudo:session): session closed for user root Jul 31 10:39:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9bd2aaa8-ff94-4e99-aef0-62ede8a22995 tempest-VolumesAdminNegativeTest-853461656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a6654b54-f09d-4aa9-b7bb-e3aa67a4bc06" returned: 0 in 0.440s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:39:39 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9bd2aaa8-ff94-4e99-aef0-62ede8a22995 tempest-VolumesAdminNegativeTest-853461656 None] Lock "cinder-quobyte-a6654b54-f09d-4aa9-b7bb-e3aa67a4bc06" released by "delete_volume" :: held 4.055s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:39:39 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8bafeb4e-c577-43bf-a43a-8f17e462069e tempest-DeleteServersTestJSON-819418394 None] Acquiring lock "cinder-13989110-bab0-411d-88a0-a3a3f8c24d2e-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:39:39 devstack cinder-volume[89090]: WARNING cinder.quota [None req-9bd2aaa8-ff94-4e99-aef0-62ede8a22995 tempest-VolumesAdminNegativeTest-853461656 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:39:39 devstack cinder-volume[89090]: WARNING cinder.quota [None req-9bd2aaa8-ff94-4e99-aef0-62ede8a22995 tempest-VolumesAdminNegativeTest-853461656 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:39:39 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-9bd2aaa8-ff94-4e99-aef0-62ede8a22995 tempest-VolumesAdminNegativeTest-853461656 None] Created reservations ['f8924591-fc2e-49e9-82b6-bbf1ea4b535b', 'dd5dcb8a-ee44-4689-83e6-2fe712a302f6', '4976019a-3816-4af7-aa0f-d0b85a386e39', '09950b98-b992-4174-a9c5-f1c4197101ea'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:39:39 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8bafeb4e-c577-43bf-a43a-8f17e462069e tempest-DeleteServersTestJSON-819418394 None] Lock "cinder-13989110-bab0-411d-88a0-a3a3f8c24d2e-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:39:39 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-bca6f3e9-b75c-4658-802b-338c11e2592e tempest-ServerRescueNegativeTestJSON-1298829817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:39:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bca6f3e9-b75c-4658-802b-338c11e2592e tempest-ServerRescueNegativeTestJSON-1298829817 None] Flow 'volume_create_manager' (7b0fc85c-0dbc-4194-aafe-d570b15a76df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:39:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bca6f3e9-b75c-4658-802b-338c11e2592e tempest-ServerRescueNegativeTestJSON-1298829817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (749848e2-8050-46a6-8e02-79416270b357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:39:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bca6f3e9-b75c-4658-802b-338c11e2592e tempest-ServerRescueNegativeTestJSON-1298829817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (749848e2-8050-46a6-8e02-79416270b357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-878145769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5986d113-0163-4a90-9608-970e36e853a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc0fbe9aea5e4589a3ba12e3142ec9f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:39:40Z,use_quota=True,user_id='cea77af59485422b9f5abec6fc428ef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:39:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bca6f3e9-b75c-4658-802b-338c11e2592e tempest-ServerRescueNegativeTestJSON-1298829817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5045b6fb-3dda-489e-8829-1007c1b60a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:39:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bca6f3e9-b75c-4658-802b-338c11e2592e tempest-ServerRescueNegativeTestJSON-1298829817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5045b6fb-3dda-489e-8829-1007c1b60a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:39:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bca6f3e9-b75c-4658-802b-338c11e2592e tempest-ServerRescueNegativeTestJSON-1298829817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (621cd122-b2fd-4115-b369-9032bf0ec0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:39:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bca6f3e9-b75c-4658-802b-338c11e2592e tempest-ServerRescueNegativeTestJSON-1298829817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (621cd122-b2fd-4115-b369-9032bf0ec0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5986d113-0163-4a90-9608-970e36e853a0', 'volume_name': 'volume-5986d113-0163-4a90-9608-970e36e853a0', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:39:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bca6f3e9-b75c-4658-802b-338c11e2592e tempest-ServerRescueNegativeTestJSON-1298829817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5c3505b-247e-481e-b9c0-7a2804e962b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:39:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bca6f3e9-b75c-4658-802b-338c11e2592e tempest-ServerRescueNegativeTestJSON-1298829817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5c3505b-247e-481e-b9c0-7a2804e962b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:39:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bca6f3e9-b75c-4658-802b-338c11e2592e tempest-ServerRescueNegativeTestJSON-1298829817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ea02e16-f999-4d2d-9471-f1f8eff32d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:39:40 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-bca6f3e9-b75c-4658-802b-338c11e2592e tempest-ServerRescueNegativeTestJSON-1298829817 None] Volume 5986d113-0163-4a90-9608-970e36e853a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5986d113-0163-4a90-9608-970e36e853a0', 'volume_size': 1} Jul 31 10:39:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-bca6f3e9-b75c-4658-802b-338c11e2592e tempest-ServerRescueNegativeTestJSON-1298829817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:39:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-bca6f3e9-b75c-4658-802b-338c11e2592e tempest-ServerRescueNegativeTestJSON-1298829817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:39:40 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-bca6f3e9-b75c-4658-802b-338c11e2592e tempest-ServerRescueNegativeTestJSON-1298829817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-878145769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5986d113-0163-4a90-9608-970e36e853a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc0fbe9aea5e4589a3ba12e3142ec9f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:39:40Z,use_quota=True,user_id='cea77af59485422b9f5abec6fc428ef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:39:40 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-bca6f3e9-b75c-4658-802b-338c11e2592e tempest-ServerRescueNegativeTestJSON-1298829817 None] Creating volume 5986d113-0163-4a90-9608-970e36e853a0 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:39:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-bca6f3e9-b75c-4658-802b-338c11e2592e tempest-ServerRescueNegativeTestJSON-1298829817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:39:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-bca6f3e9-b75c-4658-802b-338c11e2592e tempest-ServerRescueNegativeTestJSON-1298829817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:39:40 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-bca6f3e9-b75c-4658-802b-338c11e2592e tempest-ServerRescueNegativeTestJSON-1298829817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:39:40 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-bca6f3e9-b75c-4658-802b-338c11e2592e tempest-ServerRescueNegativeTestJSON-1298829817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:39:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-bca6f3e9-b75c-4658-802b-338c11e2592e tempest-ServerRescueNegativeTestJSON-1298829817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:39:40 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-bca6f3e9-b75c-4658-802b-338c11e2592e tempest-ServerRescueNegativeTestJSON-1298829817 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:39:40 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-bca6f3e9-b75c-4658-802b-338c11e2592e tempest-ServerRescueNegativeTestJSON-1298829817 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:39:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bca6f3e9-b75c-4658-802b-338c11e2592e tempest-ServerRescueNegativeTestJSON-1298829817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5986d113-0163-4a90-9608-970e36e853a0 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:39:40 devstack sudo[90781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5986d113-0163-4a90-9608-970e36e853a0 1073741824 Jul 31 10:39:40 devstack sudo[90781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:39:40 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8bafeb4e-c577-43bf-a43a-8f17e462069e tempest-DeleteServersTestJSON-819418394 None] Acquiring lock "cinder-quobyte-13989110-bab0-411d-88a0-a3a3f8c24d2e" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:39:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9bd2aaa8-ff94-4e99-aef0-62ede8a22995 tempest-VolumesAdminNegativeTest-853461656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:39:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9bd2aaa8-ff94-4e99-aef0-62ede8a22995 tempest-VolumesAdminNegativeTest-853461656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:39:40 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-9bd2aaa8-ff94-4e99-aef0-62ede8a22995 tempest-VolumesAdminNegativeTest-853461656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:39:40 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-9bd2aaa8-ff94-4e99-aef0-62ede8a22995 tempest-VolumesAdminNegativeTest-853461656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:39:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9bd2aaa8-ff94-4e99-aef0-62ede8a22995 tempest-VolumesAdminNegativeTest-853461656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:39:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9bd2aaa8-ff94-4e99-aef0-62ede8a22995 tempest-VolumesAdminNegativeTest-853461656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:39:40 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8bafeb4e-c577-43bf-a43a-8f17e462069e tempest-DeleteServersTestJSON-819418394 None] Lock "cinder-quobyte-13989110-bab0-411d-88a0-a3a3f8c24d2e" acquired by "delete_volume" :: waited 0.057s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:39:40 devstack sudo[90783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:39:40 devstack sudo[90783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:39:40 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51b4dbb-de67-4209-9e97-050562112e5d]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:39:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8bafeb4e-c577-43bf-a43a-8f17e462069e tempest-DeleteServersTestJSON-819418394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13989110-bab0-411d-88a0-a3a3f8c24d2e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:39:40 devstack sudo[90785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13989110-bab0-411d-88a0-a3a3f8c24d2e Jul 31 10:39:40 devstack sudo[90785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:39:40 devstack sudo[90783]: pam_unix(sudo:session): session closed for user root Jul 31 10:39:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9bd2aaa8-ff94-4e99-aef0-62ede8a22995 tempest-VolumesAdminNegativeTest-853461656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.557s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:39:40 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-9bd2aaa8-ff94-4e99-aef0-62ede8a22995 tempest-VolumesAdminNegativeTest-853461656 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:39:40 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-9bd2aaa8-ff94-4e99-aef0-62ede8a22995 tempest-VolumesAdminNegativeTest-853461656 None] Deleted volume successfully. Jul 31 10:39:40 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9bd2aaa8-ff94-4e99-aef0-62ede8a22995 tempest-VolumesAdminNegativeTest-853461656 None] Lock "cinder-a6654b54-f09d-4aa9-b7bb-e3aa67a4bc06-delete_volume" released by "delete_volume" :: held 5.675s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:39:41 devstack sudo[90785]: pam_unix(sudo:session): session closed for user root Jul 31 10:39:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8bafeb4e-c577-43bf-a43a-8f17e462069e tempest-DeleteServersTestJSON-819418394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13989110-bab0-411d-88a0-a3a3f8c24d2e" returned: 0 in 0.736s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:39:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8bafeb4e-c577-43bf-a43a-8f17e462069e tempest-DeleteServersTestJSON-819418394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13989110-bab0-411d-88a0-a3a3f8c24d2e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:39:41 devstack sudo[90796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13989110-bab0-411d-88a0-a3a3f8c24d2e Jul 31 10:39:41 devstack sudo[90796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:39:41 devstack sudo[90781]: pam_unix(sudo:session): session closed for user root Jul 31 10:39:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bca6f3e9-b75c-4658-802b-338c11e2592e tempest-ServerRescueNegativeTestJSON-1298829817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5986d113-0163-4a90-9608-970e36e853a0 1073741824" returned: 0 in 1.070s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:39:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bca6f3e9-b75c-4658-802b-338c11e2592e tempest-ServerRescueNegativeTestJSON-1298829817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5986d113-0163-4a90-9608-970e36e853a0 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:39:41 devstack sudo[90798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5986d113-0163-4a90-9608-970e36e853a0 Jul 31 10:39:41 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:39:41 devstack sudo[90796]: pam_unix(sudo:session): session closed for user root Jul 31 10:39:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8bafeb4e-c577-43bf-a43a-8f17e462069e tempest-DeleteServersTestJSON-819418394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13989110-bab0-411d-88a0-a3a3f8c24d2e" returned: 0 in 0.675s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:39:41 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8bafeb4e-c577-43bf-a43a-8f17e462069e tempest-DeleteServersTestJSON-819418394 None] Lock "cinder-quobyte-13989110-bab0-411d-88a0-a3a3f8c24d2e" released by "delete_volume" :: held 1.522s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:39:41 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-8bafeb4e-c577-43bf-a43a-8f17e462069e tempest-DeleteServersTestJSON-819418394 None] Created reservations ['8abecf3a-ac0a-4e66-a232-04abd730e117', '9aad3f4e-52f6-43d7-854c-830132f7a667', 'f28f6b1a-bec9-4b2d-97c2-48458d7ea509', 'de4d92e2-5ddf-4431-8843-f3d462541527'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:39:42 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root Jul 31 10:39:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bca6f3e9-b75c-4658-802b-338c11e2592e tempest-ServerRescueNegativeTestJSON-1298829817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5986d113-0163-4a90-9608-970e36e853a0" returned: 0 in 0.756s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:39:42 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-bca6f3e9-b75c-4658-802b-338c11e2592e tempest-ServerRescueNegativeTestJSON-1298829817 None] <== create_volume: return (1945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:39:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-bca6f3e9-b75c-4658-802b-338c11e2592e tempest-ServerRescueNegativeTestJSON-1298829817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.947s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:39:42 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bca6f3e9-b75c-4658-802b-338c11e2592e tempest-ServerRescueNegativeTestJSON-1298829817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ea02e16-f999-4d2d-9471-f1f8eff32d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5986d113-0163-4a90-9608-970e36e853a0', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:39:42 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bca6f3e9-b75c-4658-802b-338c11e2592e tempest-ServerRescueNegativeTestJSON-1298829817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d45ac9e-c7c2-4523-add8-c0596a879d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:39:42 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-bca6f3e9-b75c-4658-802b-338c11e2592e tempest-ServerRescueNegativeTestJSON-1298829817 None] Volume volume-5986d113-0163-4a90-9608-970e36e853a0 (5986d113-0163-4a90-9608-970e36e853a0): created successfully Jul 31 10:39:42 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bca6f3e9-b75c-4658-802b-338c11e2592e tempest-ServerRescueNegativeTestJSON-1298829817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d45ac9e-c7c2-4523-add8-c0596a879d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:39:42 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bca6f3e9-b75c-4658-802b-338c11e2592e tempest-ServerRescueNegativeTestJSON-1298829817 None] Flow 'volume_create_manager' (7b0fc85c-0dbc-4194-aafe-d570b15a76df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:39:42 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-bca6f3e9-b75c-4658-802b-338c11e2592e tempest-ServerRescueNegativeTestJSON-1298829817 None] Created volume successfully. Jul 31 10:39:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8bafeb4e-c577-43bf-a43a-8f17e462069e tempest-DeleteServersTestJSON-819418394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:39:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8bafeb4e-c577-43bf-a43a-8f17e462069e tempest-DeleteServersTestJSON-819418394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:39:42 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-8bafeb4e-c577-43bf-a43a-8f17e462069e tempest-DeleteServersTestJSON-819418394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:39:42 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-8bafeb4e-c577-43bf-a43a-8f17e462069e tempest-DeleteServersTestJSON-819418394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:39:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8bafeb4e-c577-43bf-a43a-8f17e462069e tempest-DeleteServersTestJSON-819418394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:39:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8bafeb4e-c577-43bf-a43a-8f17e462069e tempest-DeleteServersTestJSON-819418394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:39:42 devstack sudo[90817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:39:42 devstack sudo[90817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:39:42 devstack sudo[90817]: pam_unix(sudo:session): session closed for user root Jul 31 10:39:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8bafeb4e-c577-43bf-a43a-8f17e462069e tempest-DeleteServersTestJSON-819418394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.652s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:39:42 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-8bafeb4e-c577-43bf-a43a-8f17e462069e tempest-DeleteServersTestJSON-819418394 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:39:42 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-8bafeb4e-c577-43bf-a43a-8f17e462069e tempest-DeleteServersTestJSON-819418394 None] Deleted volume successfully. Jul 31 10:39:43 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8bafeb4e-c577-43bf-a43a-8f17e462069e tempest-DeleteServersTestJSON-819418394 None] Lock "cinder-13989110-bab0-411d-88a0-a3a3f8c24d2e-delete_volume" released by "delete_volume" :: held 3.143s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:39:45 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:39:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:39:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:39:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:39:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:39:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:39:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:39:46 devstack sudo[90841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:39:46 devstack sudo[90841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:39:46 devstack sudo[90841]: pam_unix(sudo:session): session closed for user root Jul 31 10:39:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.705s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:39:46 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:39:46 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager._thread_info {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:39:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread count: 8 {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:39:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread info: [<_MainThread(MainThread, started 134005426110592)>, , , , , , , ] {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:39:49 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-e376ad54-2069-4449-bfbf-e1e2c9b85d90 tempest-GroupSnapshotsV319Test-1080477777 None] Group tempest-GroupSnapshotsV319Test-Group-83955451: creating Jul 31 10:39:49 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-e376ad54-2069-4449-bfbf-e1e2c9b85d90 tempest-GroupSnapshotsV319Test-1080477777 None] Group tempest-GroupSnapshotsV319Test-Group-83955451: created successfully Jul 31 10:39:49 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-e376ad54-2069-4449-bfbf-e1e2c9b85d90 tempest-GroupSnapshotsV319Test-1080477777 None] Create group completed successfully. Jul 31 10:39:51 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f19b0e5-06cc-4cde-a4db-83cbf904596c tempest-GroupSnapshotsV319Test-1080477777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:39:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3f19b0e5-06cc-4cde-a4db-83cbf904596c tempest-GroupSnapshotsV319Test-1080477777 None] Flow 'volume_create_manager' (2f887da1-48dd-46bd-b173-414aa764f965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:39:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3f19b0e5-06cc-4cde-a4db-83cbf904596c tempest-GroupSnapshotsV319Test-1080477777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d67615ec-dfff-488d-90e6-5e92fa85b627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:39:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3f19b0e5-06cc-4cde-a4db-83cbf904596c tempest-GroupSnapshotsV319Test-1080477777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d67615ec-dfff-488d-90e6-5e92fa85b627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1386616860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ef9bab73-b8af-44f9-a351-63764142d884,host='devstack@QuobyteHD#QuobyteHD',id=3d43f68c-2565-430d-818b-f96b53ab8bef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceb8aa970959454384004c450b5012c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:39:52Z,use_quota=True,user_id='68e67b9edeef4d95817a245abb95270f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc577f9b-024c-4b1a-9707-64efd9459f5e),volume_type_id=cc577f9b-024c-4b1a-9707-64efd9459f5e)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:39:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3f19b0e5-06cc-4cde-a4db-83cbf904596c tempest-GroupSnapshotsV319Test-1080477777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e544052-1663-464d-9ffb-4e7a9356d12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:39:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3f19b0e5-06cc-4cde-a4db-83cbf904596c tempest-GroupSnapshotsV319Test-1080477777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e544052-1663-464d-9ffb-4e7a9356d12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:39:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3f19b0e5-06cc-4cde-a4db-83cbf904596c tempest-GroupSnapshotsV319Test-1080477777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dffb278-935e-4429-800c-09ebf31fcc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:39:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3f19b0e5-06cc-4cde-a4db-83cbf904596c tempest-GroupSnapshotsV319Test-1080477777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dffb278-935e-4429-800c-09ebf31fcc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d43f68c-2565-430d-818b-f96b53ab8bef', 'volume_name': 'volume-3d43f68c-2565-430d-818b-f96b53ab8bef', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:39:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3f19b0e5-06cc-4cde-a4db-83cbf904596c tempest-GroupSnapshotsV319Test-1080477777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aa7df02-af63-43b1-ac6d-15eb2a5af4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:39:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3f19b0e5-06cc-4cde-a4db-83cbf904596c tempest-GroupSnapshotsV319Test-1080477777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aa7df02-af63-43b1-ac6d-15eb2a5af4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:39:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3f19b0e5-06cc-4cde-a4db-83cbf904596c tempest-GroupSnapshotsV319Test-1080477777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4e28ccd-8c0d-4f78-8fbf-b9bd76f8968b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:39:51 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-3f19b0e5-06cc-4cde-a4db-83cbf904596c tempest-GroupSnapshotsV319Test-1080477777 None] Volume 3d43f68c-2565-430d-818b-f96b53ab8bef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d43f68c-2565-430d-818b-f96b53ab8bef', 'volume_size': 1} Jul 31 10:39:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3f19b0e5-06cc-4cde-a4db-83cbf904596c tempest-GroupSnapshotsV319Test-1080477777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:39:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3f19b0e5-06cc-4cde-a4db-83cbf904596c tempest-GroupSnapshotsV319Test-1080477777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:39:51 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-3f19b0e5-06cc-4cde-a4db-83cbf904596c tempest-GroupSnapshotsV319Test-1080477777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ef9bab73-b8af-44f9-a351-63764142d884,created_at=2026-07-31T08:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1386616860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ef9bab73-b8af-44f9-a351-63764142d884,host='devstack@QuobyteHD#QuobyteHD',id=3d43f68c-2565-430d-818b-f96b53ab8bef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceb8aa970959454384004c450b5012c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:39:52Z,use_quota=True,user_id='68e67b9edeef4d95817a245abb95270f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc577f9b-024c-4b1a-9707-64efd9459f5e),volume_type_id=cc577f9b-024c-4b1a-9707-64efd9459f5e)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:39:51 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-3f19b0e5-06cc-4cde-a4db-83cbf904596c tempest-GroupSnapshotsV319Test-1080477777 None] Creating volume 3d43f68c-2565-430d-818b-f96b53ab8bef {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:39:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3f19b0e5-06cc-4cde-a4db-83cbf904596c tempest-GroupSnapshotsV319Test-1080477777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:39:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3f19b0e5-06cc-4cde-a4db-83cbf904596c tempest-GroupSnapshotsV319Test-1080477777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:39:51 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-3f19b0e5-06cc-4cde-a4db-83cbf904596c tempest-GroupSnapshotsV319Test-1080477777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:39:51 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-3f19b0e5-06cc-4cde-a4db-83cbf904596c tempest-GroupSnapshotsV319Test-1080477777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:39:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3f19b0e5-06cc-4cde-a4db-83cbf904596c tempest-GroupSnapshotsV319Test-1080477777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:39:51 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-3f19b0e5-06cc-4cde-a4db-83cbf904596c tempest-GroupSnapshotsV319Test-1080477777 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:39:51 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-3f19b0e5-06cc-4cde-a4db-83cbf904596c tempest-GroupSnapshotsV319Test-1080477777 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:39:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3f19b0e5-06cc-4cde-a4db-83cbf904596c tempest-GroupSnapshotsV319Test-1080477777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:39:51 devstack sudo[90948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef 1073741824 Jul 31 10:39:51 devstack sudo[90948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:39:52 devstack sudo[90948]: pam_unix(sudo:session): session closed for user root Jul 31 10:39:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3f19b0e5-06cc-4cde-a4db-83cbf904596c tempest-GroupSnapshotsV319Test-1080477777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef 1073741824" returned: 0 in 0.663s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:39:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3f19b0e5-06cc-4cde-a4db-83cbf904596c tempest-GroupSnapshotsV319Test-1080477777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:39:52 devstack sudo[90954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef Jul 31 10:39:52 devstack sudo[90954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:39:53 devstack sudo[90954]: pam_unix(sudo:session): session closed for user root Jul 31 10:39:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3f19b0e5-06cc-4cde-a4db-83cbf904596c tempest-GroupSnapshotsV319Test-1080477777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef" returned: 0 in 0.530s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:39:53 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-3f19b0e5-06cc-4cde-a4db-83cbf904596c tempest-GroupSnapshotsV319Test-1080477777 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:39:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3f19b0e5-06cc-4cde-a4db-83cbf904596c tempest-GroupSnapshotsV319Test-1080477777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:39:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3f19b0e5-06cc-4cde-a4db-83cbf904596c tempest-GroupSnapshotsV319Test-1080477777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4e28ccd-8c0d-4f78-8fbf-b9bd76f8968b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d43f68c-2565-430d-818b-f96b53ab8bef', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:39:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3f19b0e5-06cc-4cde-a4db-83cbf904596c tempest-GroupSnapshotsV319Test-1080477777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bacc05b1-eff3-4e9d-bfd1-d7453ecb5d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:39:53 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-3f19b0e5-06cc-4cde-a4db-83cbf904596c tempest-GroupSnapshotsV319Test-1080477777 None] Volume volume-3d43f68c-2565-430d-818b-f96b53ab8bef (3d43f68c-2565-430d-818b-f96b53ab8bef): created successfully Jul 31 10:39:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3f19b0e5-06cc-4cde-a4db-83cbf904596c tempest-GroupSnapshotsV319Test-1080477777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bacc05b1-eff3-4e9d-bfd1-d7453ecb5d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:39:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3f19b0e5-06cc-4cde-a4db-83cbf904596c tempest-GroupSnapshotsV319Test-1080477777 None] Flow 'volume_create_manager' (2f887da1-48dd-46bd-b173-414aa764f965) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:39:53 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-3f19b0e5-06cc-4cde-a4db-83cbf904596c tempest-GroupSnapshotsV319Test-1080477777 None] Created volume successfully. Jul 31 10:39:54 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-d0a17fca-c697-4ee7-b5f8-8a621c0a1755 tempest-GroupSnapshotsV319Test-1080477777 None] GroupSnapshot 9c8010d4-f936-4a8f-b97e-da22c1caf7b8: creating. Jul 31 10:39:54 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d0a17fca-c697-4ee7-b5f8-8a621c0a1755 tempest-GroupSnapshotsV319Test-1080477777 None] Group snapshot 9c8010d4-f936-4a8f-b97e-da22c1caf7b8: creating. {{(pid=89090) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 31 10:39:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d0a17fca-c697-4ee7-b5f8-8a621c0a1755 tempest-GroupSnapshotsV319Test-1080477777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:39:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d0a17fca-c697-4ee7-b5f8-8a621c0a1755 tempest-GroupSnapshotsV319Test-1080477777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:39:54 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-d0a17fca-c697-4ee7-b5f8-8a621c0a1755 tempest-GroupSnapshotsV319Test-1080477777 None] Creating offline snapshot aafb4e9e-2a0e-483e-afc2-3c2524206792 of volume 3d43f68c-2565-430d-818b-f96b53ab8bef {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:39:54 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[8678c0db-37cf-4e05-9d33-a11660c96028]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:39:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0a17fca-c697-4ee7-b5f8-8a621c0a1755 tempest-GroupSnapshotsV319Test-1080477777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:39:54 devstack sudo[90995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef Jul 31 10:39:54 devstack sudo[90995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:39:55 devstack sudo[90995]: pam_unix(sudo:session): session closed for user root Jul 31 10:39:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0a17fca-c697-4ee7-b5f8-8a621c0a1755 tempest-GroupSnapshotsV319Test-1080477777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef" returned: 0 in 0.521s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:39:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0a17fca-c697-4ee7-b5f8-8a621c0a1755 tempest-GroupSnapshotsV319Test-1080477777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef.aafb4e9e-2a0e-483e-afc2-3c2524206792 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:39:55 devstack sudo[91015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef.aafb4e9e-2a0e-483e-afc2-3c2524206792 1G Jul 31 10:39:55 devstack sudo[91015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:39:55 devstack sudo[91015]: pam_unix(sudo:session): session closed for user root Jul 31 10:39:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0a17fca-c697-4ee7-b5f8-8a621c0a1755 tempest-GroupSnapshotsV319Test-1080477777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef.aafb4e9e-2a0e-483e-afc2-3c2524206792 1G" returned: 0 in 0.575s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:39:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0a17fca-c697-4ee7-b5f8-8a621c0a1755 tempest-GroupSnapshotsV319Test-1080477777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d43f68c-2565-430d-818b-f96b53ab8bef -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef.aafb4e9e-2a0e-483e-afc2-3c2524206792 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:39:55 devstack sudo[91029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d43f68c-2565-430d-818b-f96b53ab8bef -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef.aafb4e9e-2a0e-483e-afc2-3c2524206792 Jul 31 10:39:56 devstack sudo[91029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:39:56 devstack sudo[91029]: pam_unix(sudo:session): session closed for user root Jul 31 10:39:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0a17fca-c697-4ee7-b5f8-8a621c0a1755 tempest-GroupSnapshotsV319Test-1080477777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d43f68c-2565-430d-818b-f96b53ab8bef -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef.aafb4e9e-2a0e-483e-afc2-3c2524206792" returned: 0 in 0.924s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:39:56 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-d0a17fca-c697-4ee7-b5f8-8a621c0a1755 tempest-GroupSnapshotsV319Test-1080477777 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef.aafb4e9e-2a0e-483e-afc2-3c2524206792 is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:39:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0a17fca-c697-4ee7-b5f8-8a621c0a1755 tempest-GroupSnapshotsV319Test-1080477777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef.aafb4e9e-2a0e-483e-afc2-3c2524206792 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:39:56 devstack sudo[91047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef.aafb4e9e-2a0e-483e-afc2-3c2524206792 Jul 31 10:39:56 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:39:57 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root Jul 31 10:39:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0a17fca-c697-4ee7-b5f8-8a621c0a1755 tempest-GroupSnapshotsV319Test-1080477777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef.aafb4e9e-2a0e-483e-afc2-3c2524206792" returned: 0 in 0.448s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:39:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0a17fca-c697-4ee7-b5f8-8a621c0a1755 tempest-GroupSnapshotsV319Test-1080477777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:39:57 devstack sudo[91051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef.info Jul 31 10:39:57 devstack sudo[91051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:39:57 devstack sudo[91051]: pam_unix(sudo:session): session closed for user root Jul 31 10:39:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0a17fca-c697-4ee7-b5f8-8a621c0a1755 tempest-GroupSnapshotsV319Test-1080477777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef.info" returned: 0 in 0.365s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:39:57 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-d0a17fca-c697-4ee7-b5f8-8a621c0a1755 tempest-GroupSnapshotsV319Test-1080477777 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef.info is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:39:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0a17fca-c697-4ee7-b5f8-8a621c0a1755 tempest-GroupSnapshotsV319Test-1080477777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:39:57 devstack sudo[91054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef.info Jul 31 10:39:57 devstack sudo[91054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:39:58 devstack sudo[91054]: pam_unix(sudo:session): session closed for user root Jul 31 10:39:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0a17fca-c697-4ee7-b5f8-8a621c0a1755 tempest-GroupSnapshotsV319Test-1080477777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef.info" returned: 0 in 0.499s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:39:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d0a17fca-c697-4ee7-b5f8-8a621c0a1755 tempest-GroupSnapshotsV319Test-1080477777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.498s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:39:58 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-d0a17fca-c697-4ee7-b5f8-8a621c0a1755 tempest-GroupSnapshotsV319Test-1080477777 None] group_snapshot 9c8010d4-f936-4a8f-b97e-da22c1caf7b8: created successfully Jul 31 10:39:59 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-0a5a06d9-9d78-48c1-8cf3-52f29ee71046 tempest-ServerRescueNegativeTestJSON-1298829817 None] Acquiring lock "cinder-5986d113-0163-4a90-9608-970e36e853a0-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:40:00 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-0a5a06d9-9d78-48c1-8cf3-52f29ee71046 tempest-ServerRescueNegativeTestJSON-1298829817 None] Lock "cinder-5986d113-0163-4a90-9608-970e36e853a0-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:40:00 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-0a5a06d9-9d78-48c1-8cf3-52f29ee71046 tempest-ServerRescueNegativeTestJSON-1298829817 None] Acquiring lock "cinder-quobyte-5986d113-0163-4a90-9608-970e36e853a0" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:40:00 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-7f52b1aa-e9ae-4b4a-b5ca-38e52c0f4e02 tempest-GroupSnapshotsV319Test-1080477777 None] group_snapshot 9c8010d4-f936-4a8f-b97e-da22c1caf7b8: deleting Jul 31 10:40:00 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-0a5a06d9-9d78-48c1-8cf3-52f29ee71046 tempest-ServerRescueNegativeTestJSON-1298829817 None] Lock "cinder-quobyte-5986d113-0163-4a90-9608-970e36e853a0" acquired by "delete_volume" :: waited 0.040s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:40:00 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7f52b1aa-e9ae-4b4a-b5ca-38e52c0f4e02 tempest-GroupSnapshotsV319Test-1080477777 None] group_snapshot 9c8010d4-f936-4a8f-b97e-da22c1caf7b8: deleting {{(pid=89090) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 31 10:40:00 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[0904a2b7-8f28-49f4-bb05-49a2b45b35e2]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:40:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0a5a06d9-9d78-48c1-8cf3-52f29ee71046 tempest-ServerRescueNegativeTestJSON-1298829817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5986d113-0163-4a90-9608-970e36e853a0 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:40:00 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7f52b1aa-e9ae-4b4a-b5ca-38e52c0f4e02 tempest-GroupSnapshotsV319Test-1080477777 None] Acquiring lock "cinder-quobyte-3d43f68c-2565-430d-818b-f96b53ab8bef" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:40:00 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7f52b1aa-e9ae-4b4a-b5ca-38e52c0f4e02 tempest-GroupSnapshotsV319Test-1080477777 None] Lock "cinder-quobyte-3d43f68c-2565-430d-818b-f96b53ab8bef" acquired by "delete_snapshot" :: waited 0.035s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:40:00 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7f52b1aa-e9ae-4b4a-b5ca-38e52c0f4e02 tempest-GroupSnapshotsV319Test-1080477777 None] Acquiring lock "cinder-quobyte-aafb4e9e-2a0e-483e-afc2-3c2524206792" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:40:00 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7f52b1aa-e9ae-4b4a-b5ca-38e52c0f4e02 tempest-GroupSnapshotsV319Test-1080477777 None] Lock "cinder-quobyte-aafb4e9e-2a0e-483e-afc2-3c2524206792" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:40:00 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-7f52b1aa-e9ae-4b4a-b5ca-38e52c0f4e02 tempest-GroupSnapshotsV319Test-1080477777 None] Deleting offline snapshot aafb4e9e-2a0e-483e-afc2-3c2524206792 of volume 3d43f68c-2565-430d-818b-f96b53ab8bef {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:40:00 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-7f52b1aa-e9ae-4b4a-b5ca-38e52c0f4e02 tempest-GroupSnapshotsV319Test-1080477777 None] snapshot_file for this snap is: volume-3d43f68c-2565-430d-818b-f96b53ab8bef.aafb4e9e-2a0e-483e-afc2-3c2524206792 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:40:00 devstack sudo[91058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5986d113-0163-4a90-9608-970e36e853a0 Jul 31 10:40:00 devstack sudo[91058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:40:00 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c080f5-17ff-4154-ba29-963d01274bc9]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:40:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7f52b1aa-e9ae-4b4a-b5ca-38e52c0f4e02 tempest-GroupSnapshotsV319Test-1080477777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef.aafb4e9e-2a0e-483e-afc2-3c2524206792 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:40:00 devstack sudo[91060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef.aafb4e9e-2a0e-483e-afc2-3c2524206792 Jul 31 10:40:00 devstack sudo[91060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:40:00 devstack sudo[91058]: pam_unix(sudo:session): session closed for user root Jul 31 10:40:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0a5a06d9-9d78-48c1-8cf3-52f29ee71046 tempest-ServerRescueNegativeTestJSON-1298829817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5986d113-0163-4a90-9608-970e36e853a0" returned: 0 in 0.630s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:40:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0a5a06d9-9d78-48c1-8cf3-52f29ee71046 tempest-ServerRescueNegativeTestJSON-1298829817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5986d113-0163-4a90-9608-970e36e853a0 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:40:01 devstack sudo[91065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5986d113-0163-4a90-9608-970e36e853a0 Jul 31 10:40:01 devstack sudo[91065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:40:01 devstack sudo[91060]: pam_unix(sudo:session): session closed for user root Jul 31 10:40:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7f52b1aa-e9ae-4b4a-b5ca-38e52c0f4e02 tempest-GroupSnapshotsV319Test-1080477777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef.aafb4e9e-2a0e-483e-afc2-3c2524206792" returned: 0 in 0.933s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:40:01 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-7f52b1aa-e9ae-4b4a-b5ca-38e52c0f4e02 tempest-GroupSnapshotsV319Test-1080477777 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d43f68c-2565-430d-818b-f96b53ab8bef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:40:01 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f4b6d7-3dde-412a-be03-7923366b1bc3]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:40:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7f52b1aa-e9ae-4b4a-b5ca-38e52c0f4e02 tempest-GroupSnapshotsV319Test-1080477777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:40:01 devstack sudo[91065]: pam_unix(sudo:session): session closed for user root Jul 31 10:40:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0a5a06d9-9d78-48c1-8cf3-52f29ee71046 tempest-ServerRescueNegativeTestJSON-1298829817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5986d113-0163-4a90-9608-970e36e853a0" returned: 0 in 0.713s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:40:01 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-0a5a06d9-9d78-48c1-8cf3-52f29ee71046 tempest-ServerRescueNegativeTestJSON-1298829817 None] Lock "cinder-quobyte-5986d113-0163-4a90-9608-970e36e853a0" released by "delete_volume" :: held 1.528s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:40:01 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-0a5a06d9-9d78-48c1-8cf3-52f29ee71046 tempest-ServerRescueNegativeTestJSON-1298829817 None] Created reservations ['f4128e0b-0973-4b05-8d98-7a2cab689211', '44555c52-c719-4426-8e70-aa62abb2d1b5', '6668fd66-714c-412e-9302-2f5ef9f44829', '32b202ce-6b6d-4813-a649-d09f27282a27'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:40:01 devstack sudo[91073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef Jul 31 10:40:01 devstack sudo[91073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:40:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0a5a06d9-9d78-48c1-8cf3-52f29ee71046 tempest-ServerRescueNegativeTestJSON-1298829817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:40:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0a5a06d9-9d78-48c1-8cf3-52f29ee71046 tempest-ServerRescueNegativeTestJSON-1298829817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:40:01 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0a5a06d9-9d78-48c1-8cf3-52f29ee71046 tempest-ServerRescueNegativeTestJSON-1298829817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:40:01 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0a5a06d9-9d78-48c1-8cf3-52f29ee71046 tempest-ServerRescueNegativeTestJSON-1298829817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:40:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0a5a06d9-9d78-48c1-8cf3-52f29ee71046 tempest-ServerRescueNegativeTestJSON-1298829817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:40:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0a5a06d9-9d78-48c1-8cf3-52f29ee71046 tempest-ServerRescueNegativeTestJSON-1298829817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:40:02 devstack sudo[91076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:40:02 devstack sudo[91076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:40:02 devstack sudo[91073]: pam_unix(sudo:session): session closed for user root Jul 31 10:40:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7f52b1aa-e9ae-4b4a-b5ca-38e52c0f4e02 tempest-GroupSnapshotsV319Test-1080477777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef" returned: 0 in 0.833s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:40:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7f52b1aa-e9ae-4b4a-b5ca-38e52c0f4e02 tempest-GroupSnapshotsV319Test-1080477777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef.aafb4e9e-2a0e-483e-afc2-3c2524206792 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:40:02 devstack sudo[91076]: pam_unix(sudo:session): session closed for user root Jul 31 10:40:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0a5a06d9-9d78-48c1-8cf3-52f29ee71046 tempest-ServerRescueNegativeTestJSON-1298829817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.395s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:40:02 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-0a5a06d9-9d78-48c1-8cf3-52f29ee71046 tempest-ServerRescueNegativeTestJSON-1298829817 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:40:02 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-0a5a06d9-9d78-48c1-8cf3-52f29ee71046 tempest-ServerRescueNegativeTestJSON-1298829817 None] Deleted volume successfully. Jul 31 10:40:02 devstack sudo[91082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef.aafb4e9e-2a0e-483e-afc2-3c2524206792 Jul 31 10:40:02 devstack sudo[91082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:40:02 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-0a5a06d9-9d78-48c1-8cf3-52f29ee71046 tempest-ServerRescueNegativeTestJSON-1298829817 None] Lock "cinder-5986d113-0163-4a90-9608-970e36e853a0-delete_volume" released by "delete_volume" :: held 2.442s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:40:03 devstack sudo[91082]: pam_unix(sudo:session): session closed for user root Jul 31 10:40:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7f52b1aa-e9ae-4b4a-b5ca-38e52c0f4e02 tempest-GroupSnapshotsV319Test-1080477777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef.aafb4e9e-2a0e-483e-afc2-3c2524206792" returned: 0 in 0.783s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:40:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7f52b1aa-e9ae-4b4a-b5ca-38e52c0f4e02 tempest-GroupSnapshotsV319Test-1080477777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef.aafb4e9e-2a0e-483e-afc2-3c2524206792 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:40:03 devstack sudo[91093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef.aafb4e9e-2a0e-483e-afc2-3c2524206792 Jul 31 10:40:03 devstack sudo[91093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:40:03 devstack sudo[91093]: pam_unix(sudo:session): session closed for user root Jul 31 10:40:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7f52b1aa-e9ae-4b4a-b5ca-38e52c0f4e02 tempest-GroupSnapshotsV319Test-1080477777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef.aafb4e9e-2a0e-483e-afc2-3c2524206792" returned: 0 in 0.517s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:40:03 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7f52b1aa-e9ae-4b4a-b5ca-38e52c0f4e02 tempest-GroupSnapshotsV319Test-1080477777 None] Lock "cinder-quobyte-aafb4e9e-2a0e-483e-afc2-3c2524206792" released by "_delete_snapshot" :: held 3.310s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:40:03 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7f52b1aa-e9ae-4b4a-b5ca-38e52c0f4e02 tempest-GroupSnapshotsV319Test-1080477777 None] Lock "cinder-quobyte-3d43f68c-2565-430d-818b-f96b53ab8bef" released by "delete_snapshot" :: held 3.357s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:40:03 devstack cinder-volume[89090]: WARNING cinder.quota [None req-7f52b1aa-e9ae-4b4a-b5ca-38e52c0f4e02 tempest-GroupSnapshotsV319Test-1080477777 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-324541065 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-324541065, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:40:03 devstack cinder-volume[89090]: WARNING cinder.quota [None req-7f52b1aa-e9ae-4b4a-b5ca-38e52c0f4e02 tempest-GroupSnapshotsV319Test-1080477777 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-324541065 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-324541065, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:40:03 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-7f52b1aa-e9ae-4b4a-b5ca-38e52c0f4e02 tempest-GroupSnapshotsV319Test-1080477777 None] Created reservations ['81346524-fe55-444b-a61f-384bc15ebec4', 'd12bd02f-0772-4714-af09-5de6d7a8d4bd', '7ce76ccc-79c9-4701-93f6-3476526b9277', '41835c3a-1012-4ab3-aa42-f47d0acee35b'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:40:04 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-7f52b1aa-e9ae-4b4a-b5ca-38e52c0f4e02 tempest-GroupSnapshotsV319Test-1080477777 None] group_snapshot 9c8010d4-f936-4a8f-b97e-da22c1caf7b8: deleted successfully Jul 31 10:40:05 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-5b405e53-3282-4e56-8738-d1a42dfb4afe tempest-GroupSnapshotsV319Test-1080477777 None] Acquiring lock "cinder-quobyte-3d43f68c-2565-430d-818b-f96b53ab8bef" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:40:05 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-5b405e53-3282-4e56-8738-d1a42dfb4afe tempest-GroupSnapshotsV319Test-1080477777 None] Lock "cinder-quobyte-3d43f68c-2565-430d-818b-f96b53ab8bef" acquired by "delete_volume" :: waited 0.020s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:40:05 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2953e7-0325-4089-99a7-4880745763a9]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:40:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5b405e53-3282-4e56-8738-d1a42dfb4afe tempest-GroupSnapshotsV319Test-1080477777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:40:05 devstack sudo[91124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef Jul 31 10:40:05 devstack sudo[91124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:40:05 devstack sudo[91124]: pam_unix(sudo:session): session closed for user root Jul 31 10:40:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5b405e53-3282-4e56-8738-d1a42dfb4afe tempest-GroupSnapshotsV319Test-1080477777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef" returned: 0 in 0.549s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:40:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5b405e53-3282-4e56-8738-d1a42dfb4afe tempest-GroupSnapshotsV319Test-1080477777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:40:05 devstack sudo[91131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef Jul 31 10:40:05 devstack sudo[91131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:40:06 devstack sudo[91131]: pam_unix(sudo:session): session closed for user root Jul 31 10:40:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5b405e53-3282-4e56-8738-d1a42dfb4afe tempest-GroupSnapshotsV319Test-1080477777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3d43f68c-2565-430d-818b-f96b53ab8bef" returned: 0 in 0.453s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:40:06 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-5b405e53-3282-4e56-8738-d1a42dfb4afe tempest-GroupSnapshotsV319Test-1080477777 None] Lock "cinder-quobyte-3d43f68c-2565-430d-818b-f96b53ab8bef" released by "delete_volume" :: held 1.111s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:40:06 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-5b405e53-3282-4e56-8738-d1a42dfb4afe tempest-GroupSnapshotsV319Test-1080477777 None] Created reservations ['608e07ee-246c-4a78-8c60-2025de334d43'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:40:06 devstack cinder-volume[89090]: WARNING cinder.quota [None req-5b405e53-3282-4e56-8738-d1a42dfb4afe tempest-GroupSnapshotsV319Test-1080477777 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-324541065 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-324541065, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:40:06 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-5b405e53-3282-4e56-8738-d1a42dfb4afe tempest-GroupSnapshotsV319Test-1080477777 None] Created reservations ['dfefe2ea-2abf-419f-9f7b-53b79b1ec0de', 'f3296d73-3f5a-40e6-8b1f-0731c7477d5c', '3c264eb4-0a4c-40a7-8353-3ea32dd708cf', 'a5068b9b-2520-4cbb-9038-ca13f5f47c81'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:40:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-5b405e53-3282-4e56-8738-d1a42dfb4afe tempest-GroupSnapshotsV319Test-1080477777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:40:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-5b405e53-3282-4e56-8738-d1a42dfb4afe tempest-GroupSnapshotsV319Test-1080477777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:40:06 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-5b405e53-3282-4e56-8738-d1a42dfb4afe tempest-GroupSnapshotsV319Test-1080477777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:40:06 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-5b405e53-3282-4e56-8738-d1a42dfb4afe tempest-GroupSnapshotsV319Test-1080477777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:40:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-5b405e53-3282-4e56-8738-d1a42dfb4afe tempest-GroupSnapshotsV319Test-1080477777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:40:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5b405e53-3282-4e56-8738-d1a42dfb4afe tempest-GroupSnapshotsV319Test-1080477777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:40:06 devstack sudo[91136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:40:06 devstack sudo[91136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:40:07 devstack sudo[91136]: pam_unix(sudo:session): session closed for user root Jul 31 10:40:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5b405e53-3282-4e56-8738-d1a42dfb4afe tempest-GroupSnapshotsV319Test-1080477777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.365s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:40:07 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-5b405e53-3282-4e56-8738-d1a42dfb4afe tempest-GroupSnapshotsV319Test-1080477777 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:40:07 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-5b405e53-3282-4e56-8738-d1a42dfb4afe tempest-GroupSnapshotsV319Test-1080477777 None] Delete group completed successfully. Jul 31 10:40:16 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:UPDATE=62,cinder:SELECT=48,cinder:INSERT=12,cinder:DELETE=1 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:40:16 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=59,cinder:UPDATE=54,cinder:DELETE=6,cinder:INSERT=14 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:40:34 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-87691274-741e-4f74-984b-d09527a04819 tempest-TaggedAttachmentsTest-336293518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:40:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-87691274-741e-4f74-984b-d09527a04819 tempest-TaggedAttachmentsTest-336293518 None] Flow 'volume_create_manager' (c763d7c9-d3dc-4a08-96a8-32bd58920ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:40:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-87691274-741e-4f74-984b-d09527a04819 tempest-TaggedAttachmentsTest-336293518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e02f934-9450-48c4-a31b-d90a31d211c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:40:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-87691274-741e-4f74-984b-d09527a04819 tempest-TaggedAttachmentsTest-336293518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e02f934-9450-48c4-a31b-d90a31d211c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1826778102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88f09009-11ce-4390-ae9a-bcc7833a7829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08271182899f43b8a8a0fe2b2575dd2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:40:35Z,use_quota=True,user_id='8bbd2a69256f40beb4e215c18033bc58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:40:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-87691274-741e-4f74-984b-d09527a04819 tempest-TaggedAttachmentsTest-336293518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1848d3d-5737-4a01-b1e0-12fe990af1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:40:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-87691274-741e-4f74-984b-d09527a04819 tempest-TaggedAttachmentsTest-336293518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1848d3d-5737-4a01-b1e0-12fe990af1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:40:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-87691274-741e-4f74-984b-d09527a04819 tempest-TaggedAttachmentsTest-336293518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d2cf4ba-1b52-4724-b88d-590a29d5d921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:40:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-87691274-741e-4f74-984b-d09527a04819 tempest-TaggedAttachmentsTest-336293518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d2cf4ba-1b52-4724-b88d-590a29d5d921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88f09009-11ce-4390-ae9a-bcc7833a7829', 'volume_name': 'volume-88f09009-11ce-4390-ae9a-bcc7833a7829', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:40:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-87691274-741e-4f74-984b-d09527a04819 tempest-TaggedAttachmentsTest-336293518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea6399c-d51c-4530-b7cd-c9648490b885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:40:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-87691274-741e-4f74-984b-d09527a04819 tempest-TaggedAttachmentsTest-336293518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea6399c-d51c-4530-b7cd-c9648490b885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:40:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-87691274-741e-4f74-984b-d09527a04819 tempest-TaggedAttachmentsTest-336293518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ad8c020-0267-4765-b199-2336c4a4bff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:40:35 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-87691274-741e-4f74-984b-d09527a04819 tempest-TaggedAttachmentsTest-336293518 None] Volume 88f09009-11ce-4390-ae9a-bcc7833a7829: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88f09009-11ce-4390-ae9a-bcc7833a7829', 'volume_size': 1} Jul 31 10:40:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-87691274-741e-4f74-984b-d09527a04819 tempest-TaggedAttachmentsTest-336293518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:40:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-87691274-741e-4f74-984b-d09527a04819 tempest-TaggedAttachmentsTest-336293518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:40:35 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-87691274-741e-4f74-984b-d09527a04819 tempest-TaggedAttachmentsTest-336293518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1826778102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88f09009-11ce-4390-ae9a-bcc7833a7829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08271182899f43b8a8a0fe2b2575dd2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:40:35Z,use_quota=True,user_id='8bbd2a69256f40beb4e215c18033bc58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:40:35 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-87691274-741e-4f74-984b-d09527a04819 tempest-TaggedAttachmentsTest-336293518 None] Creating volume 88f09009-11ce-4390-ae9a-bcc7833a7829 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:40:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-87691274-741e-4f74-984b-d09527a04819 tempest-TaggedAttachmentsTest-336293518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:40:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-87691274-741e-4f74-984b-d09527a04819 tempest-TaggedAttachmentsTest-336293518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:40:35 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-87691274-741e-4f74-984b-d09527a04819 tempest-TaggedAttachmentsTest-336293518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:40:35 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-87691274-741e-4f74-984b-d09527a04819 tempest-TaggedAttachmentsTest-336293518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:40:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-87691274-741e-4f74-984b-d09527a04819 tempest-TaggedAttachmentsTest-336293518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:40:35 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-87691274-741e-4f74-984b-d09527a04819 tempest-TaggedAttachmentsTest-336293518 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:40:35 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-87691274-741e-4f74-984b-d09527a04819 tempest-TaggedAttachmentsTest-336293518 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:40:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-87691274-741e-4f74-984b-d09527a04819 tempest-TaggedAttachmentsTest-336293518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-88f09009-11ce-4390-ae9a-bcc7833a7829 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:40:35 devstack sudo[91189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-88f09009-11ce-4390-ae9a-bcc7833a7829 1073741824 Jul 31 10:40:35 devstack sudo[91189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:40:35 devstack sudo[91189]: pam_unix(sudo:session): session closed for user root Jul 31 10:40:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-87691274-741e-4f74-984b-d09527a04819 tempest-TaggedAttachmentsTest-336293518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-88f09009-11ce-4390-ae9a-bcc7833a7829 1073741824" returned: 0 in 0.527s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:40:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-87691274-741e-4f74-984b-d09527a04819 tempest-TaggedAttachmentsTest-336293518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-88f09009-11ce-4390-ae9a-bcc7833a7829 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:40:35 devstack sudo[91196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-88f09009-11ce-4390-ae9a-bcc7833a7829 Jul 31 10:40:35 devstack sudo[91196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:40:35 devstack sudo[91196]: pam_unix(sudo:session): session closed for user root Jul 31 10:40:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-87691274-741e-4f74-984b-d09527a04819 tempest-TaggedAttachmentsTest-336293518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-88f09009-11ce-4390-ae9a-bcc7833a7829" returned: 0 in 0.285s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:40:35 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-87691274-741e-4f74-984b-d09527a04819 tempest-TaggedAttachmentsTest-336293518 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:40:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-87691274-741e-4f74-984b-d09527a04819 tempest-TaggedAttachmentsTest-336293518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:40:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-87691274-741e-4f74-984b-d09527a04819 tempest-TaggedAttachmentsTest-336293518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ad8c020-0267-4765-b199-2336c4a4bff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88f09009-11ce-4390-ae9a-bcc7833a7829', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:40:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-87691274-741e-4f74-984b-d09527a04819 tempest-TaggedAttachmentsTest-336293518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22c3f845-ecb3-4d86-93d5-59ca11ac75c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:40:35 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-87691274-741e-4f74-984b-d09527a04819 tempest-TaggedAttachmentsTest-336293518 None] Volume volume-88f09009-11ce-4390-ae9a-bcc7833a7829 (88f09009-11ce-4390-ae9a-bcc7833a7829): created successfully Jul 31 10:40:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-87691274-741e-4f74-984b-d09527a04819 tempest-TaggedAttachmentsTest-336293518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22c3f845-ecb3-4d86-93d5-59ca11ac75c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:40:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-87691274-741e-4f74-984b-d09527a04819 tempest-TaggedAttachmentsTest-336293518 None] Flow 'volume_create_manager' (c763d7c9-d3dc-4a08-96a8-32bd58920ce6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:40:35 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-87691274-741e-4f74-984b-d09527a04819 tempest-TaggedAttachmentsTest-336293518 None] Created volume successfully. Jul 31 10:40:40 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f03387e-2cc5-4545-9d9f-66391dcc04d0 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:40:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6f03387e-2cc5-4545-9d9f-66391dcc04d0 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Flow 'volume_create_manager' (de3396cd-0575-46fd-b3ca-63cf67f48660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:40:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6f03387e-2cc5-4545-9d9f-66391dcc04d0 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1d2c74e-2ad2-4497-beef-42c29d2b6c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:40:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6f03387e-2cc5-4545-9d9f-66391dcc04d0 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1d2c74e-2ad2-4497-beef-42c29d2b6c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1242688083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1232c3a4-e853-426d-9692-880eb4eef80e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16be6f6afd284c959e1659d96c7b580f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:40:40Z,use_quota=True,user_id='cb5634a47bc04e0ca10cf617839823fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(beaf9122-feb0-4e22-9836-ce766b1d44a5),volume_type_id=beaf9122-feb0-4e22-9836-ce766b1d44a5)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:40:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6f03387e-2cc5-4545-9d9f-66391dcc04d0 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75250a74-e8a0-4e6a-9cad-f3c7951c367d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:40:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6f03387e-2cc5-4545-9d9f-66391dcc04d0 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75250a74-e8a0-4e6a-9cad-f3c7951c367d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:40:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6f03387e-2cc5-4545-9d9f-66391dcc04d0 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8ea6f6f-4cdf-4a9d-996c-0297aa2135ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:40:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6f03387e-2cc5-4545-9d9f-66391dcc04d0 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8ea6f6f-4cdf-4a9d-996c-0297aa2135ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1232c3a4-e853-426d-9692-880eb4eef80e', 'volume_name': 'volume-1232c3a4-e853-426d-9692-880eb4eef80e', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:40:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6f03387e-2cc5-4545-9d9f-66391dcc04d0 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94db63d8-d896-4b9c-92ef-ff5ee9df0080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:40:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6f03387e-2cc5-4545-9d9f-66391dcc04d0 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94db63d8-d896-4b9c-92ef-ff5ee9df0080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:40:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6f03387e-2cc5-4545-9d9f-66391dcc04d0 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b4b5714-509c-4511-b705-a202893d476b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:40:40 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-6f03387e-2cc5-4545-9d9f-66391dcc04d0 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Volume 1232c3a4-e853-426d-9692-880eb4eef80e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1232c3a4-e853-426d-9692-880eb4eef80e', 'volume_size': 1} Jul 31 10:40:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6f03387e-2cc5-4545-9d9f-66391dcc04d0 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:40:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6f03387e-2cc5-4545-9d9f-66391dcc04d0 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:40:40 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-6f03387e-2cc5-4545-9d9f-66391dcc04d0 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1242688083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1232c3a4-e853-426d-9692-880eb4eef80e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16be6f6afd284c959e1659d96c7b580f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:40:40Z,use_quota=True,user_id='cb5634a47bc04e0ca10cf617839823fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(beaf9122-feb0-4e22-9836-ce766b1d44a5),volume_type_id=beaf9122-feb0-4e22-9836-ce766b1d44a5)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:40:40 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-6f03387e-2cc5-4545-9d9f-66391dcc04d0 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Creating volume 1232c3a4-e853-426d-9692-880eb4eef80e {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:40:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6f03387e-2cc5-4545-9d9f-66391dcc04d0 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:40:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6f03387e-2cc5-4545-9d9f-66391dcc04d0 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:40:40 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-6f03387e-2cc5-4545-9d9f-66391dcc04d0 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:40:40 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-6f03387e-2cc5-4545-9d9f-66391dcc04d0 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:40:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6f03387e-2cc5-4545-9d9f-66391dcc04d0 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:40:40 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-6f03387e-2cc5-4545-9d9f-66391dcc04d0 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:40:40 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-6f03387e-2cc5-4545-9d9f-66391dcc04d0 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:40:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6f03387e-2cc5-4545-9d9f-66391dcc04d0 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1232c3a4-e853-426d-9692-880eb4eef80e 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:40:40 devstack sudo[91203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1232c3a4-e853-426d-9692-880eb4eef80e 1073741824 Jul 31 10:40:40 devstack sudo[91203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:40:40 devstack sudo[91203]: pam_unix(sudo:session): session closed for user root Jul 31 10:40:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6f03387e-2cc5-4545-9d9f-66391dcc04d0 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1232c3a4-e853-426d-9692-880eb4eef80e 1073741824" returned: 0 in 0.737s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:40:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6f03387e-2cc5-4545-9d9f-66391dcc04d0 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1232c3a4-e853-426d-9692-880eb4eef80e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:40:41 devstack sudo[91209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1232c3a4-e853-426d-9692-880eb4eef80e Jul 31 10:40:41 devstack sudo[91209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:40:41 devstack sudo[91209]: pam_unix(sudo:session): session closed for user root Jul 31 10:40:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6f03387e-2cc5-4545-9d9f-66391dcc04d0 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1232c3a4-e853-426d-9692-880eb4eef80e" returned: 0 in 0.378s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:40:41 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-6f03387e-2cc5-4545-9d9f-66391dcc04d0 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:40:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6f03387e-2cc5-4545-9d9f-66391dcc04d0 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:40:41 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6f03387e-2cc5-4545-9d9f-66391dcc04d0 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b4b5714-509c-4511-b705-a202893d476b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1232c3a4-e853-426d-9692-880eb4eef80e', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:40:41 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6f03387e-2cc5-4545-9d9f-66391dcc04d0 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b95739-22fe-4757-bc5f-1728a70b99b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:40:41 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-6f03387e-2cc5-4545-9d9f-66391dcc04d0 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Volume volume-1232c3a4-e853-426d-9692-880eb4eef80e (1232c3a4-e853-426d-9692-880eb4eef80e): created successfully Jul 31 10:40:41 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6f03387e-2cc5-4545-9d9f-66391dcc04d0 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b95739-22fe-4757-bc5f-1728a70b99b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:40:41 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6f03387e-2cc5-4545-9d9f-66391dcc04d0 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Flow 'volume_create_manager' (de3396cd-0575-46fd-b3ca-63cf67f48660) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:40:41 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-6f03387e-2cc5-4545-9d9f-66391dcc04d0 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Created volume successfully. Jul 31 10:40:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-1b9da6fb-018b-4162-9592-34f3b4a3a900 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:40:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-1b9da6fb-018b-4162-9592-34f3b4a3a900 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:40:42 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-1b9da6fb-018b-4162-9592-34f3b4a3a900 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:40:42 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-1b9da6fb-018b-4162-9592-34f3b4a3a900 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:40:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-1b9da6fb-018b-4162-9592-34f3b4a3a900 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:40:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1b9da6fb-018b-4162-9592-34f3b4a3a900 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:40:42 devstack sudo[91212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:40:42 devstack sudo[91212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:40:43 devstack sudo[91212]: pam_unix(sudo:session): session closed for user root Jul 31 10:40:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1b9da6fb-018b-4162-9592-34f3b4a3a900 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.319s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:40:43 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-1b9da6fb-018b-4162-9592-34f3b4a3a900 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:40:43 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-1b9da6fb-018b-4162-9592-34f3b4a3a900 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Retype volume completed successfully. Jul 31 10:40:44 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-450fde5a-0b80-4026-ad2e-2679b78bce90 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Acquiring lock "cinder-1232c3a4-e853-426d-9692-880eb4eef80e-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:40:44 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-450fde5a-0b80-4026-ad2e-2679b78bce90 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Lock "cinder-1232c3a4-e853-426d-9692-880eb4eef80e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:40:44 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-450fde5a-0b80-4026-ad2e-2679b78bce90 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Acquiring lock "cinder-quobyte-1232c3a4-e853-426d-9692-880eb4eef80e" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:40:44 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-450fde5a-0b80-4026-ad2e-2679b78bce90 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Lock "cinder-quobyte-1232c3a4-e853-426d-9692-880eb4eef80e" acquired by "delete_volume" :: waited 0.022s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:40:44 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9da744-5411-4e01-9bbe-4f0837cd3748]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:40:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-450fde5a-0b80-4026-ad2e-2679b78bce90 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1232c3a4-e853-426d-9692-880eb4eef80e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:40:44 devstack sudo[91215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1232c3a4-e853-426d-9692-880eb4eef80e Jul 31 10:40:44 devstack sudo[91215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:40:44 devstack sudo[91215]: pam_unix(sudo:session): session closed for user root Jul 31 10:40:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-450fde5a-0b80-4026-ad2e-2679b78bce90 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1232c3a4-e853-426d-9692-880eb4eef80e" returned: 0 in 0.556s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:40:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-450fde5a-0b80-4026-ad2e-2679b78bce90 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1232c3a4-e853-426d-9692-880eb4eef80e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:40:44 devstack sudo[91220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1232c3a4-e853-426d-9692-880eb4eef80e Jul 31 10:40:44 devstack sudo[91220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:40:45 devstack sudo[91220]: pam_unix(sudo:session): session closed for user root Jul 31 10:40:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-450fde5a-0b80-4026-ad2e-2679b78bce90 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1232c3a4-e853-426d-9692-880eb4eef80e" returned: 0 in 0.307s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:40:45 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-450fde5a-0b80-4026-ad2e-2679b78bce90 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Lock "cinder-quobyte-1232c3a4-e853-426d-9692-880eb4eef80e" released by "delete_volume" :: held 0.921s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:40:45 devstack cinder-volume[89090]: WARNING cinder.quota [None req-450fde5a-0b80-4026-ad2e-2679b78bce90 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:40:45 devstack cinder-volume[89090]: WARNING cinder.quota [None req-450fde5a-0b80-4026-ad2e-2679b78bce90 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:40:45 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-450fde5a-0b80-4026-ad2e-2679b78bce90 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Created reservations ['b1041766-fab3-48bd-945f-49daa6ac6158', '2ce95edb-0e74-40ed-8a88-97ea2adcdfe1', 'fe26ca5a-c6c1-4752-b76e-741e3075a6c3', '17e9404b-1c87-4ab0-9f80-879b1b63f504'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:40:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-450fde5a-0b80-4026-ad2e-2679b78bce90 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:40:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-450fde5a-0b80-4026-ad2e-2679b78bce90 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:40:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-450fde5a-0b80-4026-ad2e-2679b78bce90 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:40:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-450fde5a-0b80-4026-ad2e-2679b78bce90 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:40:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-450fde5a-0b80-4026-ad2e-2679b78bce90 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:40:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-450fde5a-0b80-4026-ad2e-2679b78bce90 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:40:45 devstack sudo[91227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:40:45 devstack sudo[91227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:40:45 devstack sudo[91227]: pam_unix(sudo:session): session closed for user root Jul 31 10:40:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-450fde5a-0b80-4026-ad2e-2679b78bce90 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.406s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:40:45 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-450fde5a-0b80-4026-ad2e-2679b78bce90 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:40:45 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-450fde5a-0b80-4026-ad2e-2679b78bce90 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Deleted volume successfully. Jul 31 10:40:45 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-450fde5a-0b80-4026-ad2e-2679b78bce90 tempest-VolumeRetypeWithoutMigrationTest-1611978643 None] Lock "cinder-1232c3a4-e853-426d-9692-880eb4eef80e-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:40:45 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:40:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:40:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:40:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:40:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:40:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:40:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:40:45 devstack sudo[91234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:40:45 devstack sudo[91234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:40:46 devstack sudo[91234]: pam_unix(sudo:session): session closed for user root Jul 31 10:40:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.409s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:40:46 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:40:46 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager._thread_info {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:40:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread count: 8 {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:40:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread info: [<_MainThread(MainThread, started 134005426110592)>, , , , , , , ] {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:40:55 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:UPDATE=21,cinder:SELECT=13,cinder:DELETE=1,cinder:INSERT=4 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:40:55 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=19,cinder:INSERT=2,cinder:UPDATE=16,cinder:DELETE=2 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:41:00 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cc3f155-4ca0-4194-adbb-4396c4115495 tempest-VolumesServicesTestJSON-119736479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:41:00 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0cc3f155-4ca0-4194-adbb-4396c4115495 tempest-VolumesServicesTestJSON-119736479 None] Flow 'volume_create_manager' (32cc2f2d-bfde-43d9-b982-0d385b298f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:41:00 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0cc3f155-4ca0-4194-adbb-4396c4115495 tempest-VolumesServicesTestJSON-119736479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f1f248-f118-4e54-9e86-f0ae88476f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:41:00 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0cc3f155-4ca0-4194-adbb-4396c4115495 tempest-VolumesServicesTestJSON-119736479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f1f248-f118-4e54-9e86-f0ae88476f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1248542596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cca96343-32aa-4e32-a02a-0ded2d8d89b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae1123bafaf452eb59ebd40b3ac5720',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:41:01Z,use_quota=True,user_id='dd5b486fd90e49dda0118eac632e6e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:41:00 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0cc3f155-4ca0-4194-adbb-4396c4115495 tempest-VolumesServicesTestJSON-119736479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (450eff4b-acd9-4b04-a3ae-392ca83780bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:41:00 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0cc3f155-4ca0-4194-adbb-4396c4115495 tempest-VolumesServicesTestJSON-119736479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (450eff4b-acd9-4b04-a3ae-392ca83780bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:41:00 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0cc3f155-4ca0-4194-adbb-4396c4115495 tempest-VolumesServicesTestJSON-119736479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ca025aa-865f-4d84-b3cd-79baa93b4e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:41:00 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0cc3f155-4ca0-4194-adbb-4396c4115495 tempest-VolumesServicesTestJSON-119736479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ca025aa-865f-4d84-b3cd-79baa93b4e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cca96343-32aa-4e32-a02a-0ded2d8d89b8', 'volume_name': 'volume-cca96343-32aa-4e32-a02a-0ded2d8d89b8', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:41:00 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0cc3f155-4ca0-4194-adbb-4396c4115495 tempest-VolumesServicesTestJSON-119736479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6cf71ca-5483-44b2-8628-0e6135c25b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:41:00 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0cc3f155-4ca0-4194-adbb-4396c4115495 tempest-VolumesServicesTestJSON-119736479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6cf71ca-5483-44b2-8628-0e6135c25b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:41:01 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0cc3f155-4ca0-4194-adbb-4396c4115495 tempest-VolumesServicesTestJSON-119736479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c7d9151-596c-4f72-a5ea-647223c5f44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:41:01 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-0cc3f155-4ca0-4194-adbb-4396c4115495 tempest-VolumesServicesTestJSON-119736479 None] Volume cca96343-32aa-4e32-a02a-0ded2d8d89b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cca96343-32aa-4e32-a02a-0ded2d8d89b8', 'volume_size': 1} Jul 31 10:41:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0cc3f155-4ca0-4194-adbb-4396c4115495 tempest-VolumesServicesTestJSON-119736479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:41:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0cc3f155-4ca0-4194-adbb-4396c4115495 tempest-VolumesServicesTestJSON-119736479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:41:01 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0cc3f155-4ca0-4194-adbb-4396c4115495 tempest-VolumesServicesTestJSON-119736479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1248542596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cca96343-32aa-4e32-a02a-0ded2d8d89b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae1123bafaf452eb59ebd40b3ac5720',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:41:01Z,use_quota=True,user_id='dd5b486fd90e49dda0118eac632e6e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:41:01 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-0cc3f155-4ca0-4194-adbb-4396c4115495 tempest-VolumesServicesTestJSON-119736479 None] Creating volume cca96343-32aa-4e32-a02a-0ded2d8d89b8 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:41:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0cc3f155-4ca0-4194-adbb-4396c4115495 tempest-VolumesServicesTestJSON-119736479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:41:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0cc3f155-4ca0-4194-adbb-4396c4115495 tempest-VolumesServicesTestJSON-119736479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:41:01 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0cc3f155-4ca0-4194-adbb-4396c4115495 tempest-VolumesServicesTestJSON-119736479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:41:01 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0cc3f155-4ca0-4194-adbb-4396c4115495 tempest-VolumesServicesTestJSON-119736479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:41:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0cc3f155-4ca0-4194-adbb-4396c4115495 tempest-VolumesServicesTestJSON-119736479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:41:01 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0cc3f155-4ca0-4194-adbb-4396c4115495 tempest-VolumesServicesTestJSON-119736479 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:41:01 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-0cc3f155-4ca0-4194-adbb-4396c4115495 tempest-VolumesServicesTestJSON-119736479 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:41:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0cc3f155-4ca0-4194-adbb-4396c4115495 tempest-VolumesServicesTestJSON-119736479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cca96343-32aa-4e32-a02a-0ded2d8d89b8 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:41:01 devstack sudo[91574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cca96343-32aa-4e32-a02a-0ded2d8d89b8 1073741824 Jul 31 10:41:01 devstack sudo[91574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:41:02 devstack sudo[91574]: pam_unix(sudo:session): session closed for user root Jul 31 10:41:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0cc3f155-4ca0-4194-adbb-4396c4115495 tempest-VolumesServicesTestJSON-119736479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cca96343-32aa-4e32-a02a-0ded2d8d89b8 1073741824" returned: 0 in 1.002s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:41:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0cc3f155-4ca0-4194-adbb-4396c4115495 tempest-VolumesServicesTestJSON-119736479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cca96343-32aa-4e32-a02a-0ded2d8d89b8 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:41:02 devstack sudo[91602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cca96343-32aa-4e32-a02a-0ded2d8d89b8 Jul 31 10:41:02 devstack sudo[91602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:41:02 devstack sudo[91602]: pam_unix(sudo:session): session closed for user root Jul 31 10:41:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0cc3f155-4ca0-4194-adbb-4396c4115495 tempest-VolumesServicesTestJSON-119736479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cca96343-32aa-4e32-a02a-0ded2d8d89b8" returned: 0 in 0.481s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:41:02 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0cc3f155-4ca0-4194-adbb-4396c4115495 tempest-VolumesServicesTestJSON-119736479 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:41:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0cc3f155-4ca0-4194-adbb-4396c4115495 tempest-VolumesServicesTestJSON-119736479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:41:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0cc3f155-4ca0-4194-adbb-4396c4115495 tempest-VolumesServicesTestJSON-119736479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c7d9151-596c-4f72-a5ea-647223c5f44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cca96343-32aa-4e32-a02a-0ded2d8d89b8', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:41:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0cc3f155-4ca0-4194-adbb-4396c4115495 tempest-VolumesServicesTestJSON-119736479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a21fe39-391e-4ff7-a3b7-d16818c1f51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:41:02 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-0cc3f155-4ca0-4194-adbb-4396c4115495 tempest-VolumesServicesTestJSON-119736479 None] Volume volume-cca96343-32aa-4e32-a02a-0ded2d8d89b8 (cca96343-32aa-4e32-a02a-0ded2d8d89b8): created successfully Jul 31 10:41:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0cc3f155-4ca0-4194-adbb-4396c4115495 tempest-VolumesServicesTestJSON-119736479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a21fe39-391e-4ff7-a3b7-d16818c1f51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:41:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0cc3f155-4ca0-4194-adbb-4396c4115495 tempest-VolumesServicesTestJSON-119736479 None] Flow 'volume_create_manager' (32cc2f2d-bfde-43d9-b982-0d385b298f2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:41:02 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-0cc3f155-4ca0-4194-adbb-4396c4115495 tempest-VolumesServicesTestJSON-119736479 None] Created volume successfully. Jul 31 10:41:04 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-07385a41-14eb-4d2f-b232-0cb75d457ec0 tempest-VolumesServicesTestJSON-119736479 None] Acquiring lock "cinder-cca96343-32aa-4e32-a02a-0ded2d8d89b8-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:41:04 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-07385a41-14eb-4d2f-b232-0cb75d457ec0 tempest-VolumesServicesTestJSON-119736479 None] Lock "cinder-cca96343-32aa-4e32-a02a-0ded2d8d89b8-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:41:04 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-07385a41-14eb-4d2f-b232-0cb75d457ec0 tempest-VolumesServicesTestJSON-119736479 None] Acquiring lock "cinder-quobyte-cca96343-32aa-4e32-a02a-0ded2d8d89b8" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:41:04 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-07385a41-14eb-4d2f-b232-0cb75d457ec0 tempest-VolumesServicesTestJSON-119736479 None] Lock "cinder-quobyte-cca96343-32aa-4e32-a02a-0ded2d8d89b8" acquired by "delete_volume" :: waited 0.023s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:41:04 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6b7f73-7a5c-4ca3-9206-e7d6f518731f]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:41:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-07385a41-14eb-4d2f-b232-0cb75d457ec0 tempest-VolumesServicesTestJSON-119736479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cca96343-32aa-4e32-a02a-0ded2d8d89b8 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:41:05 devstack sudo[91612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cca96343-32aa-4e32-a02a-0ded2d8d89b8 Jul 31 10:41:05 devstack sudo[91612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:41:05 devstack sudo[91612]: pam_unix(sudo:session): session closed for user root Jul 31 10:41:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-07385a41-14eb-4d2f-b232-0cb75d457ec0 tempest-VolumesServicesTestJSON-119736479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cca96343-32aa-4e32-a02a-0ded2d8d89b8" returned: 0 in 0.797s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:41:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-07385a41-14eb-4d2f-b232-0cb75d457ec0 tempest-VolumesServicesTestJSON-119736479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cca96343-32aa-4e32-a02a-0ded2d8d89b8 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:41:05 devstack sudo[91617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cca96343-32aa-4e32-a02a-0ded2d8d89b8 Jul 31 10:41:05 devstack sudo[91617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:41:06 devstack sudo[91617]: pam_unix(sudo:session): session closed for user root Jul 31 10:41:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-07385a41-14eb-4d2f-b232-0cb75d457ec0 tempest-VolumesServicesTestJSON-119736479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cca96343-32aa-4e32-a02a-0ded2d8d89b8" returned: 0 in 0.664s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:41:06 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-07385a41-14eb-4d2f-b232-0cb75d457ec0 tempest-VolumesServicesTestJSON-119736479 None] Lock "cinder-quobyte-cca96343-32aa-4e32-a02a-0ded2d8d89b8" released by "delete_volume" :: held 1.598s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:41:06 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-07385a41-14eb-4d2f-b232-0cb75d457ec0 tempest-VolumesServicesTestJSON-119736479 None] Created reservations ['90345034-b3d5-4ac4-ba75-cc18afbbd5f4', '00acf97e-7394-4845-a850-454850815df3', 'cada46ab-4131-43d3-94fa-c41b5b7eb896', '8005c38b-df30-4a7e-aa3f-7cb48cf9c770'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:41:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-07385a41-14eb-4d2f-b232-0cb75d457ec0 tempest-VolumesServicesTestJSON-119736479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:41:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-07385a41-14eb-4d2f-b232-0cb75d457ec0 tempest-VolumesServicesTestJSON-119736479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:41:06 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-07385a41-14eb-4d2f-b232-0cb75d457ec0 tempest-VolumesServicesTestJSON-119736479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:41:06 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-07385a41-14eb-4d2f-b232-0cb75d457ec0 tempest-VolumesServicesTestJSON-119736479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:41:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-07385a41-14eb-4d2f-b232-0cb75d457ec0 tempest-VolumesServicesTestJSON-119736479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:41:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-07385a41-14eb-4d2f-b232-0cb75d457ec0 tempest-VolumesServicesTestJSON-119736479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:41:06 devstack sudo[91623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:41:06 devstack sudo[91623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:41:07 devstack sudo[91623]: pam_unix(sudo:session): session closed for user root Jul 31 10:41:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-07385a41-14eb-4d2f-b232-0cb75d457ec0 tempest-VolumesServicesTestJSON-119736479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.774s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:41:07 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-07385a41-14eb-4d2f-b232-0cb75d457ec0 tempest-VolumesServicesTestJSON-119736479 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:41:07 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-07385a41-14eb-4d2f-b232-0cb75d457ec0 tempest-VolumesServicesTestJSON-119736479 None] Deleted volume successfully. Jul 31 10:41:07 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-07385a41-14eb-4d2f-b232-0cb75d457ec0 tempest-VolumesServicesTestJSON-119736479 None] Lock "cinder-cca96343-32aa-4e32-a02a-0ded2d8d89b8-delete_volume" released by "delete_volume" :: held 3.198s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:41:16 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=10 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:41:17 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=9,cinder:UPDATE=12,cinder:DELETE=2,cinder:INSERT=2 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:41:25 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dec3023-ae41-4c27-b09b-773d61c011ca tempest-ServerActionsTestOtherA-938259275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:41:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3dec3023-ae41-4c27-b09b-773d61c011ca tempest-ServerActionsTestOtherA-938259275 None] Flow 'volume_create_manager' (3f8dbaa2-019e-488f-8b87-6a9f81ac6ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:41:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3dec3023-ae41-4c27-b09b-773d61c011ca tempest-ServerActionsTestOtherA-938259275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c2ca84c-cd76-415d-b84d-665910ba3883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:41:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3dec3023-ae41-4c27-b09b-773d61c011ca tempest-ServerActionsTestOtherA-938259275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c2ca84c-cd76-415d-b84d-665910ba3883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-767326891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c48c586e-d272-43f1-8ab3-c839e2d4a81e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffd8fb54155e40ee854351c3617d2e13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:41:25Z,use_quota=True,user_id='87e4918ea14146bc8657f356a67592ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:41:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3dec3023-ae41-4c27-b09b-773d61c011ca tempest-ServerActionsTestOtherA-938259275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7543455-02ae-443d-98aa-90299a6bc298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:41:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3dec3023-ae41-4c27-b09b-773d61c011ca tempest-ServerActionsTestOtherA-938259275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7543455-02ae-443d-98aa-90299a6bc298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:41:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3dec3023-ae41-4c27-b09b-773d61c011ca tempest-ServerActionsTestOtherA-938259275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f7c81df-fa9f-4b22-9843-72bb8f9f980c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:41:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3dec3023-ae41-4c27-b09b-773d61c011ca tempest-ServerActionsTestOtherA-938259275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f7c81df-fa9f-4b22-9843-72bb8f9f980c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c48c586e-d272-43f1-8ab3-c839e2d4a81e', 'volume_name': 'volume-c48c586e-d272-43f1-8ab3-c839e2d4a81e', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:41:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3dec3023-ae41-4c27-b09b-773d61c011ca tempest-ServerActionsTestOtherA-938259275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (906761ee-dd14-401e-a487-cd2511d2156e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:41:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3dec3023-ae41-4c27-b09b-773d61c011ca tempest-ServerActionsTestOtherA-938259275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (906761ee-dd14-401e-a487-cd2511d2156e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:41:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3dec3023-ae41-4c27-b09b-773d61c011ca tempest-ServerActionsTestOtherA-938259275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72309c6b-1afd-4408-a063-c2dfe73769ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:41:25 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-3dec3023-ae41-4c27-b09b-773d61c011ca tempest-ServerActionsTestOtherA-938259275 None] Volume c48c586e-d272-43f1-8ab3-c839e2d4a81e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c48c586e-d272-43f1-8ab3-c839e2d4a81e', 'volume_size': 1} Jul 31 10:41:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3dec3023-ae41-4c27-b09b-773d61c011ca tempest-ServerActionsTestOtherA-938259275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:41:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3dec3023-ae41-4c27-b09b-773d61c011ca tempest-ServerActionsTestOtherA-938259275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:41:25 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-3dec3023-ae41-4c27-b09b-773d61c011ca tempest-ServerActionsTestOtherA-938259275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-767326891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c48c586e-d272-43f1-8ab3-c839e2d4a81e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffd8fb54155e40ee854351c3617d2e13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:41:25Z,use_quota=True,user_id='87e4918ea14146bc8657f356a67592ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:41:25 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-3dec3023-ae41-4c27-b09b-773d61c011ca tempest-ServerActionsTestOtherA-938259275 None] Creating volume c48c586e-d272-43f1-8ab3-c839e2d4a81e {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:41:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3dec3023-ae41-4c27-b09b-773d61c011ca tempest-ServerActionsTestOtherA-938259275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:41:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3dec3023-ae41-4c27-b09b-773d61c011ca tempest-ServerActionsTestOtherA-938259275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:41:25 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-3dec3023-ae41-4c27-b09b-773d61c011ca tempest-ServerActionsTestOtherA-938259275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:41:25 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-3dec3023-ae41-4c27-b09b-773d61c011ca tempest-ServerActionsTestOtherA-938259275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:41:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3dec3023-ae41-4c27-b09b-773d61c011ca tempest-ServerActionsTestOtherA-938259275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:41:25 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-3dec3023-ae41-4c27-b09b-773d61c011ca tempest-ServerActionsTestOtherA-938259275 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:41:25 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-3dec3023-ae41-4c27-b09b-773d61c011ca tempest-ServerActionsTestOtherA-938259275 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:41:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3dec3023-ae41-4c27-b09b-773d61c011ca tempest-ServerActionsTestOtherA-938259275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c48c586e-d272-43f1-8ab3-c839e2d4a81e 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:41:25 devstack sudo[91743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c48c586e-d272-43f1-8ab3-c839e2d4a81e 1073741824 Jul 31 10:41:25 devstack sudo[91743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:41:26 devstack sudo[91743]: pam_unix(sudo:session): session closed for user root Jul 31 10:41:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3dec3023-ae41-4c27-b09b-773d61c011ca tempest-ServerActionsTestOtherA-938259275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c48c586e-d272-43f1-8ab3-c839e2d4a81e 1073741824" returned: 0 in 0.693s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:41:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3dec3023-ae41-4c27-b09b-773d61c011ca tempest-ServerActionsTestOtherA-938259275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c48c586e-d272-43f1-8ab3-c839e2d4a81e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:41:26 devstack sudo[91749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c48c586e-d272-43f1-8ab3-c839e2d4a81e Jul 31 10:41:26 devstack sudo[91749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:41:26 devstack sudo[91749]: pam_unix(sudo:session): session closed for user root Jul 31 10:41:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3dec3023-ae41-4c27-b09b-773d61c011ca tempest-ServerActionsTestOtherA-938259275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c48c586e-d272-43f1-8ab3-c839e2d4a81e" returned: 0 in 0.400s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:41:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-3dec3023-ae41-4c27-b09b-773d61c011ca tempest-ServerActionsTestOtherA-938259275 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:41:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3dec3023-ae41-4c27-b09b-773d61c011ca tempest-ServerActionsTestOtherA-938259275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:41:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3dec3023-ae41-4c27-b09b-773d61c011ca tempest-ServerActionsTestOtherA-938259275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72309c6b-1afd-4408-a063-c2dfe73769ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c48c586e-d272-43f1-8ab3-c839e2d4a81e', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:41:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3dec3023-ae41-4c27-b09b-773d61c011ca tempest-ServerActionsTestOtherA-938259275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc035a30-0e2b-4441-afea-c490b439665d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:41:26 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-3dec3023-ae41-4c27-b09b-773d61c011ca tempest-ServerActionsTestOtherA-938259275 None] Volume volume-c48c586e-d272-43f1-8ab3-c839e2d4a81e (c48c586e-d272-43f1-8ab3-c839e2d4a81e): created successfully Jul 31 10:41:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3dec3023-ae41-4c27-b09b-773d61c011ca tempest-ServerActionsTestOtherA-938259275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc035a30-0e2b-4441-afea-c490b439665d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:41:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3dec3023-ae41-4c27-b09b-773d61c011ca tempest-ServerActionsTestOtherA-938259275 None] Flow 'volume_create_manager' (3f8dbaa2-019e-488f-8b87-6a9f81ac6ecb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:41:26 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-3dec3023-ae41-4c27-b09b-773d61c011ca tempest-ServerActionsTestOtherA-938259275 None] Created volume successfully. Jul 31 10:41:27 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd69f829-26d7-41fa-9a48-e97829674a31 tempest-AttachVolumeNegativeTest-304126598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:41:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fd69f829-26d7-41fa-9a48-e97829674a31 tempest-AttachVolumeNegativeTest-304126598 None] Flow 'volume_create_manager' (104bc79d-e87a-4b9f-8f18-48bff506c13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:41:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fd69f829-26d7-41fa-9a48-e97829674a31 tempest-AttachVolumeNegativeTest-304126598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4e1aedb-d3fe-4fcd-8f56-4dc6645010a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:41:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fd69f829-26d7-41fa-9a48-e97829674a31 tempest-AttachVolumeNegativeTest-304126598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4e1aedb-d3fe-4fcd-8f56-4dc6645010a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1957849528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6215dc6d-f1fe-4cea-b931-ba2fca1e70fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='150270d988f34405bc30eabafd7ce55d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:41:27Z,use_quota=True,user_id='060655ab58f94503b45dab890a6c4419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:41:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fd69f829-26d7-41fa-9a48-e97829674a31 tempest-AttachVolumeNegativeTest-304126598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd41802d-ed18-457e-93c1-46b0c2a1c5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:41:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fd69f829-26d7-41fa-9a48-e97829674a31 tempest-AttachVolumeNegativeTest-304126598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd41802d-ed18-457e-93c1-46b0c2a1c5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:41:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fd69f829-26d7-41fa-9a48-e97829674a31 tempest-AttachVolumeNegativeTest-304126598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31cecb58-0764-4108-b6f7-5973516acadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:41:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fd69f829-26d7-41fa-9a48-e97829674a31 tempest-AttachVolumeNegativeTest-304126598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31cecb58-0764-4108-b6f7-5973516acadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6215dc6d-f1fe-4cea-b931-ba2fca1e70fa', 'volume_name': 'volume-6215dc6d-f1fe-4cea-b931-ba2fca1e70fa', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:41:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fd69f829-26d7-41fa-9a48-e97829674a31 tempest-AttachVolumeNegativeTest-304126598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e6f2083-ff54-405b-9055-4108d7cdecb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:41:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fd69f829-26d7-41fa-9a48-e97829674a31 tempest-AttachVolumeNegativeTest-304126598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e6f2083-ff54-405b-9055-4108d7cdecb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:41:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fd69f829-26d7-41fa-9a48-e97829674a31 tempest-AttachVolumeNegativeTest-304126598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (581bedf7-9156-4b4e-b8cc-90325d3ad9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:41:27 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-fd69f829-26d7-41fa-9a48-e97829674a31 tempest-AttachVolumeNegativeTest-304126598 None] Volume 6215dc6d-f1fe-4cea-b931-ba2fca1e70fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6215dc6d-f1fe-4cea-b931-ba2fca1e70fa', 'volume_size': 1} Jul 31 10:41:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-fd69f829-26d7-41fa-9a48-e97829674a31 tempest-AttachVolumeNegativeTest-304126598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:41:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-fd69f829-26d7-41fa-9a48-e97829674a31 tempest-AttachVolumeNegativeTest-304126598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:41:27 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-fd69f829-26d7-41fa-9a48-e97829674a31 tempest-AttachVolumeNegativeTest-304126598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1957849528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6215dc6d-f1fe-4cea-b931-ba2fca1e70fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='150270d988f34405bc30eabafd7ce55d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:41:27Z,use_quota=True,user_id='060655ab58f94503b45dab890a6c4419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:41:27 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-fd69f829-26d7-41fa-9a48-e97829674a31 tempest-AttachVolumeNegativeTest-304126598 None] Creating volume 6215dc6d-f1fe-4cea-b931-ba2fca1e70fa {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:41:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-fd69f829-26d7-41fa-9a48-e97829674a31 tempest-AttachVolumeNegativeTest-304126598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:41:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-fd69f829-26d7-41fa-9a48-e97829674a31 tempest-AttachVolumeNegativeTest-304126598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:41:27 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-fd69f829-26d7-41fa-9a48-e97829674a31 tempest-AttachVolumeNegativeTest-304126598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:41:27 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-fd69f829-26d7-41fa-9a48-e97829674a31 tempest-AttachVolumeNegativeTest-304126598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:41:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-fd69f829-26d7-41fa-9a48-e97829674a31 tempest-AttachVolumeNegativeTest-304126598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:41:27 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-fd69f829-26d7-41fa-9a48-e97829674a31 tempest-AttachVolumeNegativeTest-304126598 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:41:27 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-fd69f829-26d7-41fa-9a48-e97829674a31 tempest-AttachVolumeNegativeTest-304126598 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:41:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fd69f829-26d7-41fa-9a48-e97829674a31 tempest-AttachVolumeNegativeTest-304126598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6215dc6d-f1fe-4cea-b931-ba2fca1e70fa 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:41:27 devstack sudo[91755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6215dc6d-f1fe-4cea-b931-ba2fca1e70fa 1073741824 Jul 31 10:41:27 devstack sudo[91755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:41:28 devstack sudo[91755]: pam_unix(sudo:session): session closed for user root Jul 31 10:41:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fd69f829-26d7-41fa-9a48-e97829674a31 tempest-AttachVolumeNegativeTest-304126598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6215dc6d-f1fe-4cea-b931-ba2fca1e70fa 1073741824" returned: 0 in 0.807s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:41:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fd69f829-26d7-41fa-9a48-e97829674a31 tempest-AttachVolumeNegativeTest-304126598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6215dc6d-f1fe-4cea-b931-ba2fca1e70fa {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:41:28 devstack sudo[91761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6215dc6d-f1fe-4cea-b931-ba2fca1e70fa Jul 31 10:41:28 devstack sudo[91761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:41:28 devstack sudo[91761]: pam_unix(sudo:session): session closed for user root Jul 31 10:41:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fd69f829-26d7-41fa-9a48-e97829674a31 tempest-AttachVolumeNegativeTest-304126598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6215dc6d-f1fe-4cea-b931-ba2fca1e70fa" returned: 0 in 0.311s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:41:28 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-fd69f829-26d7-41fa-9a48-e97829674a31 tempest-AttachVolumeNegativeTest-304126598 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:41:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-fd69f829-26d7-41fa-9a48-e97829674a31 tempest-AttachVolumeNegativeTest-304126598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:41:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fd69f829-26d7-41fa-9a48-e97829674a31 tempest-AttachVolumeNegativeTest-304126598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (581bedf7-9156-4b4e-b8cc-90325d3ad9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6215dc6d-f1fe-4cea-b931-ba2fca1e70fa', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:41:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fd69f829-26d7-41fa-9a48-e97829674a31 tempest-AttachVolumeNegativeTest-304126598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21156cd7-4665-40d6-8fc5-379004cb3ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:41:28 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-fd69f829-26d7-41fa-9a48-e97829674a31 tempest-AttachVolumeNegativeTest-304126598 None] Volume volume-6215dc6d-f1fe-4cea-b931-ba2fca1e70fa (6215dc6d-f1fe-4cea-b931-ba2fca1e70fa): created successfully Jul 31 10:41:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fd69f829-26d7-41fa-9a48-e97829674a31 tempest-AttachVolumeNegativeTest-304126598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21156cd7-4665-40d6-8fc5-379004cb3ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:41:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fd69f829-26d7-41fa-9a48-e97829674a31 tempest-AttachVolumeNegativeTest-304126598 None] Flow 'volume_create_manager' (104bc79d-e87a-4b9f-8f18-48bff506c13d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:41:28 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-fd69f829-26d7-41fa-9a48-e97829674a31 tempest-AttachVolumeNegativeTest-304126598 None] Created volume successfully. Jul 31 10:41:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-1284cca9-680d-40b9-bd88-af21930684bd req-08ff4e95-de78-40d2-bd4e-526795ad74ca tempest-AttachVolumeNegativeTest-304126598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:41:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-1284cca9-680d-40b9-bd88-af21930684bd req-08ff4e95-de78-40d2-bd4e-526795ad74ca tempest-AttachVolumeNegativeTest-304126598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:41:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-1284cca9-680d-40b9-bd88-af21930684bd req-08ff4e95-de78-40d2-bd4e-526795ad74ca tempest-AttachVolumeNegativeTest-304126598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:41:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-1284cca9-680d-40b9-bd88-af21930684bd req-08ff4e95-de78-40d2-bd4e-526795ad74ca tempest-AttachVolumeNegativeTest-304126598 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c', 'name': 'volume-6215dc6d-f1fe-4cea-b931-ba2fca1e70fa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bb6cf4e4-1439-4709-87b0-139645a58729', 'enforce_multipath': True} {{(pid=89090) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:41:31 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-1284cca9-680d-40b9-bd88-af21930684bd req-08ff4e95-de78-40d2-bd4e-526795ad74ca tempest-AttachVolumeNegativeTest-304126598 None] attachment_update completed successfully. Jul 31 10:41:41 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:UPDATE=7,cinder:SELECT=10,cinder:INSERT=1,cinder:DELETE=1 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:41:41 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=11,cinder:UPDATE=8,cinder:INSERT=1,cinder:DELETE=1 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:41:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-f07e87c6-1961-4d1a-9763-fb009cc51ec0 req-39d59913-6110-4973-8a3c-b462f7bd2ea4 tempest-TaggedAttachmentsTest-336293518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:41:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-f07e87c6-1961-4d1a-9763-fb009cc51ec0 req-39d59913-6110-4973-8a3c-b462f7bd2ea4 tempest-TaggedAttachmentsTest-336293518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:41:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-f07e87c6-1961-4d1a-9763-fb009cc51ec0 req-39d59913-6110-4973-8a3c-b462f7bd2ea4 tempest-TaggedAttachmentsTest-336293518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:41:44 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-f07e87c6-1961-4d1a-9763-fb009cc51ec0 req-39d59913-6110-4973-8a3c-b462f7bd2ea4 tempest-TaggedAttachmentsTest-336293518 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c', 'name': 'volume-88f09009-11ce-4390-ae9a-bcc7833a7829', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8694f5b6-e76e-4fa3-b357-455f88a79e4f', 'enforce_multipath': True} {{(pid=89090) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:41:44 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-f07e87c6-1961-4d1a-9763-fb009cc51ec0 req-39d59913-6110-4973-8a3c-b462f7bd2ea4 tempest-TaggedAttachmentsTest-336293518 None] attachment_update completed successfully. Jul 31 10:41:45 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:41:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:41:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:41:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:41:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:41:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:41:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:41:45 devstack sudo[92356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:41:45 devstack sudo[92356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:41:46 devstack sudo[92356]: pam_unix(sudo:session): session closed for user root Jul 31 10:41:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.742s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:41:46 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:41:50 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-8056af80-d54c-45db-8905-e28e10f31bcd req-4dfdfe3e-beaa-4c82-9706-147161bafcb4 tempest-TaggedAttachmentsTest-336293518 None] Terminate volume connection completed successfully. Jul 31 10:41:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-8056af80-d54c-45db-8905-e28e10f31bcd req-4dfdfe3e-beaa-4c82-9706-147161bafcb4 tempest-TaggedAttachmentsTest-336293518 None] Deleting attachment 8694f5b6-e76e-4fa3-b357-455f88a79e4f. {{(pid=89090) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:42:09 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=8 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:42:09 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:42:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f942894a-c2c2-4366-a674-27dce24fd078 tempest-TaggedAttachmentsTest-336293518 None] Acquiring lock "cinder-88f09009-11ce-4390-ae9a-bcc7833a7829-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:42:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f942894a-c2c2-4366-a674-27dce24fd078 tempest-TaggedAttachmentsTest-336293518 None] Lock "cinder-88f09009-11ce-4390-ae9a-bcc7833a7829-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:42:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f942894a-c2c2-4366-a674-27dce24fd078 tempest-TaggedAttachmentsTest-336293518 None] Acquiring lock "cinder-quobyte-88f09009-11ce-4390-ae9a-bcc7833a7829" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:42:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f942894a-c2c2-4366-a674-27dce24fd078 tempest-TaggedAttachmentsTest-336293518 None] Lock "cinder-quobyte-88f09009-11ce-4390-ae9a-bcc7833a7829" acquired by "delete_volume" :: waited 0.022s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:42:10 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[431d87ea-7d69-457d-8bfb-e241c770bee8]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:42:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f942894a-c2c2-4366-a674-27dce24fd078 tempest-TaggedAttachmentsTest-336293518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-88f09009-11ce-4390-ae9a-bcc7833a7829 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:42:10 devstack sudo[92738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-88f09009-11ce-4390-ae9a-bcc7833a7829 Jul 31 10:42:10 devstack sudo[92738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:42:11 devstack sudo[92738]: pam_unix(sudo:session): session closed for user root Jul 31 10:42:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f942894a-c2c2-4366-a674-27dce24fd078 tempest-TaggedAttachmentsTest-336293518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-88f09009-11ce-4390-ae9a-bcc7833a7829" returned: 0 in 0.541s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:42:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f942894a-c2c2-4366-a674-27dce24fd078 tempest-TaggedAttachmentsTest-336293518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-88f09009-11ce-4390-ae9a-bcc7833a7829 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:42:11 devstack sudo[92747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-88f09009-11ce-4390-ae9a-bcc7833a7829 Jul 31 10:42:11 devstack sudo[92747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:42:11 devstack sudo[92747]: pam_unix(sudo:session): session closed for user root Jul 31 10:42:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f942894a-c2c2-4366-a674-27dce24fd078 tempest-TaggedAttachmentsTest-336293518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-88f09009-11ce-4390-ae9a-bcc7833a7829" returned: 0 in 0.452s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:42:11 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f942894a-c2c2-4366-a674-27dce24fd078 tempest-TaggedAttachmentsTest-336293518 None] Lock "cinder-quobyte-88f09009-11ce-4390-ae9a-bcc7833a7829" released by "delete_volume" :: held 1.088s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:42:11 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-f942894a-c2c2-4366-a674-27dce24fd078 tempest-TaggedAttachmentsTest-336293518 None] Created reservations ['18e8ae7f-2263-4839-a380-03548dd840cf', '37851aaa-9622-4a13-ad6b-736d565fcb75', 'cc8f4fb8-d825-4032-a34e-d69ffbb43ee4', '7bfb817b-5fc7-452f-9c5d-925af31f4788'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:42:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f942894a-c2c2-4366-a674-27dce24fd078 tempest-TaggedAttachmentsTest-336293518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:42:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f942894a-c2c2-4366-a674-27dce24fd078 tempest-TaggedAttachmentsTest-336293518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:42:11 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f942894a-c2c2-4366-a674-27dce24fd078 tempest-TaggedAttachmentsTest-336293518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:42:11 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f942894a-c2c2-4366-a674-27dce24fd078 tempest-TaggedAttachmentsTest-336293518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:42:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f942894a-c2c2-4366-a674-27dce24fd078 tempest-TaggedAttachmentsTest-336293518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:42:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f942894a-c2c2-4366-a674-27dce24fd078 tempest-TaggedAttachmentsTest-336293518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:42:12 devstack sudo[92750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:42:12 devstack sudo[92750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:42:12 devstack sudo[92750]: pam_unix(sudo:session): session closed for user root Jul 31 10:42:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f942894a-c2c2-4366-a674-27dce24fd078 tempest-TaggedAttachmentsTest-336293518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.528s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:42:12 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-f942894a-c2c2-4366-a674-27dce24fd078 tempest-TaggedAttachmentsTest-336293518 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:42:12 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-f942894a-c2c2-4366-a674-27dce24fd078 tempest-TaggedAttachmentsTest-336293518 None] Deleted volume successfully. Jul 31 10:42:12 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f942894a-c2c2-4366-a674-27dce24fd078 tempest-TaggedAttachmentsTest-336293518 None] Lock "cinder-88f09009-11ce-4390-ae9a-bcc7833a7829-delete_volume" released by "delete_volume" :: held 2.076s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:42:13 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-15e6e149-814b-4a19-8aa0-c847c3d9f2dd tempest-VolumesActionsTest-873482576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:42:13 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-15e6e149-814b-4a19-8aa0-c847c3d9f2dd tempest-VolumesActionsTest-873482576 None] Flow 'volume_create_manager' (aea1844b-6384-4402-b7bd-1d0c50fa8c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:42:13 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-15e6e149-814b-4a19-8aa0-c847c3d9f2dd tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (389c1fd0-6b83-4ff8-9dc4-c95dd8af4fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:42:13 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-15e6e149-814b-4a19-8aa0-c847c3d9f2dd tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (389c1fd0-6b83-4ff8-9dc4-c95dd8af4fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:42:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1193766358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76a45c9c-fcf2-45c3-aa69-a8f64437a309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c190045006f4da39810561dbc9e76c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:42:13Z,use_quota=True,user_id='8fe545517a0b473ebe0e02c34664fbec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:42:13 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-15e6e149-814b-4a19-8aa0-c847c3d9f2dd tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d39df1-67e7-4b3b-aded-cc69308a50e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:42:13 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-15e6e149-814b-4a19-8aa0-c847c3d9f2dd tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d39df1-67e7-4b3b-aded-cc69308a50e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:42:13 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-15e6e149-814b-4a19-8aa0-c847c3d9f2dd tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dec6438-8809-4dd8-8091-638322d8d5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:42:13 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-15e6e149-814b-4a19-8aa0-c847c3d9f2dd tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dec6438-8809-4dd8-8091-638322d8d5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76a45c9c-fcf2-45c3-aa69-a8f64437a309', 'volume_name': 'volume-76a45c9c-fcf2-45c3-aa69-a8f64437a309', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:42:13 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-15e6e149-814b-4a19-8aa0-c847c3d9f2dd tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1079a332-3024-4cde-a136-48dc06157783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:42:13 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-15e6e149-814b-4a19-8aa0-c847c3d9f2dd tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1079a332-3024-4cde-a136-48dc06157783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:42:13 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-15e6e149-814b-4a19-8aa0-c847c3d9f2dd tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3321522-9905-4abf-826c-5531185ca8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:42:13 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-15e6e149-814b-4a19-8aa0-c847c3d9f2dd tempest-VolumesActionsTest-873482576 None] Volume 76a45c9c-fcf2-45c3-aa69-a8f64437a309: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76a45c9c-fcf2-45c3-aa69-a8f64437a309', 'volume_size': 1} Jul 31 10:42:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-15e6e149-814b-4a19-8aa0-c847c3d9f2dd tempest-VolumesActionsTest-873482576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:42:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-15e6e149-814b-4a19-8aa0-c847c3d9f2dd tempest-VolumesActionsTest-873482576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:42:13 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-15e6e149-814b-4a19-8aa0-c847c3d9f2dd tempest-VolumesActionsTest-873482576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:42:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1193766358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76a45c9c-fcf2-45c3-aa69-a8f64437a309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c190045006f4da39810561dbc9e76c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:42:13Z,use_quota=True,user_id='8fe545517a0b473ebe0e02c34664fbec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:42:13 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-15e6e149-814b-4a19-8aa0-c847c3d9f2dd tempest-VolumesActionsTest-873482576 None] Creating volume 76a45c9c-fcf2-45c3-aa69-a8f64437a309 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:42:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-15e6e149-814b-4a19-8aa0-c847c3d9f2dd tempest-VolumesActionsTest-873482576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:42:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-15e6e149-814b-4a19-8aa0-c847c3d9f2dd tempest-VolumesActionsTest-873482576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:42:13 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-15e6e149-814b-4a19-8aa0-c847c3d9f2dd tempest-VolumesActionsTest-873482576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:42:13 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-15e6e149-814b-4a19-8aa0-c847c3d9f2dd tempest-VolumesActionsTest-873482576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:42:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-15e6e149-814b-4a19-8aa0-c847c3d9f2dd tempest-VolumesActionsTest-873482576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:42:13 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-15e6e149-814b-4a19-8aa0-c847c3d9f2dd tempest-VolumesActionsTest-873482576 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:42:13 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-15e6e149-814b-4a19-8aa0-c847c3d9f2dd tempest-VolumesActionsTest-873482576 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:42:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-15e6e149-814b-4a19-8aa0-c847c3d9f2dd tempest-VolumesActionsTest-873482576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-76a45c9c-fcf2-45c3-aa69-a8f64437a309 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:42:13 devstack sudo[92796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-76a45c9c-fcf2-45c3-aa69-a8f64437a309 1073741824 Jul 31 10:42:13 devstack sudo[92796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:42:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-4f25bbcb-0aef-408c-a0fe-8c5a6318ae4c req-baff3b4c-7ad1-41fc-9192-882ebc1507fe tempest-ServerActionsTestOtherA-938259275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:42:14 devstack sudo[92796]: pam_unix(sudo:session): session closed for user root Jul 31 10:42:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-15e6e149-814b-4a19-8aa0-c847c3d9f2dd tempest-VolumesActionsTest-873482576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-76a45c9c-fcf2-45c3-aa69-a8f64437a309 1073741824" returned: 0 in 0.860s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:42:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-15e6e149-814b-4a19-8aa0-c847c3d9f2dd tempest-VolumesActionsTest-873482576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-76a45c9c-fcf2-45c3-aa69-a8f64437a309 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:42:14 devstack sudo[92811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-76a45c9c-fcf2-45c3-aa69-a8f64437a309 Jul 31 10:42:14 devstack sudo[92811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:42:14 devstack sudo[92811]: pam_unix(sudo:session): session closed for user root Jul 31 10:42:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-15e6e149-814b-4a19-8aa0-c847c3d9f2dd tempest-VolumesActionsTest-873482576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-76a45c9c-fcf2-45c3-aa69-a8f64437a309" returned: 0 in 0.379s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:42:14 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-15e6e149-814b-4a19-8aa0-c847c3d9f2dd tempest-VolumesActionsTest-873482576 None] <== create_volume: return (1312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:42:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-15e6e149-814b-4a19-8aa0-c847c3d9f2dd tempest-VolumesActionsTest-873482576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:42:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-4f25bbcb-0aef-408c-a0fe-8c5a6318ae4c req-baff3b4c-7ad1-41fc-9192-882ebc1507fe tempest-ServerActionsTestOtherA-938259275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.534s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:42:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-15e6e149-814b-4a19-8aa0-c847c3d9f2dd tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3321522-9905-4abf-826c-5531185ca8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76a45c9c-fcf2-45c3-aa69-a8f64437a309', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:42:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-15e6e149-814b-4a19-8aa0-c847c3d9f2dd tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3898e5-93eb-46a2-a0e7-40e671e09e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:42:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-4f25bbcb-0aef-408c-a0fe-8c5a6318ae4c req-baff3b4c-7ad1-41fc-9192-882ebc1507fe tempest-ServerActionsTestOtherA-938259275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:42:14 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-15e6e149-814b-4a19-8aa0-c847c3d9f2dd tempest-VolumesActionsTest-873482576 None] Volume volume-76a45c9c-fcf2-45c3-aa69-a8f64437a309 (76a45c9c-fcf2-45c3-aa69-a8f64437a309): created successfully Jul 31 10:42:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-15e6e149-814b-4a19-8aa0-c847c3d9f2dd tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3898e5-93eb-46a2-a0e7-40e671e09e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:42:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-15e6e149-814b-4a19-8aa0-c847c3d9f2dd tempest-VolumesActionsTest-873482576 None] Flow 'volume_create_manager' (aea1844b-6384-4402-b7bd-1d0c50fa8c04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:42:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-4f25bbcb-0aef-408c-a0fe-8c5a6318ae4c req-baff3b4c-7ad1-41fc-9192-882ebc1507fe tempest-ServerActionsTestOtherA-938259275 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c', 'name': 'volume-c48c586e-d272-43f1-8ab3-c839e2d4a81e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5bef6547-798d-4501-b589-256bf4489d13', 'enforce_multipath': True} {{(pid=89090) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:42:14 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-15e6e149-814b-4a19-8aa0-c847c3d9f2dd tempest-VolumesActionsTest-873482576 None] Created volume successfully. Jul 31 10:42:14 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-4f25bbcb-0aef-408c-a0fe-8c5a6318ae4c req-baff3b4c-7ad1-41fc-9192-882ebc1507fe tempest-ServerActionsTestOtherA-938259275 None] attachment_update completed successfully. Jul 31 10:42:15 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-eb4b7aaf-4337-4f10-b9e6-614499c1c26c tempest-VolumesActionsTest-873482576 None] Acquiring lock "cinder-76a45c9c-fcf2-45c3-aa69-a8f64437a309" by "attach_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:42:15 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-eb4b7aaf-4337-4f10-b9e6-614499c1c26c tempest-VolumesActionsTest-873482576 None] Lock "cinder-76a45c9c-fcf2-45c3-aa69-a8f64437a309" acquired by "attach_volume" :: waited 0.035s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:42:15 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-eb4b7aaf-4337-4f10-b9e6-614499c1c26c tempest-VolumesActionsTest-873482576 None] Attaching volume 76a45c9c-fcf2-45c3-aa69-a8f64437a309 to instance 7bfdd79a-5d2a-419d-b86d-e48734774b48 at mountpoint /dev/vdb on host None. Jul 31 10:42:15 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-eb4b7aaf-4337-4f10-b9e6-614499c1c26c tempest-VolumesActionsTest-873482576 None] Attach volume completed successfully. Jul 31 10:42:15 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-eb4b7aaf-4337-4f10-b9e6-614499c1c26c tempest-VolumesActionsTest-873482576 None] Lock "cinder-76a45c9c-fcf2-45c3-aa69-a8f64437a309" released by "attach_volume" :: held 0.151s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:42:16 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-57d02f07-c5fc-404d-a4e1-d3920b00e80f tempest-VolumesActionsTest-2067764756 None] Terminate volume connection completed successfully. Jul 31 10:42:16 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-57d02f07-c5fc-404d-a4e1-d3920b00e80f tempest-VolumesActionsTest-2067764756 None] Acquiring lock "cinder-76a45c9c-fcf2-45c3-aa69-a8f64437a309-detach_volume" by "detach_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:42:16 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-57d02f07-c5fc-404d-a4e1-d3920b00e80f tempest-VolumesActionsTest-2067764756 None] Lock "cinder-76a45c9c-fcf2-45c3-aa69-a8f64437a309-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:42:16 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-57d02f07-c5fc-404d-a4e1-d3920b00e80f tempest-VolumesActionsTest-2067764756 None] Detaching volume 76a45c9c-fcf2-45c3-aa69-a8f64437a309 from instance 7bfdd79a-5d2a-419d-b86d-e48734774b48. Jul 31 10:42:16 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-57d02f07-c5fc-404d-a4e1-d3920b00e80f tempest-VolumesActionsTest-2067764756 None] Detach volume completed successfully. Jul 31 10:42:16 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-57d02f07-c5fc-404d-a4e1-d3920b00e80f tempest-VolumesActionsTest-2067764756 None] Lock "cinder-76a45c9c-fcf2-45c3-aa69-a8f64437a309-detach_volume" released by "detach_volume" :: held 0.171s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:42:16 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-5ee28c1b-31b7-4cd5-9a80-94179932dac7 tempest-VolumesActionsTest-873482576 None] Acquiring lock "cinder-76a45c9c-fcf2-45c3-aa69-a8f64437a309-detach_volume" by "detach_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:42:16 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-5ee28c1b-31b7-4cd5-9a80-94179932dac7 tempest-VolumesActionsTest-873482576 None] Lock "cinder-76a45c9c-fcf2-45c3-aa69-a8f64437a309-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:42:16 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-5ee28c1b-31b7-4cd5-9a80-94179932dac7 tempest-VolumesActionsTest-873482576 None] Volume detach called, but volume not attached. Jul 31 10:42:17 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-5ee28c1b-31b7-4cd5-9a80-94179932dac7 tempest-VolumesActionsTest-873482576 None] Lock "cinder-76a45c9c-fcf2-45c3-aa69-a8f64437a309-detach_volume" released by "detach_volume" :: held 0.043s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:42:17 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-b95a1c61-b04f-4f80-936d-a4ff94fa5141 tempest-VolumesActionsTest-873482576 None] Acquiring lock "cinder-76a45c9c-fcf2-45c3-aa69-a8f64437a309-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:42:17 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-b95a1c61-b04f-4f80-936d-a4ff94fa5141 tempest-VolumesActionsTest-873482576 None] Lock "cinder-76a45c9c-fcf2-45c3-aa69-a8f64437a309-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:42:17 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-b95a1c61-b04f-4f80-936d-a4ff94fa5141 tempest-VolumesActionsTest-873482576 None] Acquiring lock "cinder-quobyte-76a45c9c-fcf2-45c3-aa69-a8f64437a309" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:42:17 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-b95a1c61-b04f-4f80-936d-a4ff94fa5141 tempest-VolumesActionsTest-873482576 None] Lock "cinder-quobyte-76a45c9c-fcf2-45c3-aa69-a8f64437a309" acquired by "delete_volume" :: waited 0.032s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:42:17 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80bcd1d-e6cf-4a88-8238-5d9ae0479cf3]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:42:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b95a1c61-b04f-4f80-936d-a4ff94fa5141 tempest-VolumesActionsTest-873482576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-76a45c9c-fcf2-45c3-aa69-a8f64437a309 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:42:17 devstack sudo[92826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-76a45c9c-fcf2-45c3-aa69-a8f64437a309 Jul 31 10:42:17 devstack sudo[92826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:42:18 devstack sudo[92826]: pam_unix(sudo:session): session closed for user root Jul 31 10:42:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b95a1c61-b04f-4f80-936d-a4ff94fa5141 tempest-VolumesActionsTest-873482576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-76a45c9c-fcf2-45c3-aa69-a8f64437a309" returned: 0 in 0.762s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:42:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b95a1c61-b04f-4f80-936d-a4ff94fa5141 tempest-VolumesActionsTest-873482576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-76a45c9c-fcf2-45c3-aa69-a8f64437a309 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:42:18 devstack sudo[92834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-76a45c9c-fcf2-45c3-aa69-a8f64437a309 Jul 31 10:42:18 devstack sudo[92834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:42:18 devstack sudo[92834]: pam_unix(sudo:session): session closed for user root Jul 31 10:42:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b95a1c61-b04f-4f80-936d-a4ff94fa5141 tempest-VolumesActionsTest-873482576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-76a45c9c-fcf2-45c3-aa69-a8f64437a309" returned: 0 in 0.335s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:42:18 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-b95a1c61-b04f-4f80-936d-a4ff94fa5141 tempest-VolumesActionsTest-873482576 None] Lock "cinder-quobyte-76a45c9c-fcf2-45c3-aa69-a8f64437a309" released by "delete_volume" :: held 1.164s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:42:18 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-b95a1c61-b04f-4f80-936d-a4ff94fa5141 tempest-VolumesActionsTest-873482576 None] Created reservations ['ce2708d2-d7a9-4345-823e-83607fe2784e', '70e1519c-6855-4b10-9ff5-382133f62eb6', 'f9c80ec5-0d50-424a-b2e0-7c663b5c34f0', '580934e9-1f84-41c7-9425-817516a0b928'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:42:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b95a1c61-b04f-4f80-936d-a4ff94fa5141 tempest-VolumesActionsTest-873482576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:42:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b95a1c61-b04f-4f80-936d-a4ff94fa5141 tempest-VolumesActionsTest-873482576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:42:19 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-b95a1c61-b04f-4f80-936d-a4ff94fa5141 tempest-VolumesActionsTest-873482576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:42:19 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-b95a1c61-b04f-4f80-936d-a4ff94fa5141 tempest-VolumesActionsTest-873482576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:42:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b95a1c61-b04f-4f80-936d-a4ff94fa5141 tempest-VolumesActionsTest-873482576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:42:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b95a1c61-b04f-4f80-936d-a4ff94fa5141 tempest-VolumesActionsTest-873482576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:42:19 devstack sudo[92845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:42:19 devstack sudo[92845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:42:19 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-3b12145d-cac5-4ee8-ad9f-4559a5dc95a6 req-b72441b6-9070-4147-bc33-d576f597dec3 tempest-ServerActionsTestOtherA-938259275 None] Terminate volume connection completed successfully. Jul 31 10:42:19 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-3b12145d-cac5-4ee8-ad9f-4559a5dc95a6 req-b72441b6-9070-4147-bc33-d576f597dec3 tempest-ServerActionsTestOtherA-938259275 None] Deleting attachment 5bef6547-798d-4501-b589-256bf4489d13. {{(pid=89090) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:42:19 devstack sudo[92845]: pam_unix(sudo:session): session closed for user root Jul 31 10:42:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b95a1c61-b04f-4f80-936d-a4ff94fa5141 tempest-VolumesActionsTest-873482576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.508s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:42:19 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-b95a1c61-b04f-4f80-936d-a4ff94fa5141 tempest-VolumesActionsTest-873482576 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:42:19 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-b95a1c61-b04f-4f80-936d-a4ff94fa5141 tempest-VolumesActionsTest-873482576 None] Deleted volume successfully. Jul 31 10:42:19 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-b95a1c61-b04f-4f80-936d-a4ff94fa5141 tempest-VolumesActionsTest-873482576 None] Lock "cinder-76a45c9c-fcf2-45c3-aa69-a8f64437a309-delete_volume" released by "delete_volume" :: held 2.110s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:42:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-3b12145d-cac5-4ee8-ad9f-4559a5dc95a6 req-a7e29940-f4cd-4711-831f-1b7878725739 tempest-ServerActionsTestOtherA-938259275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:42:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-3b12145d-cac5-4ee8-ad9f-4559a5dc95a6 req-a7e29940-f4cd-4711-831f-1b7878725739 tempest-ServerActionsTestOtherA-938259275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:42:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-3b12145d-cac5-4ee8-ad9f-4559a5dc95a6 req-a7e29940-f4cd-4711-831f-1b7878725739 tempest-ServerActionsTestOtherA-938259275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:42:21 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-3b12145d-cac5-4ee8-ad9f-4559a5dc95a6 req-a7e29940-f4cd-4711-831f-1b7878725739 tempest-ServerActionsTestOtherA-938259275 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c', 'name': 'volume-c48c586e-d272-43f1-8ab3-c839e2d4a81e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c33ff2ea-e61f-4a23-8d38-4a0e0a26ee36', 'enforce_multipath': True} {{(pid=89090) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:42:21 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-3b12145d-cac5-4ee8-ad9f-4559a5dc95a6 req-a7e29940-f4cd-4711-831f-1b7878725739 tempest-ServerActionsTestOtherA-938259275 None] attachment_update completed successfully. Jul 31 10:42:26 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5ee04db-5793-4771-b118-01cbafad4593 tempest-VolumesActionsTest-873482576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:42:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f5ee04db-5793-4771-b118-01cbafad4593 tempest-VolumesActionsTest-873482576 None] Flow 'volume_create_manager' (392db8bf-cdc9-4193-b696-a9f0e1a25451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:42:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f5ee04db-5793-4771-b118-01cbafad4593 tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e26944-0b48-475f-896d-e4d082933612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:42:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f5ee04db-5793-4771-b118-01cbafad4593 tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e26944-0b48-475f-896d-e4d082933612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1873390834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e874b352-f7d9-4b70-8d50-e363c235d188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c190045006f4da39810561dbc9e76c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:42:26Z,use_quota=True,user_id='8fe545517a0b473ebe0e02c34664fbec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:42:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f5ee04db-5793-4771-b118-01cbafad4593 tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0426e83b-3ede-460d-bee3-c274e97e35bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:42:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f5ee04db-5793-4771-b118-01cbafad4593 tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0426e83b-3ede-460d-bee3-c274e97e35bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:42:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f5ee04db-5793-4771-b118-01cbafad4593 tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40d1a313-7689-42b4-aa3a-20adda4edec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:42:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f5ee04db-5793-4771-b118-01cbafad4593 tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40d1a313-7689-42b4-aa3a-20adda4edec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e874b352-f7d9-4b70-8d50-e363c235d188', 'volume_name': 'volume-e874b352-f7d9-4b70-8d50-e363c235d188', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:42:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f5ee04db-5793-4771-b118-01cbafad4593 tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (250cec09-30b7-479d-950b-2049c08c8a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:42:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f5ee04db-5793-4771-b118-01cbafad4593 tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (250cec09-30b7-479d-950b-2049c08c8a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:42:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f5ee04db-5793-4771-b118-01cbafad4593 tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea90dd3e-9ee3-4d5c-ab72-ec5bce9544ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:42:26 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-f5ee04db-5793-4771-b118-01cbafad4593 tempest-VolumesActionsTest-873482576 None] Volume e874b352-f7d9-4b70-8d50-e363c235d188: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e874b352-f7d9-4b70-8d50-e363c235d188', 'volume_size': 1} Jul 31 10:42:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f5ee04db-5793-4771-b118-01cbafad4593 tempest-VolumesActionsTest-873482576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:42:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f5ee04db-5793-4771-b118-01cbafad4593 tempest-VolumesActionsTest-873482576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:42:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f5ee04db-5793-4771-b118-01cbafad4593 tempest-VolumesActionsTest-873482576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1873390834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e874b352-f7d9-4b70-8d50-e363c235d188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c190045006f4da39810561dbc9e76c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:42:26Z,use_quota=True,user_id='8fe545517a0b473ebe0e02c34664fbec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:42:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-f5ee04db-5793-4771-b118-01cbafad4593 tempest-VolumesActionsTest-873482576 None] Creating volume e874b352-f7d9-4b70-8d50-e363c235d188 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:42:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f5ee04db-5793-4771-b118-01cbafad4593 tempest-VolumesActionsTest-873482576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:42:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f5ee04db-5793-4771-b118-01cbafad4593 tempest-VolumesActionsTest-873482576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:42:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f5ee04db-5793-4771-b118-01cbafad4593 tempest-VolumesActionsTest-873482576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:42:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f5ee04db-5793-4771-b118-01cbafad4593 tempest-VolumesActionsTest-873482576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:42:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f5ee04db-5793-4771-b118-01cbafad4593 tempest-VolumesActionsTest-873482576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:42:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f5ee04db-5793-4771-b118-01cbafad4593 tempest-VolumesActionsTest-873482576 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:42:26 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-f5ee04db-5793-4771-b118-01cbafad4593 tempest-VolumesActionsTest-873482576 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:42:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f5ee04db-5793-4771-b118-01cbafad4593 tempest-VolumesActionsTest-873482576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e874b352-f7d9-4b70-8d50-e363c235d188 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:42:26 devstack sudo[92989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e874b352-f7d9-4b70-8d50-e363c235d188 1073741824 Jul 31 10:42:26 devstack sudo[92989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:42:28 devstack sudo[92989]: pam_unix(sudo:session): session closed for user root Jul 31 10:42:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f5ee04db-5793-4771-b118-01cbafad4593 tempest-VolumesActionsTest-873482576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e874b352-f7d9-4b70-8d50-e363c235d188 1073741824" returned: 0 in 1.626s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:42:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f5ee04db-5793-4771-b118-01cbafad4593 tempest-VolumesActionsTest-873482576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e874b352-f7d9-4b70-8d50-e363c235d188 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:42:28 devstack sudo[93022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e874b352-f7d9-4b70-8d50-e363c235d188 Jul 31 10:42:28 devstack sudo[93022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:42:28 devstack sudo[93022]: pam_unix(sudo:session): session closed for user root Jul 31 10:42:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f5ee04db-5793-4771-b118-01cbafad4593 tempest-VolumesActionsTest-873482576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e874b352-f7d9-4b70-8d50-e363c235d188" returned: 0 in 0.520s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:42:28 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f5ee04db-5793-4771-b118-01cbafad4593 tempest-VolumesActionsTest-873482576 None] <== create_volume: return (2246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:42:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f5ee04db-5793-4771-b118-01cbafad4593 tempest-VolumesActionsTest-873482576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.256s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:42:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f5ee04db-5793-4771-b118-01cbafad4593 tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea90dd3e-9ee3-4d5c-ab72-ec5bce9544ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e874b352-f7d9-4b70-8d50-e363c235d188', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:42:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f5ee04db-5793-4771-b118-01cbafad4593 tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19255bd0-9773-496a-ba58-06ae134a0760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:42:28 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-f5ee04db-5793-4771-b118-01cbafad4593 tempest-VolumesActionsTest-873482576 None] Volume volume-e874b352-f7d9-4b70-8d50-e363c235d188 (e874b352-f7d9-4b70-8d50-e363c235d188): created successfully Jul 31 10:42:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f5ee04db-5793-4771-b118-01cbafad4593 tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19255bd0-9773-496a-ba58-06ae134a0760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:42:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f5ee04db-5793-4771-b118-01cbafad4593 tempest-VolumesActionsTest-873482576 None] Flow 'volume_create_manager' (392db8bf-cdc9-4193-b696-a9f0e1a25451) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:42:28 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-f5ee04db-5793-4771-b118-01cbafad4593 tempest-VolumesActionsTest-873482576 None] Created volume successfully. Jul 31 10:42:30 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-14b43038-ef65-48f7-b832-243b52d61508 tempest-VolumesActionsTest-2067764756 None] Acquiring lock "cinder-e874b352-f7d9-4b70-8d50-e363c235d188-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:42:30 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-14b43038-ef65-48f7-b832-243b52d61508 tempest-VolumesActionsTest-2067764756 None] Lock "cinder-e874b352-f7d9-4b70-8d50-e363c235d188-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:42:30 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-14b43038-ef65-48f7-b832-243b52d61508 tempest-VolumesActionsTest-2067764756 None] Acquiring lock "cinder-quobyte-e874b352-f7d9-4b70-8d50-e363c235d188" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:42:30 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-14b43038-ef65-48f7-b832-243b52d61508 tempest-VolumesActionsTest-2067764756 None] Lock "cinder-quobyte-e874b352-f7d9-4b70-8d50-e363c235d188" acquired by "delete_volume" :: waited 0.028s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:42:30 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4e7aae-e0d7-4096-ab0f-18819b765956]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:42:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-14b43038-ef65-48f7-b832-243b52d61508 tempest-VolumesActionsTest-2067764756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e874b352-f7d9-4b70-8d50-e363c235d188 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:42:30 devstack sudo[93030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e874b352-f7d9-4b70-8d50-e363c235d188 Jul 31 10:42:30 devstack sudo[93030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:42:30 devstack sudo[93030]: pam_unix(sudo:session): session closed for user root Jul 31 10:42:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-14b43038-ef65-48f7-b832-243b52d61508 tempest-VolumesActionsTest-2067764756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e874b352-f7d9-4b70-8d50-e363c235d188" returned: 0 in 0.635s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:42:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-14b43038-ef65-48f7-b832-243b52d61508 tempest-VolumesActionsTest-2067764756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e874b352-f7d9-4b70-8d50-e363c235d188 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:42:30 devstack sudo[93037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e874b352-f7d9-4b70-8d50-e363c235d188 Jul 31 10:42:30 devstack sudo[93037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:42:31 devstack sudo[93037]: pam_unix(sudo:session): session closed for user root Jul 31 10:42:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-14b43038-ef65-48f7-b832-243b52d61508 tempest-VolumesActionsTest-2067764756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e874b352-f7d9-4b70-8d50-e363c235d188" returned: 0 in 0.276s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:42:31 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-14b43038-ef65-48f7-b832-243b52d61508 tempest-VolumesActionsTest-2067764756 None] Lock "cinder-quobyte-e874b352-f7d9-4b70-8d50-e363c235d188" released by "delete_volume" :: held 0.988s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:42:31 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-14b43038-ef65-48f7-b832-243b52d61508 tempest-VolumesActionsTest-2067764756 None] Created reservations ['8d8c425d-c781-4f8c-b09b-b68a73228657', '74b7e81b-89a2-40fa-93ad-2a396becf49e', '8c93bd5c-88d3-428b-a535-adfa0aa0bf59', '73107773-7fcb-4b04-aae5-91a84522e80a'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:42:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-14b43038-ef65-48f7-b832-243b52d61508 tempest-VolumesActionsTest-2067764756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:42:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-14b43038-ef65-48f7-b832-243b52d61508 tempest-VolumesActionsTest-2067764756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:42:31 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-14b43038-ef65-48f7-b832-243b52d61508 tempest-VolumesActionsTest-2067764756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:42:31 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-14b43038-ef65-48f7-b832-243b52d61508 tempest-VolumesActionsTest-2067764756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:42:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-14b43038-ef65-48f7-b832-243b52d61508 tempest-VolumesActionsTest-2067764756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:42:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-14b43038-ef65-48f7-b832-243b52d61508 tempest-VolumesActionsTest-2067764756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:42:31 devstack sudo[93040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:42:31 devstack sudo[93040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:42:31 devstack sudo[93040]: pam_unix(sudo:session): session closed for user root Jul 31 10:42:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-14b43038-ef65-48f7-b832-243b52d61508 tempest-VolumesActionsTest-2067764756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.277s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:42:31 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-14b43038-ef65-48f7-b832-243b52d61508 tempest-VolumesActionsTest-2067764756 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:42:31 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-14b43038-ef65-48f7-b832-243b52d61508 tempest-VolumesActionsTest-2067764756 None] Deleted volume successfully. Jul 31 10:42:31 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-14b43038-ef65-48f7-b832-243b52d61508 tempest-VolumesActionsTest-2067764756 None] Lock "cinder-e874b352-f7d9-4b70-8d50-e363c235d188-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:42:33 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-821f531b-ceec-47b2-8f50-ae1d72e0c95a tempest-VolumesActionsTest-873482576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:42:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-821f531b-ceec-47b2-8f50-ae1d72e0c95a tempest-VolumesActionsTest-873482576 None] Flow 'volume_create_manager' (25f90fdc-1032-4070-b786-950001bc3f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:42:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-821f531b-ceec-47b2-8f50-ae1d72e0c95a tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (502ec07c-765a-4980-983d-f62c00b3f18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:42:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-821f531b-ceec-47b2-8f50-ae1d72e0c95a tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (502ec07c-765a-4980-983d-f62c00b3f18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1990071867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38d559c4-b3b1-4a03-bdac-4015b4176325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c190045006f4da39810561dbc9e76c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:42:33Z,use_quota=True,user_id='8fe545517a0b473ebe0e02c34664fbec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:42:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-821f531b-ceec-47b2-8f50-ae1d72e0c95a tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c68b1add-a061-48cc-bd74-9067d869444c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:42:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-821f531b-ceec-47b2-8f50-ae1d72e0c95a tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c68b1add-a061-48cc-bd74-9067d869444c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:42:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-821f531b-ceec-47b2-8f50-ae1d72e0c95a tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c47f4821-8792-4c5d-902b-699a317e8319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:42:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-821f531b-ceec-47b2-8f50-ae1d72e0c95a tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c47f4821-8792-4c5d-902b-699a317e8319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38d559c4-b3b1-4a03-bdac-4015b4176325', 'volume_name': 'volume-38d559c4-b3b1-4a03-bdac-4015b4176325', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:42:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-821f531b-ceec-47b2-8f50-ae1d72e0c95a tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90551879-1f9c-4bd5-83ca-d3dfab76ffd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:42:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-821f531b-ceec-47b2-8f50-ae1d72e0c95a tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90551879-1f9c-4bd5-83ca-d3dfab76ffd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:42:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-821f531b-ceec-47b2-8f50-ae1d72e0c95a tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e77fe88-0708-4eff-a2ac-f6b341cc3368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:42:33 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-821f531b-ceec-47b2-8f50-ae1d72e0c95a tempest-VolumesActionsTest-873482576 None] Volume 38d559c4-b3b1-4a03-bdac-4015b4176325: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38d559c4-b3b1-4a03-bdac-4015b4176325', 'volume_size': 1} Jul 31 10:42:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-821f531b-ceec-47b2-8f50-ae1d72e0c95a tempest-VolumesActionsTest-873482576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:42:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-821f531b-ceec-47b2-8f50-ae1d72e0c95a tempest-VolumesActionsTest-873482576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:42:33 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-821f531b-ceec-47b2-8f50-ae1d72e0c95a tempest-VolumesActionsTest-873482576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1990071867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38d559c4-b3b1-4a03-bdac-4015b4176325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c190045006f4da39810561dbc9e76c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:42:33Z,use_quota=True,user_id='8fe545517a0b473ebe0e02c34664fbec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:42:33 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-821f531b-ceec-47b2-8f50-ae1d72e0c95a tempest-VolumesActionsTest-873482576 None] Creating volume 38d559c4-b3b1-4a03-bdac-4015b4176325 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:42:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-821f531b-ceec-47b2-8f50-ae1d72e0c95a tempest-VolumesActionsTest-873482576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:42:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-821f531b-ceec-47b2-8f50-ae1d72e0c95a tempest-VolumesActionsTest-873482576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:42:33 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-821f531b-ceec-47b2-8f50-ae1d72e0c95a tempest-VolumesActionsTest-873482576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:42:33 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-821f531b-ceec-47b2-8f50-ae1d72e0c95a tempest-VolumesActionsTest-873482576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:42:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-821f531b-ceec-47b2-8f50-ae1d72e0c95a tempest-VolumesActionsTest-873482576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:42:33 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-821f531b-ceec-47b2-8f50-ae1d72e0c95a tempest-VolumesActionsTest-873482576 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:42:33 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-821f531b-ceec-47b2-8f50-ae1d72e0c95a tempest-VolumesActionsTest-873482576 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:42:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-821f531b-ceec-47b2-8f50-ae1d72e0c95a tempest-VolumesActionsTest-873482576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-38d559c4-b3b1-4a03-bdac-4015b4176325 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:42:33 devstack sudo[93043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-38d559c4-b3b1-4a03-bdac-4015b4176325 1073741824 Jul 31 10:42:33 devstack sudo[93043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:42:34 devstack sudo[93043]: pam_unix(sudo:session): session closed for user root Jul 31 10:42:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-821f531b-ceec-47b2-8f50-ae1d72e0c95a tempest-VolumesActionsTest-873482576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-38d559c4-b3b1-4a03-bdac-4015b4176325 1073741824" returned: 0 in 0.756s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:42:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-821f531b-ceec-47b2-8f50-ae1d72e0c95a tempest-VolumesActionsTest-873482576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-38d559c4-b3b1-4a03-bdac-4015b4176325 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:42:34 devstack sudo[93056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-38d559c4-b3b1-4a03-bdac-4015b4176325 Jul 31 10:42:34 devstack sudo[93056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:42:34 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-c218490f-8793-4ef0-bc5b-028fa320fd33 req-6daced21-2c3e-48bf-a86b-f4a83aa44088 tempest-AttachVolumeNegativeTest-304126598 None] Terminate volume connection completed successfully. Jul 31 10:42:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-c218490f-8793-4ef0-bc5b-028fa320fd33 req-6daced21-2c3e-48bf-a86b-f4a83aa44088 tempest-AttachVolumeNegativeTest-304126598 None] Deleting attachment bb6cf4e4-1439-4709-87b0-139645a58729. {{(pid=89090) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:42:34 devstack sudo[93056]: pam_unix(sudo:session): session closed for user root Jul 31 10:42:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-821f531b-ceec-47b2-8f50-ae1d72e0c95a tempest-VolumesActionsTest-873482576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-38d559c4-b3b1-4a03-bdac-4015b4176325" returned: 0 in 0.420s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:42:34 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-821f531b-ceec-47b2-8f50-ae1d72e0c95a tempest-VolumesActionsTest-873482576 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:42:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-821f531b-ceec-47b2-8f50-ae1d72e0c95a tempest-VolumesActionsTest-873482576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:42:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-821f531b-ceec-47b2-8f50-ae1d72e0c95a tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e77fe88-0708-4eff-a2ac-f6b341cc3368) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38d559c4-b3b1-4a03-bdac-4015b4176325', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:42:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-821f531b-ceec-47b2-8f50-ae1d72e0c95a tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b8e5aa8-a7ee-47a9-a444-2971f20f75ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:42:34 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-821f531b-ceec-47b2-8f50-ae1d72e0c95a tempest-VolumesActionsTest-873482576 None] Volume volume-38d559c4-b3b1-4a03-bdac-4015b4176325 (38d559c4-b3b1-4a03-bdac-4015b4176325): created successfully Jul 31 10:42:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-821f531b-ceec-47b2-8f50-ae1d72e0c95a tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b8e5aa8-a7ee-47a9-a444-2971f20f75ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:42:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-821f531b-ceec-47b2-8f50-ae1d72e0c95a tempest-VolumesActionsTest-873482576 None] Flow 'volume_create_manager' (25f90fdc-1032-4070-b786-950001bc3f49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:42:34 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-821f531b-ceec-47b2-8f50-ae1d72e0c95a tempest-VolumesActionsTest-873482576 None] Created volume successfully. Jul 31 10:42:35 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8922d6c0-a30a-434d-852a-94da07cacda5 tempest-VolumesActionsTest-2067764756 None] Acquiring lock "cinder-38d559c4-b3b1-4a03-bdac-4015b4176325-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:42:35 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8922d6c0-a30a-434d-852a-94da07cacda5 tempest-VolumesActionsTest-2067764756 None] Lock "cinder-38d559c4-b3b1-4a03-bdac-4015b4176325-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:42:35 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8922d6c0-a30a-434d-852a-94da07cacda5 tempest-VolumesActionsTest-2067764756 None] Acquiring lock "cinder-quobyte-38d559c4-b3b1-4a03-bdac-4015b4176325" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:42:35 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8922d6c0-a30a-434d-852a-94da07cacda5 tempest-VolumesActionsTest-2067764756 None] Lock "cinder-quobyte-38d559c4-b3b1-4a03-bdac-4015b4176325" acquired by "delete_volume" :: waited 0.033s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:42:35 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d86e3b-988e-485a-a570-8588f8439ab5]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:42:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8922d6c0-a30a-434d-852a-94da07cacda5 tempest-VolumesActionsTest-2067764756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-38d559c4-b3b1-4a03-bdac-4015b4176325 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:42:36 devstack sudo[93067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-38d559c4-b3b1-4a03-bdac-4015b4176325 Jul 31 10:42:36 devstack sudo[93067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:42:36 devstack sudo[93067]: pam_unix(sudo:session): session closed for user root Jul 31 10:42:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8922d6c0-a30a-434d-852a-94da07cacda5 tempest-VolumesActionsTest-2067764756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-38d559c4-b3b1-4a03-bdac-4015b4176325" returned: 0 in 0.744s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:42:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8922d6c0-a30a-434d-852a-94da07cacda5 tempest-VolumesActionsTest-2067764756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-38d559c4-b3b1-4a03-bdac-4015b4176325 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:42:36 devstack sudo[93092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-38d559c4-b3b1-4a03-bdac-4015b4176325 Jul 31 10:42:36 devstack sudo[93092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:42:37 devstack sudo[93092]: pam_unix(sudo:session): session closed for user root Jul 31 10:42:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8922d6c0-a30a-434d-852a-94da07cacda5 tempest-VolumesActionsTest-2067764756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-38d559c4-b3b1-4a03-bdac-4015b4176325" returned: 0 in 0.505s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:42:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8922d6c0-a30a-434d-852a-94da07cacda5 tempest-VolumesActionsTest-2067764756 None] Lock "cinder-quobyte-38d559c4-b3b1-4a03-bdac-4015b4176325" released by "delete_volume" :: held 1.318s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:42:37 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-8922d6c0-a30a-434d-852a-94da07cacda5 tempest-VolumesActionsTest-2067764756 None] Created reservations ['2d0ff9f5-2f50-47d3-bad4-ff03321bf1ca', 'f483d78b-3d51-4991-8306-3c770012e65a', 'b29ab2c7-e19e-479d-b95d-722f5173de8b', 'bee9e4c9-4bb5-4cd1-a3f8-7c4f58442089'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:42:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8922d6c0-a30a-434d-852a-94da07cacda5 tempest-VolumesActionsTest-2067764756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:42:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8922d6c0-a30a-434d-852a-94da07cacda5 tempest-VolumesActionsTest-2067764756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:42:37 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-8922d6c0-a30a-434d-852a-94da07cacda5 tempest-VolumesActionsTest-2067764756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:42:37 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-8922d6c0-a30a-434d-852a-94da07cacda5 tempest-VolumesActionsTest-2067764756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:42:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8922d6c0-a30a-434d-852a-94da07cacda5 tempest-VolumesActionsTest-2067764756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:42:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8922d6c0-a30a-434d-852a-94da07cacda5 tempest-VolumesActionsTest-2067764756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:42:37 devstack sudo[93099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:42:37 devstack sudo[93099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:42:37 devstack sudo[93099]: pam_unix(sudo:session): session closed for user root Jul 31 10:42:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8922d6c0-a30a-434d-852a-94da07cacda5 tempest-VolumesActionsTest-2067764756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.322s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:42:37 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-8922d6c0-a30a-434d-852a-94da07cacda5 tempest-VolumesActionsTest-2067764756 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:42:37 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-8922d6c0-a30a-434d-852a-94da07cacda5 tempest-VolumesActionsTest-2067764756 None] Deleted volume successfully. Jul 31 10:42:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8922d6c0-a30a-434d-852a-94da07cacda5 tempest-VolumesActionsTest-2067764756 None] Lock "cinder-38d559c4-b3b1-4a03-bdac-4015b4176325-delete_volume" released by "delete_volume" :: held 2.157s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:42:39 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a8d39c8-fc8b-4ddd-afb2-6da9c5e61bf6 tempest-VolumesActionsTest-873482576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:42:39 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-8a8d39c8-fc8b-4ddd-afb2-6da9c5e61bf6 tempest-VolumesActionsTest-873482576 None] Flow 'volume_create_manager' (8804c919-f40a-4e0c-8767-d8e87556997d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:42:39 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-8a8d39c8-fc8b-4ddd-afb2-6da9c5e61bf6 tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62a698fd-44ea-44a5-a838-136923881470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:42:39 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-8a8d39c8-fc8b-4ddd-afb2-6da9c5e61bf6 tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62a698fd-44ea-44a5-a838-136923881470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-17788789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75ccc737-aaaf-42c0-864c-c22ae0d69bcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c190045006f4da39810561dbc9e76c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:42:39Z,use_quota=True,user_id='8fe545517a0b473ebe0e02c34664fbec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:42:39 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-8a8d39c8-fc8b-4ddd-afb2-6da9c5e61bf6 tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8aaba95-343b-45f4-bae5-bba4186117cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:42:39 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-8a8d39c8-fc8b-4ddd-afb2-6da9c5e61bf6 tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8aaba95-343b-45f4-bae5-bba4186117cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:42:39 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-8a8d39c8-fc8b-4ddd-afb2-6da9c5e61bf6 tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc37de6c-aa0b-42c1-9a7a-3a59aa3cd7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:42:39 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-8a8d39c8-fc8b-4ddd-afb2-6da9c5e61bf6 tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc37de6c-aa0b-42c1-9a7a-3a59aa3cd7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75ccc737-aaaf-42c0-864c-c22ae0d69bcf', 'volume_name': 'volume-75ccc737-aaaf-42c0-864c-c22ae0d69bcf', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:42:39 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-8a8d39c8-fc8b-4ddd-afb2-6da9c5e61bf6 tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70cab68d-1c8d-422a-abf5-f04800afb128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:42:39 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-8a8d39c8-fc8b-4ddd-afb2-6da9c5e61bf6 tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70cab68d-1c8d-422a-abf5-f04800afb128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:42:39 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-8a8d39c8-fc8b-4ddd-afb2-6da9c5e61bf6 tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa0e8559-e133-4a80-b46e-f0c7408c5ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:42:39 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-8a8d39c8-fc8b-4ddd-afb2-6da9c5e61bf6 tempest-VolumesActionsTest-873482576 None] Volume 75ccc737-aaaf-42c0-864c-c22ae0d69bcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75ccc737-aaaf-42c0-864c-c22ae0d69bcf', 'volume_size': 1} Jul 31 10:42:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8a8d39c8-fc8b-4ddd-afb2-6da9c5e61bf6 tempest-VolumesActionsTest-873482576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:42:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8a8d39c8-fc8b-4ddd-afb2-6da9c5e61bf6 tempest-VolumesActionsTest-873482576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:42:39 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-8a8d39c8-fc8b-4ddd-afb2-6da9c5e61bf6 tempest-VolumesActionsTest-873482576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-17788789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75ccc737-aaaf-42c0-864c-c22ae0d69bcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c190045006f4da39810561dbc9e76c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:42:39Z,use_quota=True,user_id='8fe545517a0b473ebe0e02c34664fbec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:42:39 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-8a8d39c8-fc8b-4ddd-afb2-6da9c5e61bf6 tempest-VolumesActionsTest-873482576 None] Creating volume 75ccc737-aaaf-42c0-864c-c22ae0d69bcf {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:42:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8a8d39c8-fc8b-4ddd-afb2-6da9c5e61bf6 tempest-VolumesActionsTest-873482576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:42:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8a8d39c8-fc8b-4ddd-afb2-6da9c5e61bf6 tempest-VolumesActionsTest-873482576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:42:39 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-8a8d39c8-fc8b-4ddd-afb2-6da9c5e61bf6 tempest-VolumesActionsTest-873482576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:42:39 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-8a8d39c8-fc8b-4ddd-afb2-6da9c5e61bf6 tempest-VolumesActionsTest-873482576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:42:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8a8d39c8-fc8b-4ddd-afb2-6da9c5e61bf6 tempest-VolumesActionsTest-873482576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:42:39 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-8a8d39c8-fc8b-4ddd-afb2-6da9c5e61bf6 tempest-VolumesActionsTest-873482576 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:42:39 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-8a8d39c8-fc8b-4ddd-afb2-6da9c5e61bf6 tempest-VolumesActionsTest-873482576 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:42:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8a8d39c8-fc8b-4ddd-afb2-6da9c5e61bf6 tempest-VolumesActionsTest-873482576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-75ccc737-aaaf-42c0-864c-c22ae0d69bcf 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:42:39 devstack sudo[93106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-75ccc737-aaaf-42c0-864c-c22ae0d69bcf 1073741824 Jul 31 10:42:39 devstack sudo[93106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:42:39 devstack sudo[93106]: pam_unix(sudo:session): session closed for user root Jul 31 10:42:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8a8d39c8-fc8b-4ddd-afb2-6da9c5e61bf6 tempest-VolumesActionsTest-873482576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-75ccc737-aaaf-42c0-864c-c22ae0d69bcf 1073741824" returned: 0 in 0.523s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:42:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8a8d39c8-fc8b-4ddd-afb2-6da9c5e61bf6 tempest-VolumesActionsTest-873482576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-75ccc737-aaaf-42c0-864c-c22ae0d69bcf {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:42:39 devstack sudo[93112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-75ccc737-aaaf-42c0-864c-c22ae0d69bcf Jul 31 10:42:39 devstack sudo[93112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:42:40 devstack sudo[93112]: pam_unix(sudo:session): session closed for user root Jul 31 10:42:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8a8d39c8-fc8b-4ddd-afb2-6da9c5e61bf6 tempest-VolumesActionsTest-873482576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-75ccc737-aaaf-42c0-864c-c22ae0d69bcf" returned: 0 in 0.399s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:42:40 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-8a8d39c8-fc8b-4ddd-afb2-6da9c5e61bf6 tempest-VolumesActionsTest-873482576 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:42:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8a8d39c8-fc8b-4ddd-afb2-6da9c5e61bf6 tempest-VolumesActionsTest-873482576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:42:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-8a8d39c8-fc8b-4ddd-afb2-6da9c5e61bf6 tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa0e8559-e133-4a80-b46e-f0c7408c5ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75ccc737-aaaf-42c0-864c-c22ae0d69bcf', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:42:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-8a8d39c8-fc8b-4ddd-afb2-6da9c5e61bf6 tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (464b024c-4c58-45e5-9c56-de024ea8fe16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:42:40 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-8a8d39c8-fc8b-4ddd-afb2-6da9c5e61bf6 tempest-VolumesActionsTest-873482576 None] Volume volume-75ccc737-aaaf-42c0-864c-c22ae0d69bcf (75ccc737-aaaf-42c0-864c-c22ae0d69bcf): created successfully Jul 31 10:42:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-8a8d39c8-fc8b-4ddd-afb2-6da9c5e61bf6 tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (464b024c-4c58-45e5-9c56-de024ea8fe16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:42:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-8a8d39c8-fc8b-4ddd-afb2-6da9c5e61bf6 tempest-VolumesActionsTest-873482576 None] Flow 'volume_create_manager' (8804c919-f40a-4e0c-8767-d8e87556997d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:42:40 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-8a8d39c8-fc8b-4ddd-afb2-6da9c5e61bf6 tempest-VolumesActionsTest-873482576 None] Created volume successfully. Jul 31 10:42:41 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-eba2c52e-a24f-447a-81a6-5c719735a9b9 tempest-VolumesActionsTest-2067764756 None] Acquiring lock "cinder-75ccc737-aaaf-42c0-864c-c22ae0d69bcf-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:42:41 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-eba2c52e-a24f-447a-81a6-5c719735a9b9 tempest-VolumesActionsTest-2067764756 None] Lock "cinder-75ccc737-aaaf-42c0-864c-c22ae0d69bcf-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:42:41 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-eba2c52e-a24f-447a-81a6-5c719735a9b9 tempest-VolumesActionsTest-2067764756 None] Acquiring lock "cinder-quobyte-75ccc737-aaaf-42c0-864c-c22ae0d69bcf" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:42:41 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-eba2c52e-a24f-447a-81a6-5c719735a9b9 tempest-VolumesActionsTest-2067764756 None] Lock "cinder-quobyte-75ccc737-aaaf-42c0-864c-c22ae0d69bcf" acquired by "delete_volume" :: waited 0.019s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:42:41 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d9d861-fbf3-4cde-a5d6-320023000952]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:42:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-eba2c52e-a24f-447a-81a6-5c719735a9b9 tempest-VolumesActionsTest-2067764756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-75ccc737-aaaf-42c0-864c-c22ae0d69bcf {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:42:41 devstack sudo[93133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-75ccc737-aaaf-42c0-864c-c22ae0d69bcf Jul 31 10:42:41 devstack sudo[93133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:42:42 devstack sudo[93133]: pam_unix(sudo:session): session closed for user root Jul 31 10:42:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-eba2c52e-a24f-447a-81a6-5c719735a9b9 tempest-VolumesActionsTest-2067764756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-75ccc737-aaaf-42c0-864c-c22ae0d69bcf" returned: 0 in 0.496s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:42:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-eba2c52e-a24f-447a-81a6-5c719735a9b9 tempest-VolumesActionsTest-2067764756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-75ccc737-aaaf-42c0-864c-c22ae0d69bcf {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:42:42 devstack sudo[93139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-75ccc737-aaaf-42c0-864c-c22ae0d69bcf Jul 31 10:42:42 devstack sudo[93139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:42:42 devstack sudo[93139]: pam_unix(sudo:session): session closed for user root Jul 31 10:42:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-eba2c52e-a24f-447a-81a6-5c719735a9b9 tempest-VolumesActionsTest-2067764756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-75ccc737-aaaf-42c0-864c-c22ae0d69bcf" returned: 0 in 0.295s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:42:42 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-eba2c52e-a24f-447a-81a6-5c719735a9b9 tempest-VolumesActionsTest-2067764756 None] Lock "cinder-quobyte-75ccc737-aaaf-42c0-864c-c22ae0d69bcf" released by "delete_volume" :: held 0.857s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:42:42 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-eba2c52e-a24f-447a-81a6-5c719735a9b9 tempest-VolumesActionsTest-2067764756 None] Created reservations ['24083622-34ed-420f-85e3-f64bc736b526', 'e378d0db-f681-4ea0-81e3-9b5eb3da414e', 'c18bc51a-9037-4ac1-8984-822ef88fa64d', '89240af8-5f61-45dd-92b0-4cfd6dc977ab'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:42:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-eba2c52e-a24f-447a-81a6-5c719735a9b9 tempest-VolumesActionsTest-2067764756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:42:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-eba2c52e-a24f-447a-81a6-5c719735a9b9 tempest-VolumesActionsTest-2067764756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:42:42 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-eba2c52e-a24f-447a-81a6-5c719735a9b9 tempest-VolumesActionsTest-2067764756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:42:42 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-eba2c52e-a24f-447a-81a6-5c719735a9b9 tempest-VolumesActionsTest-2067764756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:42:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-eba2c52e-a24f-447a-81a6-5c719735a9b9 tempest-VolumesActionsTest-2067764756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:42:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-eba2c52e-a24f-447a-81a6-5c719735a9b9 tempest-VolumesActionsTest-2067764756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:42:42 devstack sudo[93142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:42:42 devstack sudo[93142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:42:43 devstack sudo[93142]: pam_unix(sudo:session): session closed for user root Jul 31 10:42:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-eba2c52e-a24f-447a-81a6-5c719735a9b9 tempest-VolumesActionsTest-2067764756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.400s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:42:43 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-eba2c52e-a24f-447a-81a6-5c719735a9b9 tempest-VolumesActionsTest-2067764756 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:42:43 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-eba2c52e-a24f-447a-81a6-5c719735a9b9 tempest-VolumesActionsTest-2067764756 None] Deleted volume successfully. Jul 31 10:42:43 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-eba2c52e-a24f-447a-81a6-5c719735a9b9 tempest-VolumesActionsTest-2067764756 None] Lock "cinder-75ccc737-aaaf-42c0-864c-c22ae0d69bcf-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:42:43 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5e3d93b-82a2-4263-9d84-b51923c9cec6 tempest-VolumesActionsTest-873482576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:42:43 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c5e3d93b-82a2-4263-9d84-b51923c9cec6 tempest-VolumesActionsTest-873482576 None] Flow 'volume_create_manager' (514aba27-dcd7-47e8-a8fe-01a89dcc4708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:42:43 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c5e3d93b-82a2-4263-9d84-b51923c9cec6 tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d372b8-42af-40c0-b589-17872a7f20a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:42:43 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c5e3d93b-82a2-4263-9d84-b51923c9cec6 tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d372b8-42af-40c0-b589-17872a7f20a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-781733753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e03093a8-9ecc-492c-ab65-68394c7f0308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c190045006f4da39810561dbc9e76c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:42:43Z,use_quota=True,user_id='8fe545517a0b473ebe0e02c34664fbec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:42:43 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c5e3d93b-82a2-4263-9d84-b51923c9cec6 tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94a32ecc-a3a8-4fe9-9324-afe5fa7817a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:42:43 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c5e3d93b-82a2-4263-9d84-b51923c9cec6 tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94a32ecc-a3a8-4fe9-9324-afe5fa7817a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:42:43 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c5e3d93b-82a2-4263-9d84-b51923c9cec6 tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da36dc0d-7dc8-4840-8f3d-2fc97a6ea979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:42:43 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c5e3d93b-82a2-4263-9d84-b51923c9cec6 tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da36dc0d-7dc8-4840-8f3d-2fc97a6ea979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e03093a8-9ecc-492c-ab65-68394c7f0308', 'volume_name': 'volume-e03093a8-9ecc-492c-ab65-68394c7f0308', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:42:43 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c5e3d93b-82a2-4263-9d84-b51923c9cec6 tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78547232-991d-4a40-8d36-4132608eec60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:42:43 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c5e3d93b-82a2-4263-9d84-b51923c9cec6 tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78547232-991d-4a40-8d36-4132608eec60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:42:43 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c5e3d93b-82a2-4263-9d84-b51923c9cec6 tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f56c11ca-d908-4ad3-b5ac-26e62067807d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:42:43 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-c5e3d93b-82a2-4263-9d84-b51923c9cec6 tempest-VolumesActionsTest-873482576 None] Volume e03093a8-9ecc-492c-ab65-68394c7f0308: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e03093a8-9ecc-492c-ab65-68394c7f0308', 'volume_size': 1} Jul 31 10:42:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c5e3d93b-82a2-4263-9d84-b51923c9cec6 tempest-VolumesActionsTest-873482576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:42:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c5e3d93b-82a2-4263-9d84-b51923c9cec6 tempest-VolumesActionsTest-873482576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:42:43 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c5e3d93b-82a2-4263-9d84-b51923c9cec6 tempest-VolumesActionsTest-873482576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-781733753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e03093a8-9ecc-492c-ab65-68394c7f0308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c190045006f4da39810561dbc9e76c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:42:43Z,use_quota=True,user_id='8fe545517a0b473ebe0e02c34664fbec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:42:43 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-c5e3d93b-82a2-4263-9d84-b51923c9cec6 tempest-VolumesActionsTest-873482576 None] Creating volume e03093a8-9ecc-492c-ab65-68394c7f0308 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:42:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c5e3d93b-82a2-4263-9d84-b51923c9cec6 tempest-VolumesActionsTest-873482576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:42:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c5e3d93b-82a2-4263-9d84-b51923c9cec6 tempest-VolumesActionsTest-873482576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:42:43 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c5e3d93b-82a2-4263-9d84-b51923c9cec6 tempest-VolumesActionsTest-873482576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:42:43 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c5e3d93b-82a2-4263-9d84-b51923c9cec6 tempest-VolumesActionsTest-873482576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:42:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c5e3d93b-82a2-4263-9d84-b51923c9cec6 tempest-VolumesActionsTest-873482576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:42:43 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c5e3d93b-82a2-4263-9d84-b51923c9cec6 tempest-VolumesActionsTest-873482576 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:42:43 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-c5e3d93b-82a2-4263-9d84-b51923c9cec6 tempest-VolumesActionsTest-873482576 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:42:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c5e3d93b-82a2-4263-9d84-b51923c9cec6 tempest-VolumesActionsTest-873482576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e03093a8-9ecc-492c-ab65-68394c7f0308 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:42:43 devstack sudo[93145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e03093a8-9ecc-492c-ab65-68394c7f0308 1073741824 Jul 31 10:42:43 devstack sudo[93145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:42:44 devstack sudo[93145]: pam_unix(sudo:session): session closed for user root Jul 31 10:42:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c5e3d93b-82a2-4263-9d84-b51923c9cec6 tempest-VolumesActionsTest-873482576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e03093a8-9ecc-492c-ab65-68394c7f0308 1073741824" returned: 0 in 0.579s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:42:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c5e3d93b-82a2-4263-9d84-b51923c9cec6 tempest-VolumesActionsTest-873482576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e03093a8-9ecc-492c-ab65-68394c7f0308 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:42:44 devstack sudo[93151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e03093a8-9ecc-492c-ab65-68394c7f0308 Jul 31 10:42:44 devstack sudo[93151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:42:44 devstack sudo[93151]: pam_unix(sudo:session): session closed for user root Jul 31 10:42:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c5e3d93b-82a2-4263-9d84-b51923c9cec6 tempest-VolumesActionsTest-873482576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e03093a8-9ecc-492c-ab65-68394c7f0308" returned: 0 in 0.363s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:42:44 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c5e3d93b-82a2-4263-9d84-b51923c9cec6 tempest-VolumesActionsTest-873482576 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:42:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c5e3d93b-82a2-4263-9d84-b51923c9cec6 tempest-VolumesActionsTest-873482576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:42:44 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c5e3d93b-82a2-4263-9d84-b51923c9cec6 tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f56c11ca-d908-4ad3-b5ac-26e62067807d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e03093a8-9ecc-492c-ab65-68394c7f0308', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:42:44 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c5e3d93b-82a2-4263-9d84-b51923c9cec6 tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eae19e84-642d-4d25-baa4-49d04e953e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:42:44 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-c5e3d93b-82a2-4263-9d84-b51923c9cec6 tempest-VolumesActionsTest-873482576 None] Volume volume-e03093a8-9ecc-492c-ab65-68394c7f0308 (e03093a8-9ecc-492c-ab65-68394c7f0308): created successfully Jul 31 10:42:44 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c5e3d93b-82a2-4263-9d84-b51923c9cec6 tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eae19e84-642d-4d25-baa4-49d04e953e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:42:44 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c5e3d93b-82a2-4263-9d84-b51923c9cec6 tempest-VolumesActionsTest-873482576 None] Flow 'volume_create_manager' (514aba27-dcd7-47e8-a8fe-01a89dcc4708) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:42:44 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-c5e3d93b-82a2-4263-9d84-b51923c9cec6 tempest-VolumesActionsTest-873482576 None] Created volume successfully. Jul 31 10:42:45 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-372419f0-84a9-4f0b-a84e-5a16c600a60b tempest-VolumesActionsTest-2067764756 None] Acquiring lock "cinder-e03093a8-9ecc-492c-ab65-68394c7f0308-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:42:45 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-372419f0-84a9-4f0b-a84e-5a16c600a60b tempest-VolumesActionsTest-2067764756 None] Lock "cinder-e03093a8-9ecc-492c-ab65-68394c7f0308-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:42:45 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:42:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:42:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:42:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:42:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:42:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:42:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:42:45 devstack sudo[93154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:42:45 devstack sudo[93154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:42:46 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-372419f0-84a9-4f0b-a84e-5a16c600a60b tempest-VolumesActionsTest-2067764756 None] Acquiring lock "cinder-quobyte-e03093a8-9ecc-492c-ab65-68394c7f0308" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:42:46 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-372419f0-84a9-4f0b-a84e-5a16c600a60b tempest-VolumesActionsTest-2067764756 None] Lock "cinder-quobyte-e03093a8-9ecc-492c-ab65-68394c7f0308" acquired by "delete_volume" :: waited 0.027s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:42:46 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fa563c-5495-4b8c-826d-4c91923c26c2]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:42:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-372419f0-84a9-4f0b-a84e-5a16c600a60b tempest-VolumesActionsTest-2067764756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e03093a8-9ecc-492c-ab65-68394c7f0308 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:42:46 devstack sudo[93156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e03093a8-9ecc-492c-ab65-68394c7f0308 Jul 31 10:42:46 devstack sudo[93156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:42:46 devstack sudo[93154]: pam_unix(sudo:session): session closed for user root Jul 31 10:42:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.524s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:42:46 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:42:46 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager._thread_info {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:42:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread count: 8 {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:42:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread info: [<_MainThread(MainThread, started 134005426110592)>, , , , , , , ] {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:42:46 devstack sudo[93156]: pam_unix(sudo:session): session closed for user root Jul 31 10:42:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-372419f0-84a9-4f0b-a84e-5a16c600a60b tempest-VolumesActionsTest-2067764756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e03093a8-9ecc-492c-ab65-68394c7f0308" returned: 0 in 0.648s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:42:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-372419f0-84a9-4f0b-a84e-5a16c600a60b tempest-VolumesActionsTest-2067764756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e03093a8-9ecc-492c-ab65-68394c7f0308 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:42:46 devstack sudo[93165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e03093a8-9ecc-492c-ab65-68394c7f0308 Jul 31 10:42:46 devstack sudo[93165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:42:47 devstack sudo[93165]: pam_unix(sudo:session): session closed for user root Jul 31 10:42:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-372419f0-84a9-4f0b-a84e-5a16c600a60b tempest-VolumesActionsTest-2067764756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e03093a8-9ecc-492c-ab65-68394c7f0308" returned: 0 in 0.463s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:42:47 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-372419f0-84a9-4f0b-a84e-5a16c600a60b tempest-VolumesActionsTest-2067764756 None] Lock "cinder-quobyte-e03093a8-9ecc-492c-ab65-68394c7f0308" released by "delete_volume" :: held 1.197s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:42:47 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-372419f0-84a9-4f0b-a84e-5a16c600a60b tempest-VolumesActionsTest-2067764756 None] Created reservations ['8bdf41f1-c874-4480-a691-c4baafc07609', '96a4cf7a-4c8d-413a-8565-8a597c68af7b', 'd7df1a81-0413-4ce1-bb9a-7a0458ab6b99', 'f045ef4d-1030-4598-ac4f-4f26b810f862'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:42:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-372419f0-84a9-4f0b-a84e-5a16c600a60b tempest-VolumesActionsTest-2067764756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:42:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-372419f0-84a9-4f0b-a84e-5a16c600a60b tempest-VolumesActionsTest-2067764756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:42:47 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-372419f0-84a9-4f0b-a84e-5a16c600a60b tempest-VolumesActionsTest-2067764756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:42:47 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-372419f0-84a9-4f0b-a84e-5a16c600a60b tempest-VolumesActionsTest-2067764756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:42:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-372419f0-84a9-4f0b-a84e-5a16c600a60b tempest-VolumesActionsTest-2067764756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:42:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-372419f0-84a9-4f0b-a84e-5a16c600a60b tempest-VolumesActionsTest-2067764756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:42:47 devstack sudo[93169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:42:47 devstack sudo[93169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:42:48 devstack sudo[93169]: pam_unix(sudo:session): session closed for user root Jul 31 10:42:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-372419f0-84a9-4f0b-a84e-5a16c600a60b tempest-VolumesActionsTest-2067764756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.510s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:42:48 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-372419f0-84a9-4f0b-a84e-5a16c600a60b tempest-VolumesActionsTest-2067764756 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:42:48 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-372419f0-84a9-4f0b-a84e-5a16c600a60b tempest-VolumesActionsTest-2067764756 None] Deleted volume successfully. Jul 31 10:42:48 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-372419f0-84a9-4f0b-a84e-5a16c600a60b tempest-VolumesActionsTest-2067764756 None] Lock "cinder-e03093a8-9ecc-492c-ab65-68394c7f0308-delete_volume" released by "delete_volume" :: held 2.190s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:42:49 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e2e1be9-72a1-49da-8fa6-2f989257ef7f tempest-VolumesActionsTest-873482576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:42:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3e2e1be9-72a1-49da-8fa6-2f989257ef7f tempest-VolumesActionsTest-873482576 None] Flow 'volume_create_manager' (7a7912d5-4bb3-47cd-bebd-b0a65aa8031b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:42:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3e2e1be9-72a1-49da-8fa6-2f989257ef7f tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf425725-efe9-4d31-8d28-bfc5f795d492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:42:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3e2e1be9-72a1-49da-8fa6-2f989257ef7f tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf425725-efe9-4d31-8d28-bfc5f795d492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:42:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1955943506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adb3602b-c99e-432d-a5b7-9e28d8560e3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c190045006f4da39810561dbc9e76c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:42:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:42:49Z,use_quota=True,user_id='8fe545517a0b473ebe0e02c34664fbec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:42:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3e2e1be9-72a1-49da-8fa6-2f989257ef7f tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fbd6d48-f241-42d9-aea4-e085cdc96dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:42:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3e2e1be9-72a1-49da-8fa6-2f989257ef7f tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fbd6d48-f241-42d9-aea4-e085cdc96dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:42:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3e2e1be9-72a1-49da-8fa6-2f989257ef7f tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb3b8150-fd1f-4dd6-8f0f-4a8895d96ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:42:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3e2e1be9-72a1-49da-8fa6-2f989257ef7f tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb3b8150-fd1f-4dd6-8f0f-4a8895d96ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adb3602b-c99e-432d-a5b7-9e28d8560e3e', 'volume_name': 'volume-adb3602b-c99e-432d-a5b7-9e28d8560e3e', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:42:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3e2e1be9-72a1-49da-8fa6-2f989257ef7f tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab02816a-ee6b-4110-b878-81627e7c093a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:42:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3e2e1be9-72a1-49da-8fa6-2f989257ef7f tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab02816a-ee6b-4110-b878-81627e7c093a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:42:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3e2e1be9-72a1-49da-8fa6-2f989257ef7f tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67456656-b278-4814-bc6f-4b075c2f32ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:42:49 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-3e2e1be9-72a1-49da-8fa6-2f989257ef7f tempest-VolumesActionsTest-873482576 None] Volume adb3602b-c99e-432d-a5b7-9e28d8560e3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adb3602b-c99e-432d-a5b7-9e28d8560e3e', 'volume_size': 1} Jul 31 10:42:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3e2e1be9-72a1-49da-8fa6-2f989257ef7f tempest-VolumesActionsTest-873482576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:42:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3e2e1be9-72a1-49da-8fa6-2f989257ef7f tempest-VolumesActionsTest-873482576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:42:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-3e2e1be9-72a1-49da-8fa6-2f989257ef7f tempest-VolumesActionsTest-873482576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:42:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1955943506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adb3602b-c99e-432d-a5b7-9e28d8560e3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c190045006f4da39810561dbc9e76c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:42:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:42:49Z,use_quota=True,user_id='8fe545517a0b473ebe0e02c34664fbec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:42:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-3e2e1be9-72a1-49da-8fa6-2f989257ef7f tempest-VolumesActionsTest-873482576 None] Creating volume adb3602b-c99e-432d-a5b7-9e28d8560e3e {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:42:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3e2e1be9-72a1-49da-8fa6-2f989257ef7f tempest-VolumesActionsTest-873482576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:42:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3e2e1be9-72a1-49da-8fa6-2f989257ef7f tempest-VolumesActionsTest-873482576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:42:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-3e2e1be9-72a1-49da-8fa6-2f989257ef7f tempest-VolumesActionsTest-873482576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:42:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-3e2e1be9-72a1-49da-8fa6-2f989257ef7f tempest-VolumesActionsTest-873482576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:42:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3e2e1be9-72a1-49da-8fa6-2f989257ef7f tempest-VolumesActionsTest-873482576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:42:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-3e2e1be9-72a1-49da-8fa6-2f989257ef7f tempest-VolumesActionsTest-873482576 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:42:49 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-3e2e1be9-72a1-49da-8fa6-2f989257ef7f tempest-VolumesActionsTest-873482576 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:42:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3e2e1be9-72a1-49da-8fa6-2f989257ef7f tempest-VolumesActionsTest-873482576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-adb3602b-c99e-432d-a5b7-9e28d8560e3e 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:42:49 devstack sudo[93179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-adb3602b-c99e-432d-a5b7-9e28d8560e3e 1073741824 Jul 31 10:42:49 devstack sudo[93179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:42:50 devstack sudo[93179]: pam_unix(sudo:session): session closed for user root Jul 31 10:42:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3e2e1be9-72a1-49da-8fa6-2f989257ef7f tempest-VolumesActionsTest-873482576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-adb3602b-c99e-432d-a5b7-9e28d8560e3e 1073741824" returned: 0 in 0.909s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:42:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3e2e1be9-72a1-49da-8fa6-2f989257ef7f tempest-VolumesActionsTest-873482576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-adb3602b-c99e-432d-a5b7-9e28d8560e3e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:42:50 devstack sudo[93199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-adb3602b-c99e-432d-a5b7-9e28d8560e3e Jul 31 10:42:50 devstack sudo[93199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:42:51 devstack sudo[93199]: pam_unix(sudo:session): session closed for user root Jul 31 10:42:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3e2e1be9-72a1-49da-8fa6-2f989257ef7f tempest-VolumesActionsTest-873482576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-adb3602b-c99e-432d-a5b7-9e28d8560e3e" returned: 0 in 0.440s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:42:51 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-3e2e1be9-72a1-49da-8fa6-2f989257ef7f tempest-VolumesActionsTest-873482576 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:42:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3e2e1be9-72a1-49da-8fa6-2f989257ef7f tempest-VolumesActionsTest-873482576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.441s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:42:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3e2e1be9-72a1-49da-8fa6-2f989257ef7f tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67456656-b278-4814-bc6f-4b075c2f32ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adb3602b-c99e-432d-a5b7-9e28d8560e3e', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:42:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3e2e1be9-72a1-49da-8fa6-2f989257ef7f tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27520e62-5064-472d-9fcf-642034e50f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:42:51 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-3e2e1be9-72a1-49da-8fa6-2f989257ef7f tempest-VolumesActionsTest-873482576 None] Volume volume-adb3602b-c99e-432d-a5b7-9e28d8560e3e (adb3602b-c99e-432d-a5b7-9e28d8560e3e): created successfully Jul 31 10:42:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3e2e1be9-72a1-49da-8fa6-2f989257ef7f tempest-VolumesActionsTest-873482576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27520e62-5064-472d-9fcf-642034e50f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:42:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3e2e1be9-72a1-49da-8fa6-2f989257ef7f tempest-VolumesActionsTest-873482576 None] Flow 'volume_create_manager' (7a7912d5-4bb3-47cd-bebd-b0a65aa8031b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:42:51 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-3e2e1be9-72a1-49da-8fa6-2f989257ef7f tempest-VolumesActionsTest-873482576 None] Created volume successfully. Jul 31 10:42:52 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-d8105f32-525d-4d6b-a424-0ddd5d0f2393 req-33321d59-b1b4-41dd-938b-8512868afcbd tempest-ServerActionsTestOtherA-938259275 None] Terminate volume connection completed successfully. Jul 31 10:42:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-d8105f32-525d-4d6b-a424-0ddd5d0f2393 req-33321d59-b1b4-41dd-938b-8512868afcbd tempest-ServerActionsTestOtherA-938259275 None] Deleting attachment c33ff2ea-e61f-4a23-8d38-4a0e0a26ee36. {{(pid=89090) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:42:52 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e89d547f-82da-4e23-bd6c-6895dbb0fe76 tempest-VolumesActionsTest-873482576 None] Acquiring lock "cinder-adb3602b-c99e-432d-a5b7-9e28d8560e3e-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:42:52 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e89d547f-82da-4e23-bd6c-6895dbb0fe76 tempest-VolumesActionsTest-873482576 None] Lock "cinder-adb3602b-c99e-432d-a5b7-9e28d8560e3e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:42:52 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e89d547f-82da-4e23-bd6c-6895dbb0fe76 tempest-VolumesActionsTest-873482576 None] Acquiring lock "cinder-quobyte-adb3602b-c99e-432d-a5b7-9e28d8560e3e" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:42:52 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e89d547f-82da-4e23-bd6c-6895dbb0fe76 tempest-VolumesActionsTest-873482576 None] Lock "cinder-quobyte-adb3602b-c99e-432d-a5b7-9e28d8560e3e" acquired by "delete_volume" :: waited 0.036s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:42:52 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[578e7574-9ccc-4d02-9e91-4b77109cadad]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:42:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e89d547f-82da-4e23-bd6c-6895dbb0fe76 tempest-VolumesActionsTest-873482576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-adb3602b-c99e-432d-a5b7-9e28d8560e3e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:42:53 devstack sudo[93246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-adb3602b-c99e-432d-a5b7-9e28d8560e3e Jul 31 10:42:53 devstack sudo[93246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:42:53 devstack sudo[93246]: pam_unix(sudo:session): session closed for user root Jul 31 10:42:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e89d547f-82da-4e23-bd6c-6895dbb0fe76 tempest-VolumesActionsTest-873482576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-adb3602b-c99e-432d-a5b7-9e28d8560e3e" returned: 0 in 0.623s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:42:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e89d547f-82da-4e23-bd6c-6895dbb0fe76 tempest-VolumesActionsTest-873482576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-adb3602b-c99e-432d-a5b7-9e28d8560e3e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:42:53 devstack sudo[93256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-adb3602b-c99e-432d-a5b7-9e28d8560e3e Jul 31 10:42:53 devstack sudo[93256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:42:54 devstack sudo[93256]: pam_unix(sudo:session): session closed for user root Jul 31 10:42:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e89d547f-82da-4e23-bd6c-6895dbb0fe76 tempest-VolumesActionsTest-873482576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-adb3602b-c99e-432d-a5b7-9e28d8560e3e" returned: 0 in 0.521s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:42:54 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e89d547f-82da-4e23-bd6c-6895dbb0fe76 tempest-VolumesActionsTest-873482576 None] Lock "cinder-quobyte-adb3602b-c99e-432d-a5b7-9e28d8560e3e" released by "delete_volume" :: held 1.218s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:42:54 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-e89d547f-82da-4e23-bd6c-6895dbb0fe76 tempest-VolumesActionsTest-873482576 None] Created reservations ['dedd5cae-f5c6-44e2-8189-2dd68694d4a7', 'fed33e64-fa4d-46de-93c4-8ab281b96f04', '9457dd5d-18dd-4226-bc57-c442424e860d', '47c4b048-2058-427d-b15c-cb1a8ce6bb88'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:42:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e89d547f-82da-4e23-bd6c-6895dbb0fe76 tempest-VolumesActionsTest-873482576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:42:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e89d547f-82da-4e23-bd6c-6895dbb0fe76 tempest-VolumesActionsTest-873482576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:42:54 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-e89d547f-82da-4e23-bd6c-6895dbb0fe76 tempest-VolumesActionsTest-873482576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:42:54 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-e89d547f-82da-4e23-bd6c-6895dbb0fe76 tempest-VolumesActionsTest-873482576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:42:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e89d547f-82da-4e23-bd6c-6895dbb0fe76 tempest-VolumesActionsTest-873482576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:42:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e89d547f-82da-4e23-bd6c-6895dbb0fe76 tempest-VolumesActionsTest-873482576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:42:54 devstack sudo[93274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:42:54 devstack sudo[93274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:42:54 devstack sudo[93274]: pam_unix(sudo:session): session closed for user root Jul 31 10:42:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e89d547f-82da-4e23-bd6c-6895dbb0fe76 tempest-VolumesActionsTest-873482576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.540s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:42:54 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-e89d547f-82da-4e23-bd6c-6895dbb0fe76 tempest-VolumesActionsTest-873482576 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:42:54 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-e89d547f-82da-4e23-bd6c-6895dbb0fe76 tempest-VolumesActionsTest-873482576 None] Deleted volume successfully. Jul 31 10:42:54 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e89d547f-82da-4e23-bd6c-6895dbb0fe76 tempest-VolumesActionsTest-873482576 None] Lock "cinder-adb3602b-c99e-432d-a5b7-9e28d8560e3e-delete_volume" released by "delete_volume" :: held 2.137s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:43:02 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-c9ee9608-2c08-4d9b-8f25-e14407bfbf92 tempest-ServerActionsTestOtherA-938259275 None] Acquiring lock "cinder-c48c586e-d272-43f1-8ab3-c839e2d4a81e-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:43:02 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-c9ee9608-2c08-4d9b-8f25-e14407bfbf92 tempest-ServerActionsTestOtherA-938259275 None] Lock "cinder-c48c586e-d272-43f1-8ab3-c839e2d4a81e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:43:02 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-c9ee9608-2c08-4d9b-8f25-e14407bfbf92 tempest-ServerActionsTestOtherA-938259275 None] Acquiring lock "cinder-quobyte-c48c586e-d272-43f1-8ab3-c839e2d4a81e" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:43:02 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-c9ee9608-2c08-4d9b-8f25-e14407bfbf92 tempest-ServerActionsTestOtherA-938259275 None] Lock "cinder-quobyte-c48c586e-d272-43f1-8ab3-c839e2d4a81e" acquired by "delete_volume" :: waited 0.023s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:43:03 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[76791d5c-4699-481e-ba96-c662dfc98d50]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:43:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c9ee9608-2c08-4d9b-8f25-e14407bfbf92 tempest-ServerActionsTestOtherA-938259275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c48c586e-d272-43f1-8ab3-c839e2d4a81e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:03 devstack sudo[93411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c48c586e-d272-43f1-8ab3-c839e2d4a81e Jul 31 10:43:03 devstack sudo[93411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:03 devstack sudo[93411]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c9ee9608-2c08-4d9b-8f25-e14407bfbf92 tempest-ServerActionsTestOtherA-938259275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c48c586e-d272-43f1-8ab3-c839e2d4a81e" returned: 0 in 0.527s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c9ee9608-2c08-4d9b-8f25-e14407bfbf92 tempest-ServerActionsTestOtherA-938259275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c48c586e-d272-43f1-8ab3-c839e2d4a81e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:03 devstack sudo[93417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c48c586e-d272-43f1-8ab3-c839e2d4a81e Jul 31 10:43:03 devstack sudo[93417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:03 devstack sudo[93417]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c9ee9608-2c08-4d9b-8f25-e14407bfbf92 tempest-ServerActionsTestOtherA-938259275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c48c586e-d272-43f1-8ab3-c839e2d4a81e" returned: 0 in 0.428s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:04 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-c9ee9608-2c08-4d9b-8f25-e14407bfbf92 tempest-ServerActionsTestOtherA-938259275 None] Lock "cinder-quobyte-c48c586e-d272-43f1-8ab3-c839e2d4a81e" released by "delete_volume" :: held 1.055s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:43:04 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-c9ee9608-2c08-4d9b-8f25-e14407bfbf92 tempest-ServerActionsTestOtherA-938259275 None] Created reservations ['fa3c91bf-0635-499d-9205-06d361cf14c1', '325ba5ee-99f5-4736-8293-f40aead2e29a', 'ff619ba1-72a4-49f1-9762-c62f7db66631', '1947eecd-4800-43e8-8008-7cae3dcae80d'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:43:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c9ee9608-2c08-4d9b-8f25-e14407bfbf92 tempest-ServerActionsTestOtherA-938259275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:43:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c9ee9608-2c08-4d9b-8f25-e14407bfbf92 tempest-ServerActionsTestOtherA-938259275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:43:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c9ee9608-2c08-4d9b-8f25-e14407bfbf92 tempest-ServerActionsTestOtherA-938259275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:43:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c9ee9608-2c08-4d9b-8f25-e14407bfbf92 tempest-ServerActionsTestOtherA-938259275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:43:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c9ee9608-2c08-4d9b-8f25-e14407bfbf92 tempest-ServerActionsTestOtherA-938259275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:43:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c9ee9608-2c08-4d9b-8f25-e14407bfbf92 tempest-ServerActionsTestOtherA-938259275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:04 devstack sudo[93421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:43:04 devstack sudo[93421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:04 devstack sudo[93421]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c9ee9608-2c08-4d9b-8f25-e14407bfbf92 tempest-ServerActionsTestOtherA-938259275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.398s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:04 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-c9ee9608-2c08-4d9b-8f25-e14407bfbf92 tempest-ServerActionsTestOtherA-938259275 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:43:04 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-c9ee9608-2c08-4d9b-8f25-e14407bfbf92 tempest-ServerActionsTestOtherA-938259275 None] Deleted volume successfully. Jul 31 10:43:04 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-c9ee9608-2c08-4d9b-8f25-e14407bfbf92 tempest-ServerActionsTestOtherA-938259275 None] Lock "cinder-c48c586e-d272-43f1-8ab3-c839e2d4a81e-delete_volume" released by "delete_volume" :: held 1.969s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:43:14 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:UPDATE=81,cinder:SELECT=81,cinder:INSERT=16,cinder:DELETE=6 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:43:14 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=70,cinder:INSERT=24,cinder:UPDATE=96,cinder:DELETE=8 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:43:21 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-48b70586-19ba-4d01-9587-e377ee65fb1c tempest-VolumesListAdminTestJSON-1116729470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:43:21 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-48b70586-19ba-4d01-9587-e377ee65fb1c tempest-VolumesListAdminTestJSON-1116729470 None] Flow 'volume_create_manager' (5375e4b0-60eb-408e-aa61-9165ae854dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:43:21 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-48b70586-19ba-4d01-9587-e377ee65fb1c tempest-VolumesListAdminTestJSON-1116729470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (653c0efa-d75a-4aa3-ab5f-397a911395c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:21 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-48b70586-19ba-4d01-9587-e377ee65fb1c tempest-VolumesListAdminTestJSON-1116729470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (653c0efa-d75a-4aa3-ab5f-397a911395c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1273247054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cd6a29d-845b-4b47-b03a-ae8386548bf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d20bfb387bc94b30be730715a8f3f646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:43:21Z,use_quota=True,user_id='00c14a4b1ef44fbeb1bd67048661e1a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:21 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-48b70586-19ba-4d01-9587-e377ee65fb1c tempest-VolumesListAdminTestJSON-1116729470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9155b9d3-bbab-473f-8425-dba49fa75aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:21 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-48b70586-19ba-4d01-9587-e377ee65fb1c tempest-VolumesListAdminTestJSON-1116729470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9155b9d3-bbab-473f-8425-dba49fa75aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:21 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-48b70586-19ba-4d01-9587-e377ee65fb1c tempest-VolumesListAdminTestJSON-1116729470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb433b18-f566-479b-bada-3c7583b5f1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:21 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-48b70586-19ba-4d01-9587-e377ee65fb1c tempest-VolumesListAdminTestJSON-1116729470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb433b18-f566-479b-bada-3c7583b5f1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cd6a29d-845b-4b47-b03a-ae8386548bf5', 'volume_name': 'volume-3cd6a29d-845b-4b47-b03a-ae8386548bf5', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:21 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-48b70586-19ba-4d01-9587-e377ee65fb1c tempest-VolumesListAdminTestJSON-1116729470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae18905f-4349-4328-9600-29fa0e0369ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:21 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-48b70586-19ba-4d01-9587-e377ee65fb1c tempest-VolumesListAdminTestJSON-1116729470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae18905f-4349-4328-9600-29fa0e0369ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:21 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-48b70586-19ba-4d01-9587-e377ee65fb1c tempest-VolumesListAdminTestJSON-1116729470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4fd5244-33be-46dd-8df6-b782a00b95d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:21 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-48b70586-19ba-4d01-9587-e377ee65fb1c tempest-VolumesListAdminTestJSON-1116729470 None] Volume 3cd6a29d-845b-4b47-b03a-ae8386548bf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cd6a29d-845b-4b47-b03a-ae8386548bf5', 'volume_size': 1} Jul 31 10:43:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-48b70586-19ba-4d01-9587-e377ee65fb1c tempest-VolumesListAdminTestJSON-1116729470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:43:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-48b70586-19ba-4d01-9587-e377ee65fb1c tempest-VolumesListAdminTestJSON-1116729470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:43:21 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-48b70586-19ba-4d01-9587-e377ee65fb1c tempest-VolumesListAdminTestJSON-1116729470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1273247054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cd6a29d-845b-4b47-b03a-ae8386548bf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d20bfb387bc94b30be730715a8f3f646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:43:21Z,use_quota=True,user_id='00c14a4b1ef44fbeb1bd67048661e1a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:43:21 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-48b70586-19ba-4d01-9587-e377ee65fb1c tempest-VolumesListAdminTestJSON-1116729470 None] Creating volume 3cd6a29d-845b-4b47-b03a-ae8386548bf5 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:43:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-48b70586-19ba-4d01-9587-e377ee65fb1c tempest-VolumesListAdminTestJSON-1116729470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:43:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-48b70586-19ba-4d01-9587-e377ee65fb1c tempest-VolumesListAdminTestJSON-1116729470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:43:21 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-48b70586-19ba-4d01-9587-e377ee65fb1c tempest-VolumesListAdminTestJSON-1116729470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:43:21 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-48b70586-19ba-4d01-9587-e377ee65fb1c tempest-VolumesListAdminTestJSON-1116729470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:43:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-48b70586-19ba-4d01-9587-e377ee65fb1c tempest-VolumesListAdminTestJSON-1116729470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:43:21 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-48b70586-19ba-4d01-9587-e377ee65fb1c tempest-VolumesListAdminTestJSON-1116729470 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:43:21 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-48b70586-19ba-4d01-9587-e377ee65fb1c tempest-VolumesListAdminTestJSON-1116729470 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:43:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-48b70586-19ba-4d01-9587-e377ee65fb1c tempest-VolumesListAdminTestJSON-1116729470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3cd6a29d-845b-4b47-b03a-ae8386548bf5 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:21 devstack sudo[93609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3cd6a29d-845b-4b47-b03a-ae8386548bf5 1073741824 Jul 31 10:43:21 devstack sudo[93609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:22 devstack sudo[93609]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-48b70586-19ba-4d01-9587-e377ee65fb1c tempest-VolumesListAdminTestJSON-1116729470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3cd6a29d-845b-4b47-b03a-ae8386548bf5 1073741824" returned: 0 in 0.885s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-48b70586-19ba-4d01-9587-e377ee65fb1c tempest-VolumesListAdminTestJSON-1116729470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3cd6a29d-845b-4b47-b03a-ae8386548bf5 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:22 devstack sudo[93616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3cd6a29d-845b-4b47-b03a-ae8386548bf5 Jul 31 10:43:22 devstack sudo[93616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:22 devstack sudo[93616]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-48b70586-19ba-4d01-9587-e377ee65fb1c tempest-VolumesListAdminTestJSON-1116729470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3cd6a29d-845b-4b47-b03a-ae8386548bf5" returned: 0 in 0.443s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:22 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-48b70586-19ba-4d01-9587-e377ee65fb1c tempest-VolumesListAdminTestJSON-1116729470 None] <== create_volume: return (1424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:43:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-48b70586-19ba-4d01-9587-e377ee65fb1c tempest-VolumesListAdminTestJSON-1116729470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:43:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-48b70586-19ba-4d01-9587-e377ee65fb1c tempest-VolumesListAdminTestJSON-1116729470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4fd5244-33be-46dd-8df6-b782a00b95d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cd6a29d-845b-4b47-b03a-ae8386548bf5', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-48b70586-19ba-4d01-9587-e377ee65fb1c tempest-VolumesListAdminTestJSON-1116729470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff9ad71-968e-4299-bd03-528afb986e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:22 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-48b70586-19ba-4d01-9587-e377ee65fb1c tempest-VolumesListAdminTestJSON-1116729470 None] Volume volume-3cd6a29d-845b-4b47-b03a-ae8386548bf5 (3cd6a29d-845b-4b47-b03a-ae8386548bf5): created successfully Jul 31 10:43:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-48b70586-19ba-4d01-9587-e377ee65fb1c tempest-VolumesListAdminTestJSON-1116729470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff9ad71-968e-4299-bd03-528afb986e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-48b70586-19ba-4d01-9587-e377ee65fb1c tempest-VolumesListAdminTestJSON-1116729470 None] Flow 'volume_create_manager' (5375e4b0-60eb-408e-aa61-9165ae854dde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:43:22 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-48b70586-19ba-4d01-9587-e377ee65fb1c tempest-VolumesListAdminTestJSON-1116729470 None] Created volume successfully. Jul 31 10:43:25 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-cebd6487-9fa7-41c4-8955-d26328f9f2f0 tempest-VolumesListAdminTestJSON-1116729470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:43:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cebd6487-9fa7-41c4-8955-d26328f9f2f0 tempest-VolumesListAdminTestJSON-1116729470 None] Flow 'volume_create_manager' (86607071-800a-40c1-ac45-eb53a2c3ba0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:43:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cebd6487-9fa7-41c4-8955-d26328f9f2f0 tempest-VolumesListAdminTestJSON-1116729470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b73f6803-a1e9-4b67-bf6c-96cb57475445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cebd6487-9fa7-41c4-8955-d26328f9f2f0 tempest-VolumesListAdminTestJSON-1116729470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b73f6803-a1e9-4b67-bf6c-96cb57475445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:43:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-714986315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4ab4ca9-7bdf-4052-af26-1de22f915274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d20bfb387bc94b30be730715a8f3f646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:43:25Z,use_quota=True,user_id='00c14a4b1ef44fbeb1bd67048661e1a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cebd6487-9fa7-41c4-8955-d26328f9f2f0 tempest-VolumesListAdminTestJSON-1116729470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67023890-ff4e-4561-b331-f296d2b16619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cebd6487-9fa7-41c4-8955-d26328f9f2f0 tempest-VolumesListAdminTestJSON-1116729470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67023890-ff4e-4561-b331-f296d2b16619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cebd6487-9fa7-41c4-8955-d26328f9f2f0 tempest-VolumesListAdminTestJSON-1116729470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb9379f-9437-4037-8c2f-bc32b4a4afc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cebd6487-9fa7-41c4-8955-d26328f9f2f0 tempest-VolumesListAdminTestJSON-1116729470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb9379f-9437-4037-8c2f-bc32b4a4afc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4ab4ca9-7bdf-4052-af26-1de22f915274', 'volume_name': 'volume-e4ab4ca9-7bdf-4052-af26-1de22f915274', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cebd6487-9fa7-41c4-8955-d26328f9f2f0 tempest-VolumesListAdminTestJSON-1116729470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57f72ac9-eeee-4318-b465-0b05d92cf459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cebd6487-9fa7-41c4-8955-d26328f9f2f0 tempest-VolumesListAdminTestJSON-1116729470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57f72ac9-eeee-4318-b465-0b05d92cf459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cebd6487-9fa7-41c4-8955-d26328f9f2f0 tempest-VolumesListAdminTestJSON-1116729470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87bd13d6-3936-46fe-a9bb-76644c6d84db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:25 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-cebd6487-9fa7-41c4-8955-d26328f9f2f0 tempest-VolumesListAdminTestJSON-1116729470 None] Volume e4ab4ca9-7bdf-4052-af26-1de22f915274: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4ab4ca9-7bdf-4052-af26-1de22f915274', 'volume_size': 1} Jul 31 10:43:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-cebd6487-9fa7-41c4-8955-d26328f9f2f0 tempest-VolumesListAdminTestJSON-1116729470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:43:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-cebd6487-9fa7-41c4-8955-d26328f9f2f0 tempest-VolumesListAdminTestJSON-1116729470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:43:25 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6487-9fa7-41c4-8955-d26328f9f2f0 tempest-VolumesListAdminTestJSON-1116729470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:43:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-714986315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4ab4ca9-7bdf-4052-af26-1de22f915274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d20bfb387bc94b30be730715a8f3f646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:43:25Z,use_quota=True,user_id='00c14a4b1ef44fbeb1bd67048661e1a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:43:25 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-cebd6487-9fa7-41c4-8955-d26328f9f2f0 tempest-VolumesListAdminTestJSON-1116729470 None] Creating volume e4ab4ca9-7bdf-4052-af26-1de22f915274 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:43:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-cebd6487-9fa7-41c4-8955-d26328f9f2f0 tempest-VolumesListAdminTestJSON-1116729470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:43:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-cebd6487-9fa7-41c4-8955-d26328f9f2f0 tempest-VolumesListAdminTestJSON-1116729470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:43:25 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6487-9fa7-41c4-8955-d26328f9f2f0 tempest-VolumesListAdminTestJSON-1116729470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:43:25 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6487-9fa7-41c4-8955-d26328f9f2f0 tempest-VolumesListAdminTestJSON-1116729470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:43:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-cebd6487-9fa7-41c4-8955-d26328f9f2f0 tempest-VolumesListAdminTestJSON-1116729470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:43:25 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6487-9fa7-41c4-8955-d26328f9f2f0 tempest-VolumesListAdminTestJSON-1116729470 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:43:25 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-cebd6487-9fa7-41c4-8955-d26328f9f2f0 tempest-VolumesListAdminTestJSON-1116729470 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:43:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-cebd6487-9fa7-41c4-8955-d26328f9f2f0 tempest-VolumesListAdminTestJSON-1116729470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e4ab4ca9-7bdf-4052-af26-1de22f915274 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:25 devstack sudo[93676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e4ab4ca9-7bdf-4052-af26-1de22f915274 1073741824 Jul 31 10:43:25 devstack sudo[93676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:25 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-f09dff0b-efc1-406c-846d-3a4685723d9c tempest-AttachVolumeNegativeTest-304126598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:43:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f09dff0b-efc1-406c-846d-3a4685723d9c tempest-AttachVolumeNegativeTest-304126598 None] Flow 'volume_create_manager' (5f041265-12c3-405f-b0cf-e09262112eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:43:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f09dff0b-efc1-406c-846d-3a4685723d9c tempest-AttachVolumeNegativeTest-304126598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcc644b6-3bf5-4546-a45b-dce50992879b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f09dff0b-efc1-406c-846d-3a4685723d9c tempest-AttachVolumeNegativeTest-304126598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcc644b6-3bf5-4546-a45b-dce50992879b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-523851212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf10d8be-4a7f-4826-a778-b6386c3368ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='150270d988f34405bc30eabafd7ce55d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:43:26Z,use_quota=True,user_id='060655ab58f94503b45dab890a6c4419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f09dff0b-efc1-406c-846d-3a4685723d9c tempest-AttachVolumeNegativeTest-304126598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c1cb2e3-86e3-4358-b149-508b0057065e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f09dff0b-efc1-406c-846d-3a4685723d9c tempest-AttachVolumeNegativeTest-304126598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c1cb2e3-86e3-4358-b149-508b0057065e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f09dff0b-efc1-406c-846d-3a4685723d9c tempest-AttachVolumeNegativeTest-304126598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65d3a9ff-b679-4d2e-ba07-5caf9b40cf53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f09dff0b-efc1-406c-846d-3a4685723d9c tempest-AttachVolumeNegativeTest-304126598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65d3a9ff-b679-4d2e-ba07-5caf9b40cf53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf10d8be-4a7f-4826-a778-b6386c3368ce', 'volume_name': 'volume-bf10d8be-4a7f-4826-a778-b6386c3368ce', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f09dff0b-efc1-406c-846d-3a4685723d9c tempest-AttachVolumeNegativeTest-304126598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3751144-4fb8-4b20-b33a-e41a080aea60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f09dff0b-efc1-406c-846d-3a4685723d9c tempest-AttachVolumeNegativeTest-304126598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3751144-4fb8-4b20-b33a-e41a080aea60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f09dff0b-efc1-406c-846d-3a4685723d9c tempest-AttachVolumeNegativeTest-304126598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17d35cc4-9bc4-4ca0-86fb-36fedab4cd0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:26 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-f09dff0b-efc1-406c-846d-3a4685723d9c tempest-AttachVolumeNegativeTest-304126598 None] Volume bf10d8be-4a7f-4826-a778-b6386c3368ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf10d8be-4a7f-4826-a778-b6386c3368ce', 'volume_size': 1} Jul 31 10:43:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f09dff0b-efc1-406c-846d-3a4685723d9c tempest-AttachVolumeNegativeTest-304126598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:43:26 devstack sudo[93676]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-cebd6487-9fa7-41c4-8955-d26328f9f2f0 tempest-VolumesListAdminTestJSON-1116729470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e4ab4ca9-7bdf-4052-af26-1de22f915274 1073741824" returned: 0 in 0.799s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-cebd6487-9fa7-41c4-8955-d26328f9f2f0 tempest-VolumesListAdminTestJSON-1116729470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e4ab4ca9-7bdf-4052-af26-1de22f915274 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:26 devstack sudo[93704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e4ab4ca9-7bdf-4052-af26-1de22f915274 Jul 31 10:43:26 devstack sudo[93704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:26 devstack sudo[93704]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-cebd6487-9fa7-41c4-8955-d26328f9f2f0 tempest-VolumesListAdminTestJSON-1116729470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e4ab4ca9-7bdf-4052-af26-1de22f915274" returned: 0 in 0.346s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6487-9fa7-41c4-8955-d26328f9f2f0 tempest-VolumesListAdminTestJSON-1116729470 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:43:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-cebd6487-9fa7-41c4-8955-d26328f9f2f0 tempest-VolumesListAdminTestJSON-1116729470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:43:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f09dff0b-efc1-406c-846d-3a4685723d9c tempest-AttachVolumeNegativeTest-304126598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.537s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:43:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f09dff0b-efc1-406c-846d-3a4685723d9c tempest-AttachVolumeNegativeTest-304126598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-523851212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf10d8be-4a7f-4826-a778-b6386c3368ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='150270d988f34405bc30eabafd7ce55d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:43:26Z,use_quota=True,user_id='060655ab58f94503b45dab890a6c4419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:43:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-f09dff0b-efc1-406c-846d-3a4685723d9c tempest-AttachVolumeNegativeTest-304126598 None] Creating volume bf10d8be-4a7f-4826-a778-b6386c3368ce {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:43:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f09dff0b-efc1-406c-846d-3a4685723d9c tempest-AttachVolumeNegativeTest-304126598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:43:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f09dff0b-efc1-406c-846d-3a4685723d9c tempest-AttachVolumeNegativeTest-304126598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:43:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f09dff0b-efc1-406c-846d-3a4685723d9c tempest-AttachVolumeNegativeTest-304126598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:43:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f09dff0b-efc1-406c-846d-3a4685723d9c tempest-AttachVolumeNegativeTest-304126598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:43:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f09dff0b-efc1-406c-846d-3a4685723d9c tempest-AttachVolumeNegativeTest-304126598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:43:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f09dff0b-efc1-406c-846d-3a4685723d9c tempest-AttachVolumeNegativeTest-304126598 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:43:26 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-f09dff0b-efc1-406c-846d-3a4685723d9c tempest-AttachVolumeNegativeTest-304126598 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:43:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f09dff0b-efc1-406c-846d-3a4685723d9c tempest-AttachVolumeNegativeTest-304126598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bf10d8be-4a7f-4826-a778-b6386c3368ce 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cebd6487-9fa7-41c4-8955-d26328f9f2f0 tempest-VolumesListAdminTestJSON-1116729470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87bd13d6-3936-46fe-a9bb-76644c6d84db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4ab4ca9-7bdf-4052-af26-1de22f915274', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:26 devstack sudo[93707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bf10d8be-4a7f-4826-a778-b6386c3368ce 1073741824 Jul 31 10:43:26 devstack sudo[93707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cebd6487-9fa7-41c4-8955-d26328f9f2f0 tempest-VolumesListAdminTestJSON-1116729470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d174b257-a77a-457b-a0f2-fc5655bbac74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:26 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-cebd6487-9fa7-41c4-8955-d26328f9f2f0 tempest-VolumesListAdminTestJSON-1116729470 None] Volume volume-e4ab4ca9-7bdf-4052-af26-1de22f915274 (e4ab4ca9-7bdf-4052-af26-1de22f915274): created successfully Jul 31 10:43:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cebd6487-9fa7-41c4-8955-d26328f9f2f0 tempest-VolumesListAdminTestJSON-1116729470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d174b257-a77a-457b-a0f2-fc5655bbac74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cebd6487-9fa7-41c4-8955-d26328f9f2f0 tempest-VolumesListAdminTestJSON-1116729470 None] Flow 'volume_create_manager' (86607071-800a-40c1-ac45-eb53a2c3ba0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:43:26 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-cebd6487-9fa7-41c4-8955-d26328f9f2f0 tempest-VolumesListAdminTestJSON-1116729470 None] Created volume successfully. Jul 31 10:43:27 devstack sudo[93707]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f09dff0b-efc1-406c-846d-3a4685723d9c tempest-AttachVolumeNegativeTest-304126598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bf10d8be-4a7f-4826-a778-b6386c3368ce 1073741824" returned: 0 in 0.656s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f09dff0b-efc1-406c-846d-3a4685723d9c tempest-AttachVolumeNegativeTest-304126598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bf10d8be-4a7f-4826-a778-b6386c3368ce {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:27 devstack sudo[93716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bf10d8be-4a7f-4826-a778-b6386c3368ce Jul 31 10:43:27 devstack sudo[93716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:28 devstack sudo[93716]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f09dff0b-efc1-406c-846d-3a4685723d9c tempest-AttachVolumeNegativeTest-304126598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bf10d8be-4a7f-4826-a778-b6386c3368ce" returned: 0 in 0.559s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:28 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f09dff0b-efc1-406c-846d-3a4685723d9c tempest-AttachVolumeNegativeTest-304126598 None] <== create_volume: return (1313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:43:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f09dff0b-efc1-406c-846d-3a4685723d9c tempest-AttachVolumeNegativeTest-304126598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:43:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f09dff0b-efc1-406c-846d-3a4685723d9c tempest-AttachVolumeNegativeTest-304126598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17d35cc4-9bc4-4ca0-86fb-36fedab4cd0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf10d8be-4a7f-4826-a778-b6386c3368ce', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f09dff0b-efc1-406c-846d-3a4685723d9c tempest-AttachVolumeNegativeTest-304126598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (778dbd6d-e817-42eb-88c0-571044e61231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:28 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-f09dff0b-efc1-406c-846d-3a4685723d9c tempest-AttachVolumeNegativeTest-304126598 None] Volume volume-bf10d8be-4a7f-4826-a778-b6386c3368ce (bf10d8be-4a7f-4826-a778-b6386c3368ce): created successfully Jul 31 10:43:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f09dff0b-efc1-406c-846d-3a4685723d9c tempest-AttachVolumeNegativeTest-304126598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (778dbd6d-e817-42eb-88c0-571044e61231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f09dff0b-efc1-406c-846d-3a4685723d9c tempest-AttachVolumeNegativeTest-304126598 None] Flow 'volume_create_manager' (5f041265-12c3-405f-b0cf-e09262112eb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:43:28 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-f09dff0b-efc1-406c-846d-3a4685723d9c tempest-AttachVolumeNegativeTest-304126598 None] Created volume successfully. Jul 31 10:43:28 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0fce60a-74e2-4c39-a656-8477cb8fa560 tempest-VolumesListAdminTestJSON-1116729470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:43:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f0fce60a-74e2-4c39-a656-8477cb8fa560 tempest-VolumesListAdminTestJSON-1116729470 None] Flow 'volume_create_manager' (7df82a69-5075-46cd-8dad-87d71fc9b132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:43:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f0fce60a-74e2-4c39-a656-8477cb8fa560 tempest-VolumesListAdminTestJSON-1116729470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (824a587f-ca58-404c-9385-aaab2e16c9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f0fce60a-74e2-4c39-a656-8477cb8fa560 tempest-VolumesListAdminTestJSON-1116729470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (824a587f-ca58-404c-9385-aaab2e16c9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1931642338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=353b3f43-fc98-4368-a4d7-aed33a828e82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d20bfb387bc94b30be730715a8f3f646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:43:28Z,use_quota=True,user_id='00c14a4b1ef44fbeb1bd67048661e1a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f0fce60a-74e2-4c39-a656-8477cb8fa560 tempest-VolumesListAdminTestJSON-1116729470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0be09d01-97c0-4ef9-b6d8-527f9f51eecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f0fce60a-74e2-4c39-a656-8477cb8fa560 tempest-VolumesListAdminTestJSON-1116729470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0be09d01-97c0-4ef9-b6d8-527f9f51eecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f0fce60a-74e2-4c39-a656-8477cb8fa560 tempest-VolumesListAdminTestJSON-1116729470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e31bc8-fa26-4b3c-af12-124aeab048b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f0fce60a-74e2-4c39-a656-8477cb8fa560 tempest-VolumesListAdminTestJSON-1116729470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e31bc8-fa26-4b3c-af12-124aeab048b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '353b3f43-fc98-4368-a4d7-aed33a828e82', 'volume_name': 'volume-353b3f43-fc98-4368-a4d7-aed33a828e82', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f0fce60a-74e2-4c39-a656-8477cb8fa560 tempest-VolumesListAdminTestJSON-1116729470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b188a22f-baf6-4f75-a822-305946ce42cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f0fce60a-74e2-4c39-a656-8477cb8fa560 tempest-VolumesListAdminTestJSON-1116729470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b188a22f-baf6-4f75-a822-305946ce42cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f0fce60a-74e2-4c39-a656-8477cb8fa560 tempest-VolumesListAdminTestJSON-1116729470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7a1cdd9-17b8-4596-98e1-aa4daa06676f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:28 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-f0fce60a-74e2-4c39-a656-8477cb8fa560 tempest-VolumesListAdminTestJSON-1116729470 None] Volume 353b3f43-fc98-4368-a4d7-aed33a828e82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-353b3f43-fc98-4368-a4d7-aed33a828e82', 'volume_size': 1} Jul 31 10:43:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f0fce60a-74e2-4c39-a656-8477cb8fa560 tempest-VolumesListAdminTestJSON-1116729470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:43:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f0fce60a-74e2-4c39-a656-8477cb8fa560 tempest-VolumesListAdminTestJSON-1116729470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:43:28 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f0fce60a-74e2-4c39-a656-8477cb8fa560 tempest-VolumesListAdminTestJSON-1116729470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1931642338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=353b3f43-fc98-4368-a4d7-aed33a828e82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d20bfb387bc94b30be730715a8f3f646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:43:28Z,use_quota=True,user_id='00c14a4b1ef44fbeb1bd67048661e1a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:43:28 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-f0fce60a-74e2-4c39-a656-8477cb8fa560 tempest-VolumesListAdminTestJSON-1116729470 None] Creating volume 353b3f43-fc98-4368-a4d7-aed33a828e82 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:43:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f0fce60a-74e2-4c39-a656-8477cb8fa560 tempest-VolumesListAdminTestJSON-1116729470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:43:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f0fce60a-74e2-4c39-a656-8477cb8fa560 tempest-VolumesListAdminTestJSON-1116729470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:43:28 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f0fce60a-74e2-4c39-a656-8477cb8fa560 tempest-VolumesListAdminTestJSON-1116729470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:43:28 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f0fce60a-74e2-4c39-a656-8477cb8fa560 tempest-VolumesListAdminTestJSON-1116729470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:43:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f0fce60a-74e2-4c39-a656-8477cb8fa560 tempest-VolumesListAdminTestJSON-1116729470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:43:28 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f0fce60a-74e2-4c39-a656-8477cb8fa560 tempest-VolumesListAdminTestJSON-1116729470 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:43:28 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-f0fce60a-74e2-4c39-a656-8477cb8fa560 tempest-VolumesListAdminTestJSON-1116729470 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:43:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f0fce60a-74e2-4c39-a656-8477cb8fa560 tempest-VolumesListAdminTestJSON-1116729470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-353b3f43-fc98-4368-a4d7-aed33a828e82 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:28 devstack sudo[93719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-353b3f43-fc98-4368-a4d7-aed33a828e82 1073741824 Jul 31 10:43:28 devstack sudo[93719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:29 devstack sudo[93719]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f0fce60a-74e2-4c39-a656-8477cb8fa560 tempest-VolumesListAdminTestJSON-1116729470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-353b3f43-fc98-4368-a4d7-aed33a828e82 1073741824" returned: 0 in 0.726s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f0fce60a-74e2-4c39-a656-8477cb8fa560 tempest-VolumesListAdminTestJSON-1116729470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-353b3f43-fc98-4368-a4d7-aed33a828e82 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:29 devstack sudo[93724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-353b3f43-fc98-4368-a4d7-aed33a828e82 Jul 31 10:43:29 devstack sudo[93724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:29 devstack sudo[93724]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f0fce60a-74e2-4c39-a656-8477cb8fa560 tempest-VolumesListAdminTestJSON-1116729470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-353b3f43-fc98-4368-a4d7-aed33a828e82" returned: 0 in 0.725s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:29 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f0fce60a-74e2-4c39-a656-8477cb8fa560 tempest-VolumesListAdminTestJSON-1116729470 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:43:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f0fce60a-74e2-4c39-a656-8477cb8fa560 tempest-VolumesListAdminTestJSON-1116729470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:43:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f0fce60a-74e2-4c39-a656-8477cb8fa560 tempest-VolumesListAdminTestJSON-1116729470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7a1cdd9-17b8-4596-98e1-aa4daa06676f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-353b3f43-fc98-4368-a4d7-aed33a828e82', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f0fce60a-74e2-4c39-a656-8477cb8fa560 tempest-VolumesListAdminTestJSON-1116729470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (960b4974-7c0e-42b3-a6e5-7ae71056e635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:30 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-f0fce60a-74e2-4c39-a656-8477cb8fa560 tempest-VolumesListAdminTestJSON-1116729470 None] Volume volume-353b3f43-fc98-4368-a4d7-aed33a828e82 (353b3f43-fc98-4368-a4d7-aed33a828e82): created successfully Jul 31 10:43:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f0fce60a-74e2-4c39-a656-8477cb8fa560 tempest-VolumesListAdminTestJSON-1116729470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (960b4974-7c0e-42b3-a6e5-7ae71056e635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f0fce60a-74e2-4c39-a656-8477cb8fa560 tempest-VolumesListAdminTestJSON-1116729470 None] Flow 'volume_create_manager' (7df82a69-5075-46cd-8dad-87d71fc9b132) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:43:30 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-f0fce60a-74e2-4c39-a656-8477cb8fa560 tempest-VolumesListAdminTestJSON-1116729470 None] Created volume successfully. Jul 31 10:43:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-c21cc7a1-e84b-4574-a70a-f9c82a5d561b req-474a75d5-c178-4885-90ff-09a69972120c tempest-AttachVolumeNegativeTest-304126598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:43:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-c21cc7a1-e84b-4574-a70a-f9c82a5d561b req-474a75d5-c178-4885-90ff-09a69972120c tempest-AttachVolumeNegativeTest-304126598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:43:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-c21cc7a1-e84b-4574-a70a-f9c82a5d561b req-474a75d5-c178-4885-90ff-09a69972120c tempest-AttachVolumeNegativeTest-304126598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:43:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-c21cc7a1-e84b-4574-a70a-f9c82a5d561b req-474a75d5-c178-4885-90ff-09a69972120c tempest-AttachVolumeNegativeTest-304126598 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c', 'name': 'volume-bf10d8be-4a7f-4826-a778-b6386c3368ce', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c7085d1e-7a9d-4b5e-9653-9b012dced429', 'enforce_multipath': True} {{(pid=89090) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:43:31 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-c21cc7a1-e84b-4574-a70a-f9c82a5d561b req-474a75d5-c178-4885-90ff-09a69972120c tempest-AttachVolumeNegativeTest-304126598 None] attachment_update completed successfully. Jul 31 10:43:32 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9f8d719-01c1-4bec-8be1-8df380115f74 tempest-VolumesListAdminTestJSON-992960513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:43:32 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d9f8d719-01c1-4bec-8be1-8df380115f74 tempest-VolumesListAdminTestJSON-992960513 None] Flow 'volume_create_manager' (61127d4a-ea8c-49f7-97d8-3ed806613586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:43:32 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d9f8d719-01c1-4bec-8be1-8df380115f74 tempest-VolumesListAdminTestJSON-992960513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ebaf083-232c-49cd-be63-dc9d4c18f020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:32 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d9f8d719-01c1-4bec-8be1-8df380115f74 tempest-VolumesListAdminTestJSON-992960513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ebaf083-232c-49cd-be63-dc9d4c18f020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc16d6ac-c60e-4ce5-bfbc-75f569e291ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a8164065cc04415b7fd83e7ca135dc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:43:32Z,use_quota=True,user_id='6660522213cc42e9a124aae9b5ba4a01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:32 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d9f8d719-01c1-4bec-8be1-8df380115f74 tempest-VolumesListAdminTestJSON-992960513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84785e99-cd0f-4180-bf80-74af80bbda4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:32 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d9f8d719-01c1-4bec-8be1-8df380115f74 tempest-VolumesListAdminTestJSON-992960513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84785e99-cd0f-4180-bf80-74af80bbda4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:32 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d9f8d719-01c1-4bec-8be1-8df380115f74 tempest-VolumesListAdminTestJSON-992960513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67823937-f5c3-444e-ad1a-5c684b2dae96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:32 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d9f8d719-01c1-4bec-8be1-8df380115f74 tempest-VolumesListAdminTestJSON-992960513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67823937-f5c3-444e-ad1a-5c684b2dae96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc16d6ac-c60e-4ce5-bfbc-75f569e291ca', 'volume_name': 'volume-bc16d6ac-c60e-4ce5-bfbc-75f569e291ca', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:32 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d9f8d719-01c1-4bec-8be1-8df380115f74 tempest-VolumesListAdminTestJSON-992960513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54a63158-46fe-4e95-b9e7-661bb8e642ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:32 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d9f8d719-01c1-4bec-8be1-8df380115f74 tempest-VolumesListAdminTestJSON-992960513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54a63158-46fe-4e95-b9e7-661bb8e642ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:32 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d9f8d719-01c1-4bec-8be1-8df380115f74 tempest-VolumesListAdminTestJSON-992960513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c194f6-cc47-4d11-a75d-c092c65d007e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:32 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-d9f8d719-01c1-4bec-8be1-8df380115f74 tempest-VolumesListAdminTestJSON-992960513 None] Volume bc16d6ac-c60e-4ce5-bfbc-75f569e291ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc16d6ac-c60e-4ce5-bfbc-75f569e291ca', 'volume_size': 1} Jul 31 10:43:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d9f8d719-01c1-4bec-8be1-8df380115f74 tempest-VolumesListAdminTestJSON-992960513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:43:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d9f8d719-01c1-4bec-8be1-8df380115f74 tempest-VolumesListAdminTestJSON-992960513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:43:32 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d9f8d719-01c1-4bec-8be1-8df380115f74 tempest-VolumesListAdminTestJSON-992960513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc16d6ac-c60e-4ce5-bfbc-75f569e291ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a8164065cc04415b7fd83e7ca135dc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:43:32Z,use_quota=True,user_id='6660522213cc42e9a124aae9b5ba4a01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:43:32 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-d9f8d719-01c1-4bec-8be1-8df380115f74 tempest-VolumesListAdminTestJSON-992960513 None] Creating volume bc16d6ac-c60e-4ce5-bfbc-75f569e291ca {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:43:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d9f8d719-01c1-4bec-8be1-8df380115f74 tempest-VolumesListAdminTestJSON-992960513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:43:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d9f8d719-01c1-4bec-8be1-8df380115f74 tempest-VolumesListAdminTestJSON-992960513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:43:32 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d9f8d719-01c1-4bec-8be1-8df380115f74 tempest-VolumesListAdminTestJSON-992960513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:43:32 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d9f8d719-01c1-4bec-8be1-8df380115f74 tempest-VolumesListAdminTestJSON-992960513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:43:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d9f8d719-01c1-4bec-8be1-8df380115f74 tempest-VolumesListAdminTestJSON-992960513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:43:32 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d9f8d719-01c1-4bec-8be1-8df380115f74 tempest-VolumesListAdminTestJSON-992960513 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:43:32 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-d9f8d719-01c1-4bec-8be1-8df380115f74 tempest-VolumesListAdminTestJSON-992960513 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:43:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d9f8d719-01c1-4bec-8be1-8df380115f74 tempest-VolumesListAdminTestJSON-992960513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bc16d6ac-c60e-4ce5-bfbc-75f569e291ca 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:32 devstack sudo[94155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bc16d6ac-c60e-4ce5-bfbc-75f569e291ca 1073741824 Jul 31 10:43:32 devstack sudo[94155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:33 devstack sudo[94155]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d9f8d719-01c1-4bec-8be1-8df380115f74 tempest-VolumesListAdminTestJSON-992960513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bc16d6ac-c60e-4ce5-bfbc-75f569e291ca 1073741824" returned: 0 in 0.856s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d9f8d719-01c1-4bec-8be1-8df380115f74 tempest-VolumesListAdminTestJSON-992960513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bc16d6ac-c60e-4ce5-bfbc-75f569e291ca {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:33 devstack sudo[94161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bc16d6ac-c60e-4ce5-bfbc-75f569e291ca Jul 31 10:43:33 devstack sudo[94161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:33 devstack sudo[94161]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d9f8d719-01c1-4bec-8be1-8df380115f74 tempest-VolumesListAdminTestJSON-992960513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bc16d6ac-c60e-4ce5-bfbc-75f569e291ca" returned: 0 in 0.283s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:33 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d9f8d719-01c1-4bec-8be1-8df380115f74 tempest-VolumesListAdminTestJSON-992960513 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:43:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d9f8d719-01c1-4bec-8be1-8df380115f74 tempest-VolumesListAdminTestJSON-992960513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:43:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d9f8d719-01c1-4bec-8be1-8df380115f74 tempest-VolumesListAdminTestJSON-992960513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c194f6-cc47-4d11-a75d-c092c65d007e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc16d6ac-c60e-4ce5-bfbc-75f569e291ca', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d9f8d719-01c1-4bec-8be1-8df380115f74 tempest-VolumesListAdminTestJSON-992960513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d07f0baa-b62b-4368-ae5f-c672e7df98e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:33 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-d9f8d719-01c1-4bec-8be1-8df380115f74 tempest-VolumesListAdminTestJSON-992960513 None] Volume volume-bc16d6ac-c60e-4ce5-bfbc-75f569e291ca (bc16d6ac-c60e-4ce5-bfbc-75f569e291ca): created successfully Jul 31 10:43:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d9f8d719-01c1-4bec-8be1-8df380115f74 tempest-VolumesListAdminTestJSON-992960513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d07f0baa-b62b-4368-ae5f-c672e7df98e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d9f8d719-01c1-4bec-8be1-8df380115f74 tempest-VolumesListAdminTestJSON-992960513 None] Flow 'volume_create_manager' (61127d4a-ea8c-49f7-97d8-3ed806613586) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:43:33 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-d9f8d719-01c1-4bec-8be1-8df380115f74 tempest-VolumesListAdminTestJSON-992960513 None] Created volume successfully. Jul 31 10:43:34 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-bd3220ed-1def-4752-90ae-6fefdc3628bb tempest-VolumesListAdminTestJSON-992960513 None] Acquiring lock "cinder-bc16d6ac-c60e-4ce5-bfbc-75f569e291ca-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:43:34 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-bd3220ed-1def-4752-90ae-6fefdc3628bb tempest-VolumesListAdminTestJSON-992960513 None] Lock "cinder-bc16d6ac-c60e-4ce5-bfbc-75f569e291ca-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:43:34 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-bd3220ed-1def-4752-90ae-6fefdc3628bb tempest-VolumesListAdminTestJSON-992960513 None] Acquiring lock "cinder-quobyte-bc16d6ac-c60e-4ce5-bfbc-75f569e291ca" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:43:34 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-bd3220ed-1def-4752-90ae-6fefdc3628bb tempest-VolumesListAdminTestJSON-992960513 None] Lock "cinder-quobyte-bc16d6ac-c60e-4ce5-bfbc-75f569e291ca" acquired by "delete_volume" :: waited 0.052s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:43:34 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee60ca26-9eb5-49de-b0af-9d0f5768b48f]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:43:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bd3220ed-1def-4752-90ae-6fefdc3628bb tempest-VolumesListAdminTestJSON-992960513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bc16d6ac-c60e-4ce5-bfbc-75f569e291ca {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:34 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b8bb246-40b7-4057-9834-f3c50e784256 tempest-ServersNegativeTestJSON-2137225051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:43:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6b8bb246-40b7-4057-9834-f3c50e784256 tempest-ServersNegativeTestJSON-2137225051 None] Flow 'volume_create_manager' (64b1219c-a7db-49cb-a195-872ca51d12cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:43:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6b8bb246-40b7-4057-9834-f3c50e784256 tempest-ServersNegativeTestJSON-2137225051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cb88c79-13ae-4bde-a201-1f08c631bb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:34 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ae94608b-b627-46f1-b03f-4510d94d1195 tempest-VolumesListAdminTestJSON-1116729470 None] Acquiring lock "cinder-353b3f43-fc98-4368-a4d7-aed33a828e82-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:43:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6b8bb246-40b7-4057-9834-f3c50e784256 tempest-ServersNegativeTestJSON-2137225051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cb88c79-13ae-4bde-a201-1f08c631bb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-582474934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c08b0cb-f305-45b7-8d6d-f01c7b3e0a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4707c7f72c3345c8b973cd1ace305ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:43:35Z,use_quota=True,user_id='4d22ac74c6a54f6fb4ddbb07913231e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6b8bb246-40b7-4057-9834-f3c50e784256 tempest-ServersNegativeTestJSON-2137225051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a83e471f-06de-4733-bf01-d5bd9a225c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6b8bb246-40b7-4057-9834-f3c50e784256 tempest-ServersNegativeTestJSON-2137225051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a83e471f-06de-4733-bf01-d5bd9a225c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6b8bb246-40b7-4057-9834-f3c50e784256 tempest-ServersNegativeTestJSON-2137225051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d93c195d-ee03-4b59-b9ca-4000eb170b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6b8bb246-40b7-4057-9834-f3c50e784256 tempest-ServersNegativeTestJSON-2137225051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d93c195d-ee03-4b59-b9ca-4000eb170b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c08b0cb-f305-45b7-8d6d-f01c7b3e0a3d', 'volume_name': 'volume-5c08b0cb-f305-45b7-8d6d-f01c7b3e0a3d', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6b8bb246-40b7-4057-9834-f3c50e784256 tempest-ServersNegativeTestJSON-2137225051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad771feb-224c-4ab6-8b0c-e1a107356f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6b8bb246-40b7-4057-9834-f3c50e784256 tempest-ServersNegativeTestJSON-2137225051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad771feb-224c-4ab6-8b0c-e1a107356f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6b8bb246-40b7-4057-9834-f3c50e784256 tempest-ServersNegativeTestJSON-2137225051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f932e96-7c20-4dfb-80d8-2225136466ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:35 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-6b8bb246-40b7-4057-9834-f3c50e784256 tempest-ServersNegativeTestJSON-2137225051 None] Volume 5c08b0cb-f305-45b7-8d6d-f01c7b3e0a3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c08b0cb-f305-45b7-8d6d-f01c7b3e0a3d', 'volume_size': 1} Jul 31 10:43:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6b8bb246-40b7-4057-9834-f3c50e784256 tempest-ServersNegativeTestJSON-2137225051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:43:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6b8bb246-40b7-4057-9834-f3c50e784256 tempest-ServersNegativeTestJSON-2137225051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:43:35 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-6b8bb246-40b7-4057-9834-f3c50e784256 tempest-ServersNegativeTestJSON-2137225051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-582474934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c08b0cb-f305-45b7-8d6d-f01c7b3e0a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4707c7f72c3345c8b973cd1ace305ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:43:35Z,use_quota=True,user_id='4d22ac74c6a54f6fb4ddbb07913231e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:43:35 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-6b8bb246-40b7-4057-9834-f3c50e784256 tempest-ServersNegativeTestJSON-2137225051 None] Creating volume 5c08b0cb-f305-45b7-8d6d-f01c7b3e0a3d {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:43:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6b8bb246-40b7-4057-9834-f3c50e784256 tempest-ServersNegativeTestJSON-2137225051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:43:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6b8bb246-40b7-4057-9834-f3c50e784256 tempest-ServersNegativeTestJSON-2137225051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:43:35 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-6b8bb246-40b7-4057-9834-f3c50e784256 tempest-ServersNegativeTestJSON-2137225051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:43:35 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-6b8bb246-40b7-4057-9834-f3c50e784256 tempest-ServersNegativeTestJSON-2137225051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:43:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6b8bb246-40b7-4057-9834-f3c50e784256 tempest-ServersNegativeTestJSON-2137225051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:43:35 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-6b8bb246-40b7-4057-9834-f3c50e784256 tempest-ServersNegativeTestJSON-2137225051 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:43:35 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-6b8bb246-40b7-4057-9834-f3c50e784256 tempest-ServersNegativeTestJSON-2137225051 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:43:35 devstack sudo[94166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bc16d6ac-c60e-4ce5-bfbc-75f569e291ca Jul 31 10:43:35 devstack sudo[94166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6b8bb246-40b7-4057-9834-f3c50e784256 tempest-ServersNegativeTestJSON-2137225051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5c08b0cb-f305-45b7-8d6d-f01c7b3e0a3d 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:35 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ae94608b-b627-46f1-b03f-4510d94d1195 tempest-VolumesListAdminTestJSON-1116729470 None] Lock "cinder-353b3f43-fc98-4368-a4d7-aed33a828e82-delete_volume" acquired by "delete_volume" :: waited 0.136s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:43:35 devstack sudo[94169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5c08b0cb-f305-45b7-8d6d-f01c7b3e0a3d 1073741824 Jul 31 10:43:35 devstack sudo[94169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:35 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ae94608b-b627-46f1-b03f-4510d94d1195 tempest-VolumesListAdminTestJSON-1116729470 None] Acquiring lock "cinder-quobyte-353b3f43-fc98-4368-a4d7-aed33a828e82" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:43:35 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ae94608b-b627-46f1-b03f-4510d94d1195 tempest-VolumesListAdminTestJSON-1116729470 None] Lock "cinder-quobyte-353b3f43-fc98-4368-a4d7-aed33a828e82" acquired by "delete_volume" :: waited 0.026s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:43:35 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[2faca71b-0b14-4b18-a669-ea1655dc9d05]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:43:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ae94608b-b627-46f1-b03f-4510d94d1195 tempest-VolumesListAdminTestJSON-1116729470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-353b3f43-fc98-4368-a4d7-aed33a828e82 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:35 devstack sudo[94166]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:35 devstack sudo[94173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-353b3f43-fc98-4368-a4d7-aed33a828e82 Jul 31 10:43:35 devstack sudo[94173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bd3220ed-1def-4752-90ae-6fefdc3628bb tempest-VolumesListAdminTestJSON-992960513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bc16d6ac-c60e-4ce5-bfbc-75f569e291ca" returned: 0 in 0.584s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bd3220ed-1def-4752-90ae-6fefdc3628bb tempest-VolumesListAdminTestJSON-992960513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bc16d6ac-c60e-4ce5-bfbc-75f569e291ca {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:35 devstack sudo[94208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bc16d6ac-c60e-4ce5-bfbc-75f569e291ca Jul 31 10:43:35 devstack sudo[94208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:35 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-d3ea71b8-ef89-4667-82e9-b673445ccef9 req-9551c633-f360-4cf9-b426-5b69fd41bceb tempest-AttachVolumeNegativeTest-304126598 None] Terminate volume connection completed successfully. Jul 31 10:43:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-d3ea71b8-ef89-4667-82e9-b673445ccef9 req-9551c633-f360-4cf9-b426-5b69fd41bceb tempest-AttachVolumeNegativeTest-304126598 None] Deleting attachment c7085d1e-7a9d-4b5e-9653-9b012dced429. {{(pid=89090) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:43:35 devstack sudo[94169]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6b8bb246-40b7-4057-9834-f3c50e784256 tempest-ServersNegativeTestJSON-2137225051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5c08b0cb-f305-45b7-8d6d-f01c7b3e0a3d 1073741824" returned: 0 in 0.751s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6b8bb246-40b7-4057-9834-f3c50e784256 tempest-ServersNegativeTestJSON-2137225051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5c08b0cb-f305-45b7-8d6d-f01c7b3e0a3d {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:35 devstack sudo[94214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5c08b0cb-f305-45b7-8d6d-f01c7b3e0a3d Jul 31 10:43:35 devstack sudo[94214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:35 devstack sudo[94173]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ae94608b-b627-46f1-b03f-4510d94d1195 tempest-VolumesListAdminTestJSON-1116729470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-353b3f43-fc98-4368-a4d7-aed33a828e82" returned: 0 in 0.713s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ae94608b-b627-46f1-b03f-4510d94d1195 tempest-VolumesListAdminTestJSON-1116729470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-353b3f43-fc98-4368-a4d7-aed33a828e82 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:35 devstack sudo[94217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-353b3f43-fc98-4368-a4d7-aed33a828e82 Jul 31 10:43:35 devstack sudo[94217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:36 devstack sudo[94208]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bd3220ed-1def-4752-90ae-6fefdc3628bb tempest-VolumesListAdminTestJSON-992960513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bc16d6ac-c60e-4ce5-bfbc-75f569e291ca" returned: 0 in 0.575s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:36 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-bd3220ed-1def-4752-90ae-6fefdc3628bb tempest-VolumesListAdminTestJSON-992960513 None] Lock "cinder-quobyte-bc16d6ac-c60e-4ce5-bfbc-75f569e291ca" released by "delete_volume" :: held 1.236s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:43:36 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-bd3220ed-1def-4752-90ae-6fefdc3628bb tempest-VolumesListAdminTestJSON-992960513 None] Created reservations ['3f0754a2-b9ec-41c0-a787-daae4abc55e1', 'fbd8d9d6-ea01-4d54-809f-bd86a69f8cab', '22dce806-64b4-4e8a-b3d1-fc1f0cf4e382', '923cd74d-54ee-438f-91a2-7842ed4f7bfd'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:43:36 devstack sudo[94214]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6b8bb246-40b7-4057-9834-f3c50e784256 tempest-ServersNegativeTestJSON-2137225051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5c08b0cb-f305-45b7-8d6d-f01c7b3e0a3d" returned: 0 in 0.360s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:36 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-6b8bb246-40b7-4057-9834-f3c50e784256 tempest-ServersNegativeTestJSON-2137225051 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:43:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6b8bb246-40b7-4057-9834-f3c50e784256 tempest-ServersNegativeTestJSON-2137225051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:43:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6b8bb246-40b7-4057-9834-f3c50e784256 tempest-ServersNegativeTestJSON-2137225051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f932e96-7c20-4dfb-80d8-2225136466ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c08b0cb-f305-45b7-8d6d-f01c7b3e0a3d', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6b8bb246-40b7-4057-9834-f3c50e784256 tempest-ServersNegativeTestJSON-2137225051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08184fdc-5026-468c-8391-8d9c3ff52304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:36 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-6b8bb246-40b7-4057-9834-f3c50e784256 tempest-ServersNegativeTestJSON-2137225051 None] Volume volume-5c08b0cb-f305-45b7-8d6d-f01c7b3e0a3d (5c08b0cb-f305-45b7-8d6d-f01c7b3e0a3d): created successfully Jul 31 10:43:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6b8bb246-40b7-4057-9834-f3c50e784256 tempest-ServersNegativeTestJSON-2137225051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08184fdc-5026-468c-8391-8d9c3ff52304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6b8bb246-40b7-4057-9834-f3c50e784256 tempest-ServersNegativeTestJSON-2137225051 None] Flow 'volume_create_manager' (64b1219c-a7db-49cb-a195-872ca51d12cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:43:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-bd3220ed-1def-4752-90ae-6fefdc3628bb tempest-VolumesListAdminTestJSON-992960513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:43:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-bd3220ed-1def-4752-90ae-6fefdc3628bb tempest-VolumesListAdminTestJSON-992960513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:43:36 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-bd3220ed-1def-4752-90ae-6fefdc3628bb tempest-VolumesListAdminTestJSON-992960513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:43:36 devstack sudo[94217]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:36 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-bd3220ed-1def-4752-90ae-6fefdc3628bb tempest-VolumesListAdminTestJSON-992960513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:43:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-bd3220ed-1def-4752-90ae-6fefdc3628bb tempest-VolumesListAdminTestJSON-992960513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:43:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bd3220ed-1def-4752-90ae-6fefdc3628bb tempest-VolumesListAdminTestJSON-992960513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ae94608b-b627-46f1-b03f-4510d94d1195 tempest-VolumesListAdminTestJSON-1116729470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-353b3f43-fc98-4368-a4d7-aed33a828e82" returned: 0 in 0.389s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:36 devstack sudo[94221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:43:36 devstack sudo[94221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:36 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-6b8bb246-40b7-4057-9834-f3c50e784256 tempest-ServersNegativeTestJSON-2137225051 None] Created volume successfully. Jul 31 10:43:36 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ae94608b-b627-46f1-b03f-4510d94d1195 tempest-VolumesListAdminTestJSON-1116729470 None] Lock "cinder-quobyte-353b3f43-fc98-4368-a4d7-aed33a828e82" released by "delete_volume" :: held 1.195s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:43:36 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-ae94608b-b627-46f1-b03f-4510d94d1195 tempest-VolumesListAdminTestJSON-1116729470 None] Created reservations ['ac260ef9-97a3-4a30-ad0d-3b7e4a59ec56', 'e5cfc151-c74f-42f6-9a31-7875edf5b45e', '042e8307-8c25-4c03-a024-73b71f262bb4', 'a0ccd57e-b056-4b8e-ab47-a3d6f8b69d19'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:43:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ae94608b-b627-46f1-b03f-4510d94d1195 tempest-VolumesListAdminTestJSON-1116729470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:43:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ae94608b-b627-46f1-b03f-4510d94d1195 tempest-VolumesListAdminTestJSON-1116729470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:43:36 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ae94608b-b627-46f1-b03f-4510d94d1195 tempest-VolumesListAdminTestJSON-1116729470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:43:36 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ae94608b-b627-46f1-b03f-4510d94d1195 tempest-VolumesListAdminTestJSON-1116729470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:43:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ae94608b-b627-46f1-b03f-4510d94d1195 tempest-VolumesListAdminTestJSON-1116729470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:43:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ae94608b-b627-46f1-b03f-4510d94d1195 tempest-VolumesListAdminTestJSON-1116729470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:36 devstack sudo[94221]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bd3220ed-1def-4752-90ae-6fefdc3628bb tempest-VolumesListAdminTestJSON-992960513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.340s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:36 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-bd3220ed-1def-4752-90ae-6fefdc3628bb tempest-VolumesListAdminTestJSON-992960513 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:43:36 devstack sudo[94226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:43:36 devstack sudo[94226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:36 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-bd3220ed-1def-4752-90ae-6fefdc3628bb tempest-VolumesListAdminTestJSON-992960513 None] Deleted volume successfully. Jul 31 10:43:36 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-bd3220ed-1def-4752-90ae-6fefdc3628bb tempest-VolumesListAdminTestJSON-992960513 None] Lock "cinder-bc16d6ac-c60e-4ce5-bfbc-75f569e291ca-delete_volume" released by "delete_volume" :: held 2.066s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:43:36 devstack sudo[94226]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ae94608b-b627-46f1-b03f-4510d94d1195 tempest-VolumesListAdminTestJSON-1116729470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.353s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:36 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-ae94608b-b627-46f1-b03f-4510d94d1195 tempest-VolumesListAdminTestJSON-1116729470 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:43:36 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-ae94608b-b627-46f1-b03f-4510d94d1195 tempest-VolumesListAdminTestJSON-1116729470 None] Deleted volume successfully. Jul 31 10:43:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ae94608b-b627-46f1-b03f-4510d94d1195 tempest-VolumesListAdminTestJSON-1116729470 None] Lock "cinder-353b3f43-fc98-4368-a4d7-aed33a828e82-delete_volume" released by "delete_volume" :: held 1.946s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:43:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-4b6ff69d-0f6f-4791-8a95-2180d30b610c tempest-VolumesListAdminTestJSON-1116729470 None] Acquiring lock "cinder-e4ab4ca9-7bdf-4052-af26-1de22f915274-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:43:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-4b6ff69d-0f6f-4791-8a95-2180d30b610c tempest-VolumesListAdminTestJSON-1116729470 None] Lock "cinder-e4ab4ca9-7bdf-4052-af26-1de22f915274-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:43:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-4b6ff69d-0f6f-4791-8a95-2180d30b610c tempest-VolumesListAdminTestJSON-1116729470 None] Acquiring lock "cinder-quobyte-e4ab4ca9-7bdf-4052-af26-1de22f915274" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:43:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-4b6ff69d-0f6f-4791-8a95-2180d30b610c tempest-VolumesListAdminTestJSON-1116729470 None] Lock "cinder-quobyte-e4ab4ca9-7bdf-4052-af26-1de22f915274" acquired by "delete_volume" :: waited 0.028s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:43:37 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c24962c-496d-4789-9234-9dd6cee435e0]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:43:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4b6ff69d-0f6f-4791-8a95-2180d30b610c tempest-VolumesListAdminTestJSON-1116729470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e4ab4ca9-7bdf-4052-af26-1de22f915274 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:37 devstack sudo[94234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e4ab4ca9-7bdf-4052-af26-1de22f915274 Jul 31 10:43:37 devstack sudo[94234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:38 devstack sudo[94234]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4b6ff69d-0f6f-4791-8a95-2180d30b610c tempest-VolumesListAdminTestJSON-1116729470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e4ab4ca9-7bdf-4052-af26-1de22f915274" returned: 0 in 0.685s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4b6ff69d-0f6f-4791-8a95-2180d30b610c tempest-VolumesListAdminTestJSON-1116729470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e4ab4ca9-7bdf-4052-af26-1de22f915274 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:38 devstack sudo[94260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e4ab4ca9-7bdf-4052-af26-1de22f915274 Jul 31 10:43:38 devstack sudo[94260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:38 devstack sudo[94260]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4b6ff69d-0f6f-4791-8a95-2180d30b610c tempest-VolumesListAdminTestJSON-1116729470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e4ab4ca9-7bdf-4052-af26-1de22f915274" returned: 0 in 0.385s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:38 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-4b6ff69d-0f6f-4791-8a95-2180d30b610c tempest-VolumesListAdminTestJSON-1116729470 None] Lock "cinder-quobyte-e4ab4ca9-7bdf-4052-af26-1de22f915274" released by "delete_volume" :: held 1.148s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:43:38 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-4b6ff69d-0f6f-4791-8a95-2180d30b610c tempest-VolumesListAdminTestJSON-1116729470 None] Created reservations ['9778ec74-bd56-49dc-ad5f-b6076a897e39', '2a19e330-30b6-4401-8068-d83375ba5d9c', 'af0ac976-3439-487c-bd8e-9046fabc3e80', '6232e7b7-5823-49ec-834f-0f2f293fc031'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:43:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4b6ff69d-0f6f-4791-8a95-2180d30b610c tempest-VolumesListAdminTestJSON-1116729470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:43:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4b6ff69d-0f6f-4791-8a95-2180d30b610c tempest-VolumesListAdminTestJSON-1116729470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:43:38 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4b6ff69d-0f6f-4791-8a95-2180d30b610c tempest-VolumesListAdminTestJSON-1116729470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:43:38 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4b6ff69d-0f6f-4791-8a95-2180d30b610c tempest-VolumesListAdminTestJSON-1116729470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:43:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4b6ff69d-0f6f-4791-8a95-2180d30b610c tempest-VolumesListAdminTestJSON-1116729470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:43:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4b6ff69d-0f6f-4791-8a95-2180d30b610c tempest-VolumesListAdminTestJSON-1116729470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:38 devstack sudo[94263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:43:38 devstack sudo[94263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:39 devstack sudo[94263]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4b6ff69d-0f6f-4791-8a95-2180d30b610c tempest-VolumesListAdminTestJSON-1116729470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.385s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:39 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-4b6ff69d-0f6f-4791-8a95-2180d30b610c tempest-VolumesListAdminTestJSON-1116729470 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:43:39 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-4b6ff69d-0f6f-4791-8a95-2180d30b610c tempest-VolumesListAdminTestJSON-1116729470 None] Deleted volume successfully. Jul 31 10:43:39 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-4b6ff69d-0f6f-4791-8a95-2180d30b610c tempest-VolumesListAdminTestJSON-1116729470 None] Lock "cinder-e4ab4ca9-7bdf-4052-af26-1de22f915274-delete_volume" released by "delete_volume" :: held 1.946s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:43:39 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-dee022c1-ec9f-4c77-b8eb-dfd4e0f3c2cc tempest-ServersNegativeTestJSON-2137225051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:43:39 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dee022c1-ec9f-4c77-b8eb-dfd4e0f3c2cc tempest-ServersNegativeTestJSON-2137225051 None] Flow 'volume_create_manager' (ecb3877a-6e33-4f62-86ec-7f404c0ba05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:43:39 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dee022c1-ec9f-4c77-b8eb-dfd4e0f3c2cc tempest-ServersNegativeTestJSON-2137225051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5496a44-d4c1-442f-a475-3610829f5bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:39 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dee022c1-ec9f-4c77-b8eb-dfd4e0f3c2cc tempest-ServersNegativeTestJSON-2137225051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5496a44-d4c1-442f-a475-3610829f5bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:43:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1743610646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a3f3f21-3e77-4d74-a2ab-04fb0a3f1ab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4707c7f72c3345c8b973cd1ace305ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:43:40Z,use_quota=True,user_id='4d22ac74c6a54f6fb4ddbb07913231e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:39 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dee022c1-ec9f-4c77-b8eb-dfd4e0f3c2cc tempest-ServersNegativeTestJSON-2137225051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d5f959c-6a41-467e-8c4e-6758835e0cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:39 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dee022c1-ec9f-4c77-b8eb-dfd4e0f3c2cc tempest-ServersNegativeTestJSON-2137225051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d5f959c-6a41-467e-8c4e-6758835e0cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:39 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dee022c1-ec9f-4c77-b8eb-dfd4e0f3c2cc tempest-ServersNegativeTestJSON-2137225051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d52bdf7-de3c-4faf-b832-1edfe411210b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:39 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dee022c1-ec9f-4c77-b8eb-dfd4e0f3c2cc tempest-ServersNegativeTestJSON-2137225051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d52bdf7-de3c-4faf-b832-1edfe411210b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a3f3f21-3e77-4d74-a2ab-04fb0a3f1ab6', 'volume_name': 'volume-1a3f3f21-3e77-4d74-a2ab-04fb0a3f1ab6', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:39 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dee022c1-ec9f-4c77-b8eb-dfd4e0f3c2cc tempest-ServersNegativeTestJSON-2137225051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa32d921-61fd-4a23-964e-19df3a49b4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:39 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dee022c1-ec9f-4c77-b8eb-dfd4e0f3c2cc tempest-ServersNegativeTestJSON-2137225051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa32d921-61fd-4a23-964e-19df3a49b4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:39 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dee022c1-ec9f-4c77-b8eb-dfd4e0f3c2cc tempest-ServersNegativeTestJSON-2137225051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3e8194a-9a7c-4e24-8e80-7fa1fe54d03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:39 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-dee022c1-ec9f-4c77-b8eb-dfd4e0f3c2cc tempest-ServersNegativeTestJSON-2137225051 None] Volume 1a3f3f21-3e77-4d74-a2ab-04fb0a3f1ab6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a3f3f21-3e77-4d74-a2ab-04fb0a3f1ab6', 'volume_size': 1} Jul 31 10:43:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-dee022c1-ec9f-4c77-b8eb-dfd4e0f3c2cc tempest-ServersNegativeTestJSON-2137225051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:43:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-dee022c1-ec9f-4c77-b8eb-dfd4e0f3c2cc tempest-ServersNegativeTestJSON-2137225051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:43:39 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-dee022c1-ec9f-4c77-b8eb-dfd4e0f3c2cc tempest-ServersNegativeTestJSON-2137225051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:43:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1743610646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a3f3f21-3e77-4d74-a2ab-04fb0a3f1ab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4707c7f72c3345c8b973cd1ace305ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:43:40Z,use_quota=True,user_id='4d22ac74c6a54f6fb4ddbb07913231e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:43:39 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-dee022c1-ec9f-4c77-b8eb-dfd4e0f3c2cc tempest-ServersNegativeTestJSON-2137225051 None] Creating volume 1a3f3f21-3e77-4d74-a2ab-04fb0a3f1ab6 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:43:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-dee022c1-ec9f-4c77-b8eb-dfd4e0f3c2cc tempest-ServersNegativeTestJSON-2137225051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:43:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-dee022c1-ec9f-4c77-b8eb-dfd4e0f3c2cc tempest-ServersNegativeTestJSON-2137225051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:43:39 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-dee022c1-ec9f-4c77-b8eb-dfd4e0f3c2cc tempest-ServersNegativeTestJSON-2137225051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:43:39 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-dee022c1-ec9f-4c77-b8eb-dfd4e0f3c2cc tempest-ServersNegativeTestJSON-2137225051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:43:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-dee022c1-ec9f-4c77-b8eb-dfd4e0f3c2cc tempest-ServersNegativeTestJSON-2137225051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:43:39 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-dee022c1-ec9f-4c77-b8eb-dfd4e0f3c2cc tempest-ServersNegativeTestJSON-2137225051 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:43:39 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-dee022c1-ec9f-4c77-b8eb-dfd4e0f3c2cc tempest-ServersNegativeTestJSON-2137225051 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:43:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dee022c1-ec9f-4c77-b8eb-dfd4e0f3c2cc tempest-ServersNegativeTestJSON-2137225051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1a3f3f21-3e77-4d74-a2ab-04fb0a3f1ab6 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:39 devstack sudo[94268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1a3f3f21-3e77-4d74-a2ab-04fb0a3f1ab6 1073741824 Jul 31 10:43:39 devstack sudo[94268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:39 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e0b8e292-9aa1-4dc5-a45c-df60a2dc135d tempest-VolumesListAdminTestJSON-1116729470 None] Acquiring lock "cinder-3cd6a29d-845b-4b47-b03a-ae8386548bf5-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:43:39 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e0b8e292-9aa1-4dc5-a45c-df60a2dc135d tempest-VolumesListAdminTestJSON-1116729470 None] Lock "cinder-3cd6a29d-845b-4b47-b03a-ae8386548bf5-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:43:40 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e0b8e292-9aa1-4dc5-a45c-df60a2dc135d tempest-VolumesListAdminTestJSON-1116729470 None] Acquiring lock "cinder-quobyte-3cd6a29d-845b-4b47-b03a-ae8386548bf5" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:43:40 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e0b8e292-9aa1-4dc5-a45c-df60a2dc135d tempest-VolumesListAdminTestJSON-1116729470 None] Lock "cinder-quobyte-3cd6a29d-845b-4b47-b03a-ae8386548bf5" acquired by "delete_volume" :: waited 0.023s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:43:40 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[d132f33f-c164-429c-8416-ea3d2370f8ab]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:43:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e0b8e292-9aa1-4dc5-a45c-df60a2dc135d tempest-VolumesListAdminTestJSON-1116729470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3cd6a29d-845b-4b47-b03a-ae8386548bf5 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:40 devstack sudo[94273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3cd6a29d-845b-4b47-b03a-ae8386548bf5 Jul 31 10:43:40 devstack sudo[94273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:40 devstack sudo[94268]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dee022c1-ec9f-4c77-b8eb-dfd4e0f3c2cc tempest-ServersNegativeTestJSON-2137225051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1a3f3f21-3e77-4d74-a2ab-04fb0a3f1ab6 1073741824" returned: 0 in 0.599s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dee022c1-ec9f-4c77-b8eb-dfd4e0f3c2cc tempest-ServersNegativeTestJSON-2137225051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1a3f3f21-3e77-4d74-a2ab-04fb0a3f1ab6 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:40 devstack sudo[94277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1a3f3f21-3e77-4d74-a2ab-04fb0a3f1ab6 Jul 31 10:43:40 devstack sudo[94277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:40 devstack sudo[94277]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dee022c1-ec9f-4c77-b8eb-dfd4e0f3c2cc tempest-ServersNegativeTestJSON-2137225051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1a3f3f21-3e77-4d74-a2ab-04fb0a3f1ab6" returned: 0 in 0.382s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:40 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-dee022c1-ec9f-4c77-b8eb-dfd4e0f3c2cc tempest-ServersNegativeTestJSON-2137225051 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:43:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-dee022c1-ec9f-4c77-b8eb-dfd4e0f3c2cc tempest-ServersNegativeTestJSON-2137225051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:43:40 devstack sudo[94273]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e0b8e292-9aa1-4dc5-a45c-df60a2dc135d tempest-VolumesListAdminTestJSON-1116729470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3cd6a29d-845b-4b47-b03a-ae8386548bf5" returned: 0 in 0.696s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e0b8e292-9aa1-4dc5-a45c-df60a2dc135d tempest-VolumesListAdminTestJSON-1116729470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3cd6a29d-845b-4b47-b03a-ae8386548bf5 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dee022c1-ec9f-4c77-b8eb-dfd4e0f3c2cc tempest-ServersNegativeTestJSON-2137225051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3e8194a-9a7c-4e24-8e80-7fa1fe54d03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a3f3f21-3e77-4d74-a2ab-04fb0a3f1ab6', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dee022c1-ec9f-4c77-b8eb-dfd4e0f3c2cc tempest-ServersNegativeTestJSON-2137225051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (398c8edc-6d5e-4f53-858c-7ce6c0170abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:40 devstack sudo[94284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3cd6a29d-845b-4b47-b03a-ae8386548bf5 Jul 31 10:43:40 devstack sudo[94284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:40 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-dee022c1-ec9f-4c77-b8eb-dfd4e0f3c2cc tempest-ServersNegativeTestJSON-2137225051 None] Volume volume-1a3f3f21-3e77-4d74-a2ab-04fb0a3f1ab6 (1a3f3f21-3e77-4d74-a2ab-04fb0a3f1ab6): created successfully Jul 31 10:43:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dee022c1-ec9f-4c77-b8eb-dfd4e0f3c2cc tempest-ServersNegativeTestJSON-2137225051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (398c8edc-6d5e-4f53-858c-7ce6c0170abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dee022c1-ec9f-4c77-b8eb-dfd4e0f3c2cc tempest-ServersNegativeTestJSON-2137225051 None] Flow 'volume_create_manager' (ecb3877a-6e33-4f62-86ec-7f404c0ba05e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:43:40 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-dee022c1-ec9f-4c77-b8eb-dfd4e0f3c2cc tempest-ServersNegativeTestJSON-2137225051 None] Created volume successfully. Jul 31 10:43:41 devstack sudo[94284]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e0b8e292-9aa1-4dc5-a45c-df60a2dc135d tempest-VolumesListAdminTestJSON-1116729470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3cd6a29d-845b-4b47-b03a-ae8386548bf5" returned: 0 in 0.326s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:41 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e0b8e292-9aa1-4dc5-a45c-df60a2dc135d tempest-VolumesListAdminTestJSON-1116729470 None] Lock "cinder-quobyte-3cd6a29d-845b-4b47-b03a-ae8386548bf5" released by "delete_volume" :: held 1.091s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:43:41 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-e0b8e292-9aa1-4dc5-a45c-df60a2dc135d tempest-VolumesListAdminTestJSON-1116729470 None] Created reservations ['d52a34d1-fd7c-4a1d-ab93-7109f7eae01f', '52c809e2-7112-4949-8a88-bf9d8e83962f', '683c3ef6-4c3a-411d-8b25-eb769625ac92', 'a251cc5b-af92-430b-b753-22f40a5eeff9'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:43:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e0b8e292-9aa1-4dc5-a45c-df60a2dc135d tempest-VolumesListAdminTestJSON-1116729470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:43:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e0b8e292-9aa1-4dc5-a45c-df60a2dc135d tempest-VolumesListAdminTestJSON-1116729470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:43:41 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-e0b8e292-9aa1-4dc5-a45c-df60a2dc135d tempest-VolumesListAdminTestJSON-1116729470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:43:41 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-e0b8e292-9aa1-4dc5-a45c-df60a2dc135d tempest-VolumesListAdminTestJSON-1116729470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:43:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e0b8e292-9aa1-4dc5-a45c-df60a2dc135d tempest-VolumesListAdminTestJSON-1116729470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:43:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e0b8e292-9aa1-4dc5-a45c-df60a2dc135d tempest-VolumesListAdminTestJSON-1116729470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:41 devstack sudo[94287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:43:41 devstack sudo[94287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:41 devstack sudo[94287]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e0b8e292-9aa1-4dc5-a45c-df60a2dc135d tempest-VolumesListAdminTestJSON-1116729470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.320s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:41 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-e0b8e292-9aa1-4dc5-a45c-df60a2dc135d tempest-VolumesListAdminTestJSON-1116729470 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:43:41 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-e0b8e292-9aa1-4dc5-a45c-df60a2dc135d tempest-VolumesListAdminTestJSON-1116729470 None] Deleted volume successfully. Jul 31 10:43:41 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e0b8e292-9aa1-4dc5-a45c-df60a2dc135d tempest-VolumesListAdminTestJSON-1116729470 None] Lock "cinder-3cd6a29d-845b-4b47-b03a-ae8386548bf5-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:43:42 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-400400a8-ace1-41e7-bd92-a2f953d5edc7 tempest-ServersNegativeTestJSON-2137225051 None] Acquiring lock "cinder-1a3f3f21-3e77-4d74-a2ab-04fb0a3f1ab6-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:43:42 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-400400a8-ace1-41e7-bd92-a2f953d5edc7 tempest-ServersNegativeTestJSON-2137225051 None] Lock "cinder-1a3f3f21-3e77-4d74-a2ab-04fb0a3f1ab6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:43:42 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-400400a8-ace1-41e7-bd92-a2f953d5edc7 tempest-ServersNegativeTestJSON-2137225051 None] Acquiring lock "cinder-quobyte-1a3f3f21-3e77-4d74-a2ab-04fb0a3f1ab6" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:43:42 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-400400a8-ace1-41e7-bd92-a2f953d5edc7 tempest-ServersNegativeTestJSON-2137225051 None] Lock "cinder-quobyte-1a3f3f21-3e77-4d74-a2ab-04fb0a3f1ab6" acquired by "delete_volume" :: waited 0.024s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:43:42 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5066bc9-c414-45bb-99eb-63728c78fc71]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:43:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-400400a8-ace1-41e7-bd92-a2f953d5edc7 tempest-ServersNegativeTestJSON-2137225051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1a3f3f21-3e77-4d74-a2ab-04fb0a3f1ab6 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:42 devstack sudo[94290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1a3f3f21-3e77-4d74-a2ab-04fb0a3f1ab6 Jul 31 10:43:42 devstack sudo[94290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:43 devstack sudo[94290]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-400400a8-ace1-41e7-bd92-a2f953d5edc7 tempest-ServersNegativeTestJSON-2137225051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1a3f3f21-3e77-4d74-a2ab-04fb0a3f1ab6" returned: 0 in 0.449s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-400400a8-ace1-41e7-bd92-a2f953d5edc7 tempest-ServersNegativeTestJSON-2137225051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1a3f3f21-3e77-4d74-a2ab-04fb0a3f1ab6 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:43 devstack sudo[94295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1a3f3f21-3e77-4d74-a2ab-04fb0a3f1ab6 Jul 31 10:43:43 devstack sudo[94295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:43 devstack sudo[94295]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-400400a8-ace1-41e7-bd92-a2f953d5edc7 tempest-ServersNegativeTestJSON-2137225051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1a3f3f21-3e77-4d74-a2ab-04fb0a3f1ab6" returned: 0 in 0.384s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:43 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-400400a8-ace1-41e7-bd92-a2f953d5edc7 tempest-ServersNegativeTestJSON-2137225051 None] Lock "cinder-quobyte-1a3f3f21-3e77-4d74-a2ab-04fb0a3f1ab6" released by "delete_volume" :: held 0.892s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:43:43 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-400400a8-ace1-41e7-bd92-a2f953d5edc7 tempest-ServersNegativeTestJSON-2137225051 None] Created reservations ['ed545948-e286-47d9-b28b-16a33ce662c4', 'b515c721-51b4-41bb-88c0-395a724a8498', '92473e36-55fa-43f4-a557-bb91f981bee9', '047f597f-fb79-4aa2-8b27-0bfcfb410c23'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:43:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-400400a8-ace1-41e7-bd92-a2f953d5edc7 tempest-ServersNegativeTestJSON-2137225051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:43:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-400400a8-ace1-41e7-bd92-a2f953d5edc7 tempest-ServersNegativeTestJSON-2137225051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:43:43 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-400400a8-ace1-41e7-bd92-a2f953d5edc7 tempest-ServersNegativeTestJSON-2137225051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:43:43 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-400400a8-ace1-41e7-bd92-a2f953d5edc7 tempest-ServersNegativeTestJSON-2137225051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:43:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-400400a8-ace1-41e7-bd92-a2f953d5edc7 tempest-ServersNegativeTestJSON-2137225051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:43:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-400400a8-ace1-41e7-bd92-a2f953d5edc7 tempest-ServersNegativeTestJSON-2137225051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:43 devstack sudo[94298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:43:43 devstack sudo[94298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:44 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6d1c640e-170b-404c-9d86-e106513d7d0a tempest-ServersNegativeTestJSON-2137225051 None] Acquiring lock "cinder-5c08b0cb-f305-45b7-8d6d-f01c7b3e0a3d-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:43:44 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6d1c640e-170b-404c-9d86-e106513d7d0a tempest-ServersNegativeTestJSON-2137225051 None] Lock "cinder-5c08b0cb-f305-45b7-8d6d-f01c7b3e0a3d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:43:44 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6d1c640e-170b-404c-9d86-e106513d7d0a tempest-ServersNegativeTestJSON-2137225051 None] Acquiring lock "cinder-quobyte-5c08b0cb-f305-45b7-8d6d-f01c7b3e0a3d" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:43:44 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6d1c640e-170b-404c-9d86-e106513d7d0a tempest-ServersNegativeTestJSON-2137225051 None] Lock "cinder-quobyte-5c08b0cb-f305-45b7-8d6d-f01c7b3e0a3d" acquired by "delete_volume" :: waited 0.023s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:43:44 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16b0cc3-7d17-44d2-863e-20b88974a2cc]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:43:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6d1c640e-170b-404c-9d86-e106513d7d0a tempest-ServersNegativeTestJSON-2137225051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5c08b0cb-f305-45b7-8d6d-f01c7b3e0a3d {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:44 devstack sudo[94298]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-400400a8-ace1-41e7-bd92-a2f953d5edc7 tempest-ServersNegativeTestJSON-2137225051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.365s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:44 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-400400a8-ace1-41e7-bd92-a2f953d5edc7 tempest-ServersNegativeTestJSON-2137225051 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:43:44 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-400400a8-ace1-41e7-bd92-a2f953d5edc7 tempest-ServersNegativeTestJSON-2137225051 None] Deleted volume successfully. Jul 31 10:43:44 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-400400a8-ace1-41e7-bd92-a2f953d5edc7 tempest-ServersNegativeTestJSON-2137225051 None] Lock "cinder-1a3f3f21-3e77-4d74-a2ab-04fb0a3f1ab6-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:43:44 devstack sudo[94301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5c08b0cb-f305-45b7-8d6d-f01c7b3e0a3d Jul 31 10:43:44 devstack sudo[94301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:44 devstack sudo[94301]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6d1c640e-170b-404c-9d86-e106513d7d0a tempest-ServersNegativeTestJSON-2137225051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5c08b0cb-f305-45b7-8d6d-f01c7b3e0a3d" returned: 0 in 0.536s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6d1c640e-170b-404c-9d86-e106513d7d0a tempest-ServersNegativeTestJSON-2137225051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5c08b0cb-f305-45b7-8d6d-f01c7b3e0a3d {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:44 devstack sudo[94307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5c08b0cb-f305-45b7-8d6d-f01c7b3e0a3d Jul 31 10:43:44 devstack sudo[94307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:45 devstack sudo[94307]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6d1c640e-170b-404c-9d86-e106513d7d0a tempest-ServersNegativeTestJSON-2137225051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5c08b0cb-f305-45b7-8d6d-f01c7b3e0a3d" returned: 0 in 0.372s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:45 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6d1c640e-170b-404c-9d86-e106513d7d0a tempest-ServersNegativeTestJSON-2137225051 None] Lock "cinder-quobyte-5c08b0cb-f305-45b7-8d6d-f01c7b3e0a3d" released by "delete_volume" :: held 0.972s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:43:45 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-6d1c640e-170b-404c-9d86-e106513d7d0a tempest-ServersNegativeTestJSON-2137225051 None] Created reservations ['8103d296-1bab-4756-a402-0a7294dabd02', 'c72fc32e-aa96-466e-a1cb-bcd64c425ba3', '712e11d6-1bdf-4e78-bf6b-03c90e4802b8', 'aa10d465-7879-40c9-9549-93207f8df8db'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:43:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6d1c640e-170b-404c-9d86-e106513d7d0a tempest-ServersNegativeTestJSON-2137225051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:43:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6d1c640e-170b-404c-9d86-e106513d7d0a tempest-ServersNegativeTestJSON-2137225051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:43:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-6d1c640e-170b-404c-9d86-e106513d7d0a tempest-ServersNegativeTestJSON-2137225051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:43:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-6d1c640e-170b-404c-9d86-e106513d7d0a tempest-ServersNegativeTestJSON-2137225051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:43:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6d1c640e-170b-404c-9d86-e106513d7d0a tempest-ServersNegativeTestJSON-2137225051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:43:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6d1c640e-170b-404c-9d86-e106513d7d0a tempest-ServersNegativeTestJSON-2137225051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:45 devstack sudo[94310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:43:45 devstack sudo[94310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:45 devstack sudo[94310]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6d1c640e-170b-404c-9d86-e106513d7d0a tempest-ServersNegativeTestJSON-2137225051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.414s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:45 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-6d1c640e-170b-404c-9d86-e106513d7d0a tempest-ServersNegativeTestJSON-2137225051 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:43:45 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-6d1c640e-170b-404c-9d86-e106513d7d0a tempest-ServersNegativeTestJSON-2137225051 None] Deleted volume successfully. Jul 31 10:43:45 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:43:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:43:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:43:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:43:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:43:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:43:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:45 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6d1c640e-170b-404c-9d86-e106513d7d0a tempest-ServersNegativeTestJSON-2137225051 None] Lock "cinder-5c08b0cb-f305-45b7-8d6d-f01c7b3e0a3d-delete_volume" released by "delete_volume" :: held 1.905s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:43:45 devstack sudo[94313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:43:45 devstack sudo[94313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:46 devstack sudo[94313]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.392s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:46 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:43:46 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager._thread_info {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:43:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread count: 8 {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:43:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread info: [<_MainThread(MainThread, started 134005426110592)>, , , , , , , ] {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:43:54 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:43:54 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Flow 'volume_create_manager' (3566b96e-66bc-43e3-97ff-7150ea95b4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:43:54 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73a3bfa6-b150-457b-ba21-a0f7cc6ec6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:54 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73a3bfa6-b150-457b-ba21-a0f7cc6ec6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-187795500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbe4e7d0-3601-4805-85c9-4c4135bf41d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87c3d99b328d4c4aa6dfb6a253e3db50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:43:54Z,use_quota=True,user_id='61d5c04bcb5a4952a0ce6d7a547b2485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:54 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d54eb5-3294-4293-9ab4-994accedfd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:54 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d54eb5-3294-4293-9ab4-994accedfd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:54 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac63a3d4-26e4-41f7-a0ae-042ca1e972a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:54 devstack cinder-volume[89090]: DEBUG cinder.image.glance [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Creating Keystone auth plugin from conf {{(pid=89090) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 10:43:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac63a3d4-26e4-41f7-a0ae-042ca1e972a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bbe4e7d0-3601-4805-85c9-4c4135bf41d5', 'volume_name': 'volume-bbe4e7d0-3601-4805-85c9-4c4135bf41d5', 'volume_size': 1, 'image_id': 'b429196b-9072-49ce-b54e-9693a9fd5306', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b429196b-9072-49ce-b54e-9693a9fd5306', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c7e7a60bc5b640caa5ec5fc5df1bd573', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b429196b-9072-49ce-b54e-9693a9fd5306', 'created_at': datetime.datetime(2026, 7, 31, 8, 33, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 33, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b429196b-9072-49ce-b54e-9693a9fd5306/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5edf77dc-03a8-4b83-a320-e02ac202c96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5edf77dc-03a8-4b83-a320-e02ac202c96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:43:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6439aa2f-b6ca-4770-83d4-d758962a3f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:43:55 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Volume bbe4e7d0-3601-4805-85c9-4c4135bf41d5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bbe4e7d0-3601-4805-85c9-4c4135bf41d5', 'volume_size': 1, 'image_id': 'b429196b-9072-49ce-b54e-9693a9fd5306', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b429196b-9072-49ce-b54e-9693a9fd5306', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c7e7a60bc5b640caa5ec5fc5df1bd573', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b429196b-9072-49ce-b54e-9693a9fd5306', 'created_at': datetime.datetime(2026, 7, 31, 8, 33, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 33, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b429196b-9072-49ce-b54e-9693a9fd5306/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 31 10:43:55 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Trying to clone bbe4e7d0-3601-4805-85c9-4c4135bf41d5 from image b429196b-9072-49ce-b54e-9693a9fd5306 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b429196b-9072-49ce-b54e-9693a9fd5306', 'metadata': {}}]). {{(pid=89090) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 10:43:56 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_eu1s0yfcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89090) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 10:43:56 devstack cinder-volume[89090]: INFO cinder.image.image_utils [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Image download 20.69 MB at 20.69 MB/s Jul 31 10:43:56 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef94405-74b4-48a6-ac8e-251c33c237f8]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:43:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_eu1s0yfcdevstack@QuobyteHD {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:56 devstack sudo[94429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_eu1s0yfcdevstack@QuobyteHD Jul 31 10:43:56 devstack sudo[94429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:56 devstack sudo[94429]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_eu1s0yfcdevstack@QuobyteHD" returned: 0 in 0.597s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:56 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Temporary image b429196b-9072-49ce-b54e-9693a9fd5306 is fetched for user 61d5c04bcb5a4952a0ce6d7a547b2485. {{(pid=89090) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 10:43:56 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58948f8-8e03-438e-8b0f-dac592f40000]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:43:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_eu1s0yfcdevstack@QuobyteHD {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:57 devstack sudo[94449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_eu1s0yfcdevstack@QuobyteHD Jul 31 10:43:57 devstack sudo[94449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:57 devstack sudo[94449]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_eu1s0yfcdevstack@QuobyteHD" returned: 0 in 0.434s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:43:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:43:57 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-187795500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbe4e7d0-3601-4805-85c9-4c4135bf41d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87c3d99b328d4c4aa6dfb6a253e3db50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:43:54Z,use_quota=True,user_id='61d5c04bcb5a4952a0ce6d7a547b2485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:43:57 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Creating volume bbe4e7d0-3601-4805-85c9-4c4135bf41d5 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:43:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:43:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:43:57 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:43:57 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:43:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:43:57 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:43:57 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:43:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bbe4e7d0-3601-4805-85c9-4c4135bf41d5 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:57 devstack sudo[94457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bbe4e7d0-3601-4805-85c9-4c4135bf41d5 1073741824 Jul 31 10:43:57 devstack sudo[94457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:58 devstack sudo[94457]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bbe4e7d0-3601-4805-85c9-4c4135bf41d5 1073741824" returned: 0 in 0.827s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bbe4e7d0-3601-4805-85c9-4c4135bf41d5 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:58 devstack sudo[94463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bbe4e7d0-3601-4805-85c9-4c4135bf41d5 Jul 31 10:43:58 devstack sudo[94463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:58 devstack sudo[94463]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bbe4e7d0-3601-4805-85c9-4c4135bf41d5" returned: 0 in 0.306s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:58 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:43:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:43:58 devstack cinder-volume[89090]: DEBUG cinder.volume.volume_utils [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Attempting download of b429196b-9072-49ce-b54e-9693a9fd5306 ((None, [{'url': 'file:///opt/stack/data/glance/images/b429196b-9072-49ce-b54e-9693a9fd5306', 'metadata': {}}])) to volume bbe4e7d0-3601-4805-85c9-4c4135bf41d5. {{(pid=89090) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 10:43:58 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca007283-18bd-4540-af22-799cedfe8211]: (4, 'raw') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:43:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b429196b-9072-49ce-b54e-9693a9fd5306_lkst38a9 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:58 devstack sudo[94467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b429196b-9072-49ce-b54e-9693a9fd5306_lkst38a9 Jul 31 10:43:58 devstack sudo[94467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:59 devstack sudo[94467]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b429196b-9072-49ce-b54e-9693a9fd5306_lkst38a9" returned: 0 in 0.444s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b429196b-9072-49ce-b54e-9693a9fd5306_lkst38a9 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:59 devstack sudo[94471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b429196b-9072-49ce-b54e-9693a9fd5306_lkst38a9 Jul 31 10:43:59 devstack sudo[94471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:43:59 devstack sudo[94471]: pam_unix(sudo:session): session closed for user root Jul 31 10:43:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b429196b-9072-49ce-b54e-9693a9fd5306_lkst38a9" returned: 1 in 0.438s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:43:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b429196b-9072-49ce-b54e-9693a9fd5306_lkst38a9' failed. Not Retrying. {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 10:43:59 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f61af96-e343-4f12-b3ec-2c2f183da182]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:43:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_eu1s0yfcdevstack@QuobyteHD {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:43:59 devstack sudo[94475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_eu1s0yfcdevstack@QuobyteHD Jul 31 10:43:59 devstack sudo[94475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:00 devstack sudo[94475]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_eu1s0yfcdevstack@QuobyteHD" returned: 0 in 0.692s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:00 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] b429196b-9072-49ce-b54e-9693a9fd5306 was qcow2, converting to qcow2 {{(pid=89090) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 10:44:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_eu1s0yfcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bbe4e7d0-3601-4805-85c9-4c4135bf41d5 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:00 devstack sudo[94515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_eu1s0yfcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bbe4e7d0-3601-4805-85c9-4c4135bf41d5 Jul 31 10:44:00 devstack sudo[94515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:03 devstack sudo[94515]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_eu1s0yfcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bbe4e7d0-3601-4805-85c9-4c4135bf41d5" returned: 0 in 3.637s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:03 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_eu1s0yfcdevstack@QuobyteHD, size 112.00 MB, duration 3.64 sec, destination /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bbe4e7d0-3601-4805-85c9-4c4135bf41d5 {{(pid=89090) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 10:44:03 devstack cinder-volume[89090]: INFO cinder.image.image_utils [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Converted 112.00 MB image at 30.77 MB/s Jul 31 10:44:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bbe4e7d0-3601-4805-85c9-4c4135bf41d5 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:03 devstack sudo[94642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bbe4e7d0-3601-4805-85c9-4c4135bf41d5 1G Jul 31 10:44:03 devstack sudo[94642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:04 devstack sudo[94642]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bbe4e7d0-3601-4805-85c9-4c4135bf41d5 1G" returned: 0 in 0.708s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:04 devstack cinder-volume[89090]: DEBUG cinder.volume.volume_utils [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Downloaded image b429196b-9072-49ce-b54e-9693a9fd5306 ((None, [{'url': 'file:///opt/stack/data/glance/images/b429196b-9072-49ce-b54e-9693a9fd5306', 'metadata': {}}])) to volume bbe4e7d0-3601-4805-85c9-4c4135bf41d5 successfully. {{(pid=89090) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 10:44:04 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Temporary image b429196b-9072-49ce-b54e-9693a9fd5306 for user 61d5c04bcb5a4952a0ce6d7a547b2485 is deleted. {{(pid=89090) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 10:44:04 devstack cinder-volume[89090]: DEBUG cinder.volume.volume_utils [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Marking volume bbe4e7d0-3601-4805-85c9-4c4135bf41d5 as bootable. {{(pid=89090) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 10:44:04 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Copying metadata from image b429196b-9072-49ce-b54e-9693a9fd5306 to bbe4e7d0-3601-4805-85c9-4c4135bf41d5. {{(pid=89090) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 10:44:04 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Creating volume glance metadata for volume bbe4e7d0-3601-4805-85c9-4c4135bf41d5 backed by image b429196b-9072-49ce-b54e-9693a9fd5306 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b429196b-9072-49ce-b54e-9693a9fd5306', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89090) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 10:44:05 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6439aa2f-b6ca-4770-83d4-d758962a3f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbe4e7d0-3601-4805-85c9-4c4135bf41d5', 'volume_size': 1, 'image_id': 'b429196b-9072-49ce-b54e-9693a9fd5306', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b429196b-9072-49ce-b54e-9693a9fd5306', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c7e7a60bc5b640caa5ec5fc5df1bd573', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b429196b-9072-49ce-b54e-9693a9fd5306', 'created_at': datetime.datetime(2026, 7, 31, 8, 33, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 33, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b429196b-9072-49ce-b54e-9693a9fd5306/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:44:05 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72df54a2-82db-4ab4-af5a-73b5f346a737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:44:05 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Volume volume-bbe4e7d0-3601-4805-85c9-4c4135bf41d5 (bbe4e7d0-3601-4805-85c9-4c4135bf41d5): created successfully Jul 31 10:44:05 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72df54a2-82db-4ab4-af5a-73b5f346a737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:44:05 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Flow 'volume_create_manager' (3566b96e-66bc-43e3-97ff-7150ea95b4e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:44:05 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-e006cf42-a771-4f93-b9ea-94bb9862e8c5 tempest-VolumesImageMetadata-94687815 None] Created volume successfully. Jul 31 10:44:06 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8e3f34fd-49e4-4d0d-82d6-7fd1f761c026 tempest-VolumesImageMetadata-94687815 None] Acquiring lock "cinder-bbe4e7d0-3601-4805-85c9-4c4135bf41d5-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:44:06 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8e3f34fd-49e4-4d0d-82d6-7fd1f761c026 tempest-VolumesImageMetadata-94687815 None] Lock "cinder-bbe4e7d0-3601-4805-85c9-4c4135bf41d5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:44:06 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8e3f34fd-49e4-4d0d-82d6-7fd1f761c026 tempest-VolumesImageMetadata-94687815 None] Acquiring lock "cinder-quobyte-bbe4e7d0-3601-4805-85c9-4c4135bf41d5" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:44:06 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8e3f34fd-49e4-4d0d-82d6-7fd1f761c026 tempest-VolumesImageMetadata-94687815 None] Lock "cinder-quobyte-bbe4e7d0-3601-4805-85c9-4c4135bf41d5" acquired by "delete_volume" :: waited 0.037s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:44:06 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d72540a-6b74-4f1f-93f2-ecf445052f74]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:44:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8e3f34fd-49e4-4d0d-82d6-7fd1f761c026 tempest-VolumesImageMetadata-94687815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bbe4e7d0-3601-4805-85c9-4c4135bf41d5 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:06 devstack sudo[94652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bbe4e7d0-3601-4805-85c9-4c4135bf41d5 Jul 31 10:44:06 devstack sudo[94652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:07 devstack sudo[94652]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8e3f34fd-49e4-4d0d-82d6-7fd1f761c026 tempest-VolumesImageMetadata-94687815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bbe4e7d0-3601-4805-85c9-4c4135bf41d5" returned: 0 in 1.187s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8e3f34fd-49e4-4d0d-82d6-7fd1f761c026 tempest-VolumesImageMetadata-94687815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bbe4e7d0-3601-4805-85c9-4c4135bf41d5 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:07 devstack sudo[94659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bbe4e7d0-3601-4805-85c9-4c4135bf41d5 Jul 31 10:44:07 devstack sudo[94659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:08 devstack sudo[94659]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8e3f34fd-49e4-4d0d-82d6-7fd1f761c026 tempest-VolumesImageMetadata-94687815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bbe4e7d0-3601-4805-85c9-4c4135bf41d5" returned: 0 in 0.803s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:08 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8e3f34fd-49e4-4d0d-82d6-7fd1f761c026 tempest-VolumesImageMetadata-94687815 None] Lock "cinder-quobyte-bbe4e7d0-3601-4805-85c9-4c4135bf41d5" released by "delete_volume" :: held 2.093s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:44:08 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-8e3f34fd-49e4-4d0d-82d6-7fd1f761c026 tempest-VolumesImageMetadata-94687815 None] Created reservations ['e0f39dcf-cf95-47b6-baec-c986b75f43e5', 'ba31d298-d426-4360-a2db-f6d6e2fbdd5b', '027ba9f9-3599-423a-a64c-5366bd359bb2', '76f9a0ab-5479-4cce-a962-95e4efa44a07'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:44:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8e3f34fd-49e4-4d0d-82d6-7fd1f761c026 tempest-VolumesImageMetadata-94687815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:44:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8e3f34fd-49e4-4d0d-82d6-7fd1f761c026 tempest-VolumesImageMetadata-94687815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:44:08 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-8e3f34fd-49e4-4d0d-82d6-7fd1f761c026 tempest-VolumesImageMetadata-94687815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:44:08 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-8e3f34fd-49e4-4d0d-82d6-7fd1f761c026 tempest-VolumesImageMetadata-94687815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:44:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8e3f34fd-49e4-4d0d-82d6-7fd1f761c026 tempest-VolumesImageMetadata-94687815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:44:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8e3f34fd-49e4-4d0d-82d6-7fd1f761c026 tempest-VolumesImageMetadata-94687815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:08 devstack sudo[94663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:44:08 devstack sudo[94663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:09 devstack sudo[94663]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8e3f34fd-49e4-4d0d-82d6-7fd1f761c026 tempest-VolumesImageMetadata-94687815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.623s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:09 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-8e3f34fd-49e4-4d0d-82d6-7fd1f761c026 tempest-VolumesImageMetadata-94687815 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:44:09 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-8e3f34fd-49e4-4d0d-82d6-7fd1f761c026 tempest-VolumesImageMetadata-94687815 None] Deleted volume successfully. Jul 31 10:44:09 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8e3f34fd-49e4-4d0d-82d6-7fd1f761c026 tempest-VolumesImageMetadata-94687815 None] Lock "cinder-bbe4e7d0-3601-4805-85c9-4c4135bf41d5-delete_volume" released by "delete_volume" :: held 3.267s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:44:17 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:UPDATE=90,cinder:SELECT=61,cinder:INSERT=22,cinder:DELETE=7 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:44:17 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=73,cinder:INSERT=27,cinder:UPDATE=78,cinder:DELETE=8 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:44:17 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfd85209-d39d-4ca2-9627-79e8125dd4ba tempest-VolumesTransfersTest-2107560965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:44:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dfd85209-d39d-4ca2-9627-79e8125dd4ba tempest-VolumesTransfersTest-2107560965 None] Flow 'volume_create_manager' (4693beb8-c546-4656-8df8-8d6878f2bafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:44:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dfd85209-d39d-4ca2-9627-79e8125dd4ba tempest-VolumesTransfersTest-2107560965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac37d62c-1c0a-4a10-b994-7cf27f3d9024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:44:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dfd85209-d39d-4ca2-9627-79e8125dd4ba tempest-VolumesTransfersTest-2107560965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac37d62c-1c0a-4a10-b994-7cf27f3d9024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-219061740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83976ccb-38c8-4cca-91c3-9d74c30c82ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='230b5d8192df4cec9152ebfb7d8f6ff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:44:17Z,use_quota=True,user_id='a5e3e4248fff4ba8838c69636e459721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:44:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dfd85209-d39d-4ca2-9627-79e8125dd4ba tempest-VolumesTransfersTest-2107560965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e14a85-6cd5-4496-9b56-44bff09b9a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:44:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dfd85209-d39d-4ca2-9627-79e8125dd4ba tempest-VolumesTransfersTest-2107560965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e14a85-6cd5-4496-9b56-44bff09b9a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:44:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dfd85209-d39d-4ca2-9627-79e8125dd4ba tempest-VolumesTransfersTest-2107560965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1e95369-17e4-4e63-a16f-928d30d413d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:44:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dfd85209-d39d-4ca2-9627-79e8125dd4ba tempest-VolumesTransfersTest-2107560965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1e95369-17e4-4e63-a16f-928d30d413d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83976ccb-38c8-4cca-91c3-9d74c30c82ea', 'volume_name': 'volume-83976ccb-38c8-4cca-91c3-9d74c30c82ea', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:44:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dfd85209-d39d-4ca2-9627-79e8125dd4ba tempest-VolumesTransfersTest-2107560965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b68317a0-bdeb-40f0-bdae-5b2cd129c277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:44:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dfd85209-d39d-4ca2-9627-79e8125dd4ba tempest-VolumesTransfersTest-2107560965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b68317a0-bdeb-40f0-bdae-5b2cd129c277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:44:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dfd85209-d39d-4ca2-9627-79e8125dd4ba tempest-VolumesTransfersTest-2107560965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95d05cb8-9e5a-4f8f-a8e5-8fdf35b072de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:44:17 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-dfd85209-d39d-4ca2-9627-79e8125dd4ba tempest-VolumesTransfersTest-2107560965 None] Volume 83976ccb-38c8-4cca-91c3-9d74c30c82ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83976ccb-38c8-4cca-91c3-9d74c30c82ea', 'volume_size': 1} Jul 31 10:44:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-dfd85209-d39d-4ca2-9627-79e8125dd4ba tempest-VolumesTransfersTest-2107560965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:44:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-dfd85209-d39d-4ca2-9627-79e8125dd4ba tempest-VolumesTransfersTest-2107560965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:44:17 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-dfd85209-d39d-4ca2-9627-79e8125dd4ba tempest-VolumesTransfersTest-2107560965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-219061740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83976ccb-38c8-4cca-91c3-9d74c30c82ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='230b5d8192df4cec9152ebfb7d8f6ff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:44:17Z,use_quota=True,user_id='a5e3e4248fff4ba8838c69636e459721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:44:17 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-dfd85209-d39d-4ca2-9627-79e8125dd4ba tempest-VolumesTransfersTest-2107560965 None] Creating volume 83976ccb-38c8-4cca-91c3-9d74c30c82ea {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:44:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-dfd85209-d39d-4ca2-9627-79e8125dd4ba tempest-VolumesTransfersTest-2107560965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:44:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-dfd85209-d39d-4ca2-9627-79e8125dd4ba tempest-VolumesTransfersTest-2107560965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:44:17 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-dfd85209-d39d-4ca2-9627-79e8125dd4ba tempest-VolumesTransfersTest-2107560965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:44:17 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-dfd85209-d39d-4ca2-9627-79e8125dd4ba tempest-VolumesTransfersTest-2107560965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:44:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-dfd85209-d39d-4ca2-9627-79e8125dd4ba tempest-VolumesTransfersTest-2107560965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:44:17 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-dfd85209-d39d-4ca2-9627-79e8125dd4ba tempest-VolumesTransfersTest-2107560965 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:44:17 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-dfd85209-d39d-4ca2-9627-79e8125dd4ba tempest-VolumesTransfersTest-2107560965 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:44:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dfd85209-d39d-4ca2-9627-79e8125dd4ba tempest-VolumesTransfersTest-2107560965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-83976ccb-38c8-4cca-91c3-9d74c30c82ea 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:17 devstack sudo[94676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-83976ccb-38c8-4cca-91c3-9d74c30c82ea 1073741824 Jul 31 10:44:17 devstack sudo[94676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:18 devstack sudo[94676]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dfd85209-d39d-4ca2-9627-79e8125dd4ba tempest-VolumesTransfersTest-2107560965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-83976ccb-38c8-4cca-91c3-9d74c30c82ea 1073741824" returned: 0 in 0.659s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dfd85209-d39d-4ca2-9627-79e8125dd4ba tempest-VolumesTransfersTest-2107560965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-83976ccb-38c8-4cca-91c3-9d74c30c82ea {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:18 devstack sudo[94682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-83976ccb-38c8-4cca-91c3-9d74c30c82ea Jul 31 10:44:18 devstack sudo[94682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:18 devstack sudo[94682]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dfd85209-d39d-4ca2-9627-79e8125dd4ba tempest-VolumesTransfersTest-2107560965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-83976ccb-38c8-4cca-91c3-9d74c30c82ea" returned: 0 in 0.305s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-dfd85209-d39d-4ca2-9627-79e8125dd4ba tempest-VolumesTransfersTest-2107560965 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:44:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-dfd85209-d39d-4ca2-9627-79e8125dd4ba tempest-VolumesTransfersTest-2107560965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:44:18 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dfd85209-d39d-4ca2-9627-79e8125dd4ba tempest-VolumesTransfersTest-2107560965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95d05cb8-9e5a-4f8f-a8e5-8fdf35b072de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83976ccb-38c8-4cca-91c3-9d74c30c82ea', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:44:18 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dfd85209-d39d-4ca2-9627-79e8125dd4ba tempest-VolumesTransfersTest-2107560965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fb5c6e9-0b9d-43a8-b4e5-e48116dd59db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:44:18 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-dfd85209-d39d-4ca2-9627-79e8125dd4ba tempest-VolumesTransfersTest-2107560965 None] Volume volume-83976ccb-38c8-4cca-91c3-9d74c30c82ea (83976ccb-38c8-4cca-91c3-9d74c30c82ea): created successfully Jul 31 10:44:18 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dfd85209-d39d-4ca2-9627-79e8125dd4ba tempest-VolumesTransfersTest-2107560965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fb5c6e9-0b9d-43a8-b4e5-e48116dd59db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:44:18 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dfd85209-d39d-4ca2-9627-79e8125dd4ba tempest-VolumesTransfersTest-2107560965 None] Flow 'volume_create_manager' (4693beb8-c546-4656-8df8-8d6878f2bafb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:44:18 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-dfd85209-d39d-4ca2-9627-79e8125dd4ba tempest-VolumesTransfersTest-2107560965 None] Created volume successfully. Jul 31 10:44:20 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-f61599dd-346a-4076-81e2-59c1103435f1 tempest-VolumesTransfersTest-473165725 None] Transfer volume completed successfully. Jul 31 10:44:20 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-139b714c-4acf-41c5-a28c-03723b3699ad tempest-VolumesTransfersTest-675946109 None] Acquiring lock "cinder-83976ccb-38c8-4cca-91c3-9d74c30c82ea-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:44:20 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-139b714c-4acf-41c5-a28c-03723b3699ad tempest-VolumesTransfersTest-675946109 None] Lock "cinder-83976ccb-38c8-4cca-91c3-9d74c30c82ea-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:44:20 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-139b714c-4acf-41c5-a28c-03723b3699ad tempest-VolumesTransfersTest-675946109 None] Acquiring lock "cinder-quobyte-83976ccb-38c8-4cca-91c3-9d74c30c82ea" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:44:20 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-139b714c-4acf-41c5-a28c-03723b3699ad tempest-VolumesTransfersTest-675946109 None] Lock "cinder-quobyte-83976ccb-38c8-4cca-91c3-9d74c30c82ea" acquired by "delete_volume" :: waited 0.019s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:44:20 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b6e915-1173-4ec2-a813-ea59800268bd]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:44:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-139b714c-4acf-41c5-a28c-03723b3699ad tempest-VolumesTransfersTest-675946109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-83976ccb-38c8-4cca-91c3-9d74c30c82ea {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:21 devstack sudo[94724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-83976ccb-38c8-4cca-91c3-9d74c30c82ea Jul 31 10:44:21 devstack sudo[94724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:21 devstack sudo[94724]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-139b714c-4acf-41c5-a28c-03723b3699ad tempest-VolumesTransfersTest-675946109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-83976ccb-38c8-4cca-91c3-9d74c30c82ea" returned: 0 in 0.400s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-139b714c-4acf-41c5-a28c-03723b3699ad tempest-VolumesTransfersTest-675946109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-83976ccb-38c8-4cca-91c3-9d74c30c82ea {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:21 devstack sudo[94729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-83976ccb-38c8-4cca-91c3-9d74c30c82ea Jul 31 10:44:21 devstack sudo[94729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:21 devstack sudo[94729]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-139b714c-4acf-41c5-a28c-03723b3699ad tempest-VolumesTransfersTest-675946109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-83976ccb-38c8-4cca-91c3-9d74c30c82ea" returned: 0 in 0.266s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:21 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-139b714c-4acf-41c5-a28c-03723b3699ad tempest-VolumesTransfersTest-675946109 None] Lock "cinder-quobyte-83976ccb-38c8-4cca-91c3-9d74c30c82ea" released by "delete_volume" :: held 0.715s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:44:21 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-139b714c-4acf-41c5-a28c-03723b3699ad tempest-VolumesTransfersTest-675946109 None] Created reservations ['0cf36c1b-07d1-4bf9-9d5a-592c6aaee960', '3486aaf4-ce63-4465-909f-6e2f335a60b5', '85a83c22-9d63-46e4-8ca6-92f5b7ba76ce', '79bfdaa1-2e02-4e34-b824-2f66b0f4c19b'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:44:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-139b714c-4acf-41c5-a28c-03723b3699ad tempest-VolumesTransfersTest-675946109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:44:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-139b714c-4acf-41c5-a28c-03723b3699ad tempest-VolumesTransfersTest-675946109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:44:21 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-139b714c-4acf-41c5-a28c-03723b3699ad tempest-VolumesTransfersTest-675946109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:44:21 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-139b714c-4acf-41c5-a28c-03723b3699ad tempest-VolumesTransfersTest-675946109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:44:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-139b714c-4acf-41c5-a28c-03723b3699ad tempest-VolumesTransfersTest-675946109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:44:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-139b714c-4acf-41c5-a28c-03723b3699ad tempest-VolumesTransfersTest-675946109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:21 devstack sudo[94733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:44:21 devstack sudo[94733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:22 devstack sudo[94733]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-139b714c-4acf-41c5-a28c-03723b3699ad tempest-VolumesTransfersTest-675946109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.308s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:22 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-139b714c-4acf-41c5-a28c-03723b3699ad tempest-VolumesTransfersTest-675946109 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:44:22 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-139b714c-4acf-41c5-a28c-03723b3699ad tempest-VolumesTransfersTest-675946109 None] Deleted volume successfully. Jul 31 10:44:22 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-139b714c-4acf-41c5-a28c-03723b3699ad tempest-VolumesTransfersTest-675946109 None] Lock "cinder-83976ccb-38c8-4cca-91c3-9d74c30c82ea-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:44:22 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-81077a6f-1d83-44d7-b8e0-f7ca14d5c085 tempest-VolumesTransfersTest-2107560965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:44:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-81077a6f-1d83-44d7-b8e0-f7ca14d5c085 tempest-VolumesTransfersTest-2107560965 None] Flow 'volume_create_manager' (dbff7b6d-ae53-4ea8-a310-c2ec50007545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:44:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-81077a6f-1d83-44d7-b8e0-f7ca14d5c085 tempest-VolumesTransfersTest-2107560965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e0a18a2-c4cd-4e17-91d1-242dfbe13de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:44:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-81077a6f-1d83-44d7-b8e0-f7ca14d5c085 tempest-VolumesTransfersTest-2107560965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e0a18a2-c4cd-4e17-91d1-242dfbe13de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1574078986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=878d19d9-e490-4e90-9784-aaae73593897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='230b5d8192df4cec9152ebfb7d8f6ff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:44:22Z,use_quota=True,user_id='a5e3e4248fff4ba8838c69636e459721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:44:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-81077a6f-1d83-44d7-b8e0-f7ca14d5c085 tempest-VolumesTransfersTest-2107560965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daf0223a-8094-4c21-a561-54d61a18946a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:44:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-81077a6f-1d83-44d7-b8e0-f7ca14d5c085 tempest-VolumesTransfersTest-2107560965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daf0223a-8094-4c21-a561-54d61a18946a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:44:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-81077a6f-1d83-44d7-b8e0-f7ca14d5c085 tempest-VolumesTransfersTest-2107560965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e8934e-2913-4374-82b6-e4d031d933d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:44:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-81077a6f-1d83-44d7-b8e0-f7ca14d5c085 tempest-VolumesTransfersTest-2107560965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e8934e-2913-4374-82b6-e4d031d933d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '878d19d9-e490-4e90-9784-aaae73593897', 'volume_name': 'volume-878d19d9-e490-4e90-9784-aaae73593897', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:44:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-81077a6f-1d83-44d7-b8e0-f7ca14d5c085 tempest-VolumesTransfersTest-2107560965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6ddbd8e-dabb-4b9e-889d-9d5235affe48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:44:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-81077a6f-1d83-44d7-b8e0-f7ca14d5c085 tempest-VolumesTransfersTest-2107560965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6ddbd8e-dabb-4b9e-889d-9d5235affe48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:44:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-81077a6f-1d83-44d7-b8e0-f7ca14d5c085 tempest-VolumesTransfersTest-2107560965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ecb82f-13e9-436f-8a2a-d4ae81e7e99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:44:22 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-81077a6f-1d83-44d7-b8e0-f7ca14d5c085 tempest-VolumesTransfersTest-2107560965 None] Volume 878d19d9-e490-4e90-9784-aaae73593897: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-878d19d9-e490-4e90-9784-aaae73593897', 'volume_size': 1} Jul 31 10:44:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-81077a6f-1d83-44d7-b8e0-f7ca14d5c085 tempest-VolumesTransfersTest-2107560965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:44:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-81077a6f-1d83-44d7-b8e0-f7ca14d5c085 tempest-VolumesTransfersTest-2107560965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:44:22 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-81077a6f-1d83-44d7-b8e0-f7ca14d5c085 tempest-VolumesTransfersTest-2107560965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1574078986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=878d19d9-e490-4e90-9784-aaae73593897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='230b5d8192df4cec9152ebfb7d8f6ff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:44:22Z,use_quota=True,user_id='a5e3e4248fff4ba8838c69636e459721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:44:22 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-81077a6f-1d83-44d7-b8e0-f7ca14d5c085 tempest-VolumesTransfersTest-2107560965 None] Creating volume 878d19d9-e490-4e90-9784-aaae73593897 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:44:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-81077a6f-1d83-44d7-b8e0-f7ca14d5c085 tempest-VolumesTransfersTest-2107560965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:44:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-81077a6f-1d83-44d7-b8e0-f7ca14d5c085 tempest-VolumesTransfersTest-2107560965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:44:22 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-81077a6f-1d83-44d7-b8e0-f7ca14d5c085 tempest-VolumesTransfersTest-2107560965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:44:22 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-81077a6f-1d83-44d7-b8e0-f7ca14d5c085 tempest-VolumesTransfersTest-2107560965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:44:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-81077a6f-1d83-44d7-b8e0-f7ca14d5c085 tempest-VolumesTransfersTest-2107560965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:44:22 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-81077a6f-1d83-44d7-b8e0-f7ca14d5c085 tempest-VolumesTransfersTest-2107560965 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:44:22 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-81077a6f-1d83-44d7-b8e0-f7ca14d5c085 tempest-VolumesTransfersTest-2107560965 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:44:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-81077a6f-1d83-44d7-b8e0-f7ca14d5c085 tempest-VolumesTransfersTest-2107560965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-878d19d9-e490-4e90-9784-aaae73593897 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:22 devstack sudo[94736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-878d19d9-e490-4e90-9784-aaae73593897 1073741824 Jul 31 10:44:22 devstack sudo[94736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:23 devstack sudo[94736]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-81077a6f-1d83-44d7-b8e0-f7ca14d5c085 tempest-VolumesTransfersTest-2107560965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-878d19d9-e490-4e90-9784-aaae73593897 1073741824" returned: 0 in 0.491s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-81077a6f-1d83-44d7-b8e0-f7ca14d5c085 tempest-VolumesTransfersTest-2107560965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-878d19d9-e490-4e90-9784-aaae73593897 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:23 devstack sudo[94742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-878d19d9-e490-4e90-9784-aaae73593897 Jul 31 10:44:23 devstack sudo[94742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:23 devstack sudo[94742]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-81077a6f-1d83-44d7-b8e0-f7ca14d5c085 tempest-VolumesTransfersTest-2107560965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-878d19d9-e490-4e90-9784-aaae73593897" returned: 0 in 0.271s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:23 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-81077a6f-1d83-44d7-b8e0-f7ca14d5c085 tempest-VolumesTransfersTest-2107560965 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:44:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-81077a6f-1d83-44d7-b8e0-f7ca14d5c085 tempest-VolumesTransfersTest-2107560965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:44:23 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-81077a6f-1d83-44d7-b8e0-f7ca14d5c085 tempest-VolumesTransfersTest-2107560965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ecb82f-13e9-436f-8a2a-d4ae81e7e99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-878d19d9-e490-4e90-9784-aaae73593897', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:44:23 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-81077a6f-1d83-44d7-b8e0-f7ca14d5c085 tempest-VolumesTransfersTest-2107560965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (656b4039-8e3e-455d-ae94-648c89e5da6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:44:23 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-81077a6f-1d83-44d7-b8e0-f7ca14d5c085 tempest-VolumesTransfersTest-2107560965 None] Volume volume-878d19d9-e490-4e90-9784-aaae73593897 (878d19d9-e490-4e90-9784-aaae73593897): created successfully Jul 31 10:44:23 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-81077a6f-1d83-44d7-b8e0-f7ca14d5c085 tempest-VolumesTransfersTest-2107560965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (656b4039-8e3e-455d-ae94-648c89e5da6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:44:23 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-81077a6f-1d83-44d7-b8e0-f7ca14d5c085 tempest-VolumesTransfersTest-2107560965 None] Flow 'volume_create_manager' (dbff7b6d-ae53-4ea8-a310-c2ec50007545) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:44:23 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-81077a6f-1d83-44d7-b8e0-f7ca14d5c085 tempest-VolumesTransfersTest-2107560965 None] Created volume successfully. Jul 31 10:44:25 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7ef5b693-e1d9-4b3d-ab69-17159839d7fb tempest-VolumesTransfersTest-675946109 None] Acquiring lock "cinder-878d19d9-e490-4e90-9784-aaae73593897-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:44:25 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7ef5b693-e1d9-4b3d-ab69-17159839d7fb tempest-VolumesTransfersTest-675946109 None] Lock "cinder-878d19d9-e490-4e90-9784-aaae73593897-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:44:25 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7ef5b693-e1d9-4b3d-ab69-17159839d7fb tempest-VolumesTransfersTest-675946109 None] Acquiring lock "cinder-quobyte-878d19d9-e490-4e90-9784-aaae73593897" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:44:25 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7ef5b693-e1d9-4b3d-ab69-17159839d7fb tempest-VolumesTransfersTest-675946109 None] Lock "cinder-quobyte-878d19d9-e490-4e90-9784-aaae73593897" acquired by "delete_volume" :: waited 0.020s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:44:25 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[2290a3cd-ae7e-4e71-9f97-2fcd0a66dd1a]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:44:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7ef5b693-e1d9-4b3d-ab69-17159839d7fb tempest-VolumesTransfersTest-675946109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-878d19d9-e490-4e90-9784-aaae73593897 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:25 devstack sudo[94745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-878d19d9-e490-4e90-9784-aaae73593897 Jul 31 10:44:25 devstack sudo[94745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:25 devstack sudo[94745]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7ef5b693-e1d9-4b3d-ab69-17159839d7fb tempest-VolumesTransfersTest-675946109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-878d19d9-e490-4e90-9784-aaae73593897" returned: 0 in 0.445s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7ef5b693-e1d9-4b3d-ab69-17159839d7fb tempest-VolumesTransfersTest-675946109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-878d19d9-e490-4e90-9784-aaae73593897 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:25 devstack sudo[94750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-878d19d9-e490-4e90-9784-aaae73593897 Jul 31 10:44:25 devstack sudo[94750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:25 devstack sudo[94750]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7ef5b693-e1d9-4b3d-ab69-17159839d7fb tempest-VolumesTransfersTest-675946109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-878d19d9-e490-4e90-9784-aaae73593897" returned: 0 in 0.285s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:25 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7ef5b693-e1d9-4b3d-ab69-17159839d7fb tempest-VolumesTransfersTest-675946109 None] Lock "cinder-quobyte-878d19d9-e490-4e90-9784-aaae73593897" released by "delete_volume" :: held 0.793s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:44:25 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-7ef5b693-e1d9-4b3d-ab69-17159839d7fb tempest-VolumesTransfersTest-675946109 None] Created reservations ['52804191-c258-44e7-a419-9764ac3d9f42', 'b87b9565-2a4b-48ec-873d-6c8cf08c7b11', '7e4f9281-69a5-441e-b7a4-7a4cf97bdb31', '6d2c1339-3648-40a8-bb5d-efb773641c18'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:44:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7ef5b693-e1d9-4b3d-ab69-17159839d7fb tempest-VolumesTransfersTest-675946109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:44:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7ef5b693-e1d9-4b3d-ab69-17159839d7fb tempest-VolumesTransfersTest-675946109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:44:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-7ef5b693-e1d9-4b3d-ab69-17159839d7fb tempest-VolumesTransfersTest-675946109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:44:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-7ef5b693-e1d9-4b3d-ab69-17159839d7fb tempest-VolumesTransfersTest-675946109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:44:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7ef5b693-e1d9-4b3d-ab69-17159839d7fb tempest-VolumesTransfersTest-675946109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:44:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7ef5b693-e1d9-4b3d-ab69-17159839d7fb tempest-VolumesTransfersTest-675946109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:26 devstack sudo[94753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:44:26 devstack sudo[94753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:26 devstack sudo[94753]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7ef5b693-e1d9-4b3d-ab69-17159839d7fb tempest-VolumesTransfersTest-675946109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.407s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:26 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-7ef5b693-e1d9-4b3d-ab69-17159839d7fb tempest-VolumesTransfersTest-675946109 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:44:26 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-7ef5b693-e1d9-4b3d-ab69-17159839d7fb tempest-VolumesTransfersTest-675946109 None] Deleted volume successfully. Jul 31 10:44:26 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7ef5b693-e1d9-4b3d-ab69-17159839d7fb tempest-VolumesTransfersTest-675946109 None] Lock "cinder-878d19d9-e490-4e90-9784-aaae73593897-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:44:26 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-56ea3d9e-4408-48cc-8d05-564424d550e6 tempest-SnapshotsActionsTest-587741653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:44:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-56ea3d9e-4408-48cc-8d05-564424d550e6 tempest-SnapshotsActionsTest-587741653 None] Flow 'volume_create_manager' (aa339c1f-b534-4dca-b128-583e109de0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:44:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-56ea3d9e-4408-48cc-8d05-564424d550e6 tempest-SnapshotsActionsTest-587741653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57413159-d2f5-46b8-adf0-79d3d11cd9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:44:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-56ea3d9e-4408-48cc-8d05-564424d550e6 tempest-SnapshotsActionsTest-587741653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57413159-d2f5-46b8-adf0-79d3d11cd9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-718943655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99fefa2713dd40b78c475c9702be2fe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:44:27Z,use_quota=True,user_id='d9e27178f24b47e395ec7c4efb25b787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:44:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-56ea3d9e-4408-48cc-8d05-564424d550e6 tempest-SnapshotsActionsTest-587741653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a28a72d3-4136-4a1c-9978-d1beb09b8967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:44:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-56ea3d9e-4408-48cc-8d05-564424d550e6 tempest-SnapshotsActionsTest-587741653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a28a72d3-4136-4a1c-9978-d1beb09b8967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:44:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-56ea3d9e-4408-48cc-8d05-564424d550e6 tempest-SnapshotsActionsTest-587741653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6e8e3e4-1b16-41ba-bf9a-ae324bf1c0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:44:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-56ea3d9e-4408-48cc-8d05-564424d550e6 tempest-SnapshotsActionsTest-587741653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6e8e3e4-1b16-41ba-bf9a-ae324bf1c0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc', 'volume_name': 'volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:44:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-56ea3d9e-4408-48cc-8d05-564424d550e6 tempest-SnapshotsActionsTest-587741653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b0e981d-032c-45f0-a6a2-718ad9a7625b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:44:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-56ea3d9e-4408-48cc-8d05-564424d550e6 tempest-SnapshotsActionsTest-587741653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b0e981d-032c-45f0-a6a2-718ad9a7625b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:44:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-56ea3d9e-4408-48cc-8d05-564424d550e6 tempest-SnapshotsActionsTest-587741653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae43f613-5752-4118-8a22-8d9a4995dc0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:44:27 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-56ea3d9e-4408-48cc-8d05-564424d550e6 tempest-SnapshotsActionsTest-587741653 None] Volume 8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc', 'volume_size': 1} Jul 31 10:44:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-56ea3d9e-4408-48cc-8d05-564424d550e6 tempest-SnapshotsActionsTest-587741653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:44:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-56ea3d9e-4408-48cc-8d05-564424d550e6 tempest-SnapshotsActionsTest-587741653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:44:27 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-56ea3d9e-4408-48cc-8d05-564424d550e6 tempest-SnapshotsActionsTest-587741653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-718943655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99fefa2713dd40b78c475c9702be2fe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:44:27Z,use_quota=True,user_id='d9e27178f24b47e395ec7c4efb25b787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:44:27 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-56ea3d9e-4408-48cc-8d05-564424d550e6 tempest-SnapshotsActionsTest-587741653 None] Creating volume 8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:44:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-56ea3d9e-4408-48cc-8d05-564424d550e6 tempest-SnapshotsActionsTest-587741653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:44:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-56ea3d9e-4408-48cc-8d05-564424d550e6 tempest-SnapshotsActionsTest-587741653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:44:27 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-56ea3d9e-4408-48cc-8d05-564424d550e6 tempest-SnapshotsActionsTest-587741653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:44:27 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-56ea3d9e-4408-48cc-8d05-564424d550e6 tempest-SnapshotsActionsTest-587741653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:44:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-56ea3d9e-4408-48cc-8d05-564424d550e6 tempest-SnapshotsActionsTest-587741653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:44:27 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-56ea3d9e-4408-48cc-8d05-564424d550e6 tempest-SnapshotsActionsTest-587741653 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:44:27 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-56ea3d9e-4408-48cc-8d05-564424d550e6 tempest-SnapshotsActionsTest-587741653 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:44:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-56ea3d9e-4408-48cc-8d05-564424d550e6 tempest-SnapshotsActionsTest-587741653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:27 devstack sudo[94757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc 1073741824 Jul 31 10:44:27 devstack sudo[94757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:27 devstack sudo[94757]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-56ea3d9e-4408-48cc-8d05-564424d550e6 tempest-SnapshotsActionsTest-587741653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc 1073741824" returned: 0 in 0.522s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-56ea3d9e-4408-48cc-8d05-564424d550e6 tempest-SnapshotsActionsTest-587741653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:27 devstack sudo[94763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc Jul 31 10:44:27 devstack sudo[94763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:27 devstack sudo[94763]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-56ea3d9e-4408-48cc-8d05-564424d550e6 tempest-SnapshotsActionsTest-587741653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc" returned: 0 in 0.296s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:27 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-56ea3d9e-4408-48cc-8d05-564424d550e6 tempest-SnapshotsActionsTest-587741653 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:44:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-56ea3d9e-4408-48cc-8d05-564424d550e6 tempest-SnapshotsActionsTest-587741653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:44:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-56ea3d9e-4408-48cc-8d05-564424d550e6 tempest-SnapshotsActionsTest-587741653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae43f613-5752-4118-8a22-8d9a4995dc0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:44:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-56ea3d9e-4408-48cc-8d05-564424d550e6 tempest-SnapshotsActionsTest-587741653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (171f27ee-50a4-46c2-94de-d223655e00c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:44:28 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-56ea3d9e-4408-48cc-8d05-564424d550e6 tempest-SnapshotsActionsTest-587741653 None] Volume volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc (8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc): created successfully Jul 31 10:44:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-56ea3d9e-4408-48cc-8d05-564424d550e6 tempest-SnapshotsActionsTest-587741653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (171f27ee-50a4-46c2-94de-d223655e00c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:44:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-56ea3d9e-4408-48cc-8d05-564424d550e6 tempest-SnapshotsActionsTest-587741653 None] Flow 'volume_create_manager' (aa339c1f-b534-4dca-b128-583e109de0de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:44:28 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-56ea3d9e-4408-48cc-8d05-564424d550e6 tempest-SnapshotsActionsTest-587741653 None] Created volume successfully. Jul 31 10:44:28 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-d806bfbd-a1a3-4ad2-851a-5c504eeffbff tempest-AttachVolumeShelveTestJSON-1538487283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:44:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d806bfbd-a1a3-4ad2-851a-5c504eeffbff tempest-AttachVolumeShelveTestJSON-1538487283 None] Flow 'volume_create_manager' (21c8ef16-f5d8-4583-b497-965d9cb8e3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:44:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d806bfbd-a1a3-4ad2-851a-5c504eeffbff tempest-AttachVolumeShelveTestJSON-1538487283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eccb00d4-951c-45f2-9948-b79225226538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:44:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d806bfbd-a1a3-4ad2-851a-5c504eeffbff tempest-AttachVolumeShelveTestJSON-1538487283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eccb00d4-951c-45f2-9948-b79225226538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1606189115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb9648fd-713a-412b-95bf-9377e419b496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c55713856354d5381c89f312f395fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:44:29Z,use_quota=True,user_id='cb0d803d1883403994cbe8e2d5efbbf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:44:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d806bfbd-a1a3-4ad2-851a-5c504eeffbff tempest-AttachVolumeShelveTestJSON-1538487283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91aec067-9bf2-47a3-a06c-5bd1886b82f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:44:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d806bfbd-a1a3-4ad2-851a-5c504eeffbff tempest-AttachVolumeShelveTestJSON-1538487283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91aec067-9bf2-47a3-a06c-5bd1886b82f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:44:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d806bfbd-a1a3-4ad2-851a-5c504eeffbff tempest-AttachVolumeShelveTestJSON-1538487283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (542b6a81-5cf9-4166-b80f-d86a93dbe71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:44:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d806bfbd-a1a3-4ad2-851a-5c504eeffbff tempest-AttachVolumeShelveTestJSON-1538487283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (542b6a81-5cf9-4166-b80f-d86a93dbe71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb9648fd-713a-412b-95bf-9377e419b496', 'volume_name': 'volume-fb9648fd-713a-412b-95bf-9377e419b496', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:44:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d806bfbd-a1a3-4ad2-851a-5c504eeffbff tempest-AttachVolumeShelveTestJSON-1538487283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30364440-00a4-491b-8cf1-f31c29118785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:44:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d806bfbd-a1a3-4ad2-851a-5c504eeffbff tempest-AttachVolumeShelveTestJSON-1538487283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30364440-00a4-491b-8cf1-f31c29118785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:44:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d806bfbd-a1a3-4ad2-851a-5c504eeffbff tempest-AttachVolumeShelveTestJSON-1538487283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e63d0bcf-5538-4670-8e87-55bcdaabf96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:44:28 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-d806bfbd-a1a3-4ad2-851a-5c504eeffbff tempest-AttachVolumeShelveTestJSON-1538487283 None] Volume fb9648fd-713a-412b-95bf-9377e419b496: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb9648fd-713a-412b-95bf-9377e419b496', 'volume_size': 1} Jul 31 10:44:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d806bfbd-a1a3-4ad2-851a-5c504eeffbff tempest-AttachVolumeShelveTestJSON-1538487283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:44:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d806bfbd-a1a3-4ad2-851a-5c504eeffbff tempest-AttachVolumeShelveTestJSON-1538487283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:44:28 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d806bfbd-a1a3-4ad2-851a-5c504eeffbff tempest-AttachVolumeShelveTestJSON-1538487283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1606189115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb9648fd-713a-412b-95bf-9377e419b496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c55713856354d5381c89f312f395fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:44:29Z,use_quota=True,user_id='cb0d803d1883403994cbe8e2d5efbbf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:44:28 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-d806bfbd-a1a3-4ad2-851a-5c504eeffbff tempest-AttachVolumeShelveTestJSON-1538487283 None] Creating volume fb9648fd-713a-412b-95bf-9377e419b496 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:44:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d806bfbd-a1a3-4ad2-851a-5c504eeffbff tempest-AttachVolumeShelveTestJSON-1538487283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:44:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d806bfbd-a1a3-4ad2-851a-5c504eeffbff tempest-AttachVolumeShelveTestJSON-1538487283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:44:28 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d806bfbd-a1a3-4ad2-851a-5c504eeffbff tempest-AttachVolumeShelveTestJSON-1538487283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:44:28 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d806bfbd-a1a3-4ad2-851a-5c504eeffbff tempest-AttachVolumeShelveTestJSON-1538487283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:44:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d806bfbd-a1a3-4ad2-851a-5c504eeffbff tempest-AttachVolumeShelveTestJSON-1538487283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:44:28 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d806bfbd-a1a3-4ad2-851a-5c504eeffbff tempest-AttachVolumeShelveTestJSON-1538487283 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:44:28 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-d806bfbd-a1a3-4ad2-851a-5c504eeffbff tempest-AttachVolumeShelveTestJSON-1538487283 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:44:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d806bfbd-a1a3-4ad2-851a-5c504eeffbff tempest-AttachVolumeShelveTestJSON-1538487283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fb9648fd-713a-412b-95bf-9377e419b496 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:28 devstack sudo[94768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fb9648fd-713a-412b-95bf-9377e419b496 1073741824 Jul 31 10:44:28 devstack sudo[94768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c2cfaa77-c47a-474d-a665-3706b0e9e6c0 tempest-SnapshotsActionsTest-587741653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:44:29 devstack sudo[94768]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d806bfbd-a1a3-4ad2-851a-5c504eeffbff tempest-AttachVolumeShelveTestJSON-1538487283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fb9648fd-713a-412b-95bf-9377e419b496 1073741824" returned: 0 in 0.505s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d806bfbd-a1a3-4ad2-851a-5c504eeffbff tempest-AttachVolumeShelveTestJSON-1538487283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fb9648fd-713a-412b-95bf-9377e419b496 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:29 devstack sudo[94774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fb9648fd-713a-412b-95bf-9377e419b496 Jul 31 10:44:29 devstack sudo[94774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:29 devstack sudo[94774]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d806bfbd-a1a3-4ad2-851a-5c504eeffbff tempest-AttachVolumeShelveTestJSON-1538487283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fb9648fd-713a-412b-95bf-9377e419b496" returned: 0 in 0.301s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:29 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d806bfbd-a1a3-4ad2-851a-5c504eeffbff tempest-AttachVolumeShelveTestJSON-1538487283 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:44:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d806bfbd-a1a3-4ad2-851a-5c504eeffbff tempest-AttachVolumeShelveTestJSON-1538487283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:44:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c2cfaa77-c47a-474d-a665-3706b0e9e6c0 tempest-SnapshotsActionsTest-587741653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.588s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:44:29 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-c2cfaa77-c47a-474d-a665-3706b0e9e6c0 tempest-SnapshotsActionsTest-587741653 None] Creating offline snapshot 4b7f7261-c1e0-4883-b4ba-0689cfa9db12 of volume 8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:44:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d806bfbd-a1a3-4ad2-851a-5c504eeffbff tempest-AttachVolumeShelveTestJSON-1538487283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e63d0bcf-5538-4670-8e87-55bcdaabf96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb9648fd-713a-412b-95bf-9377e419b496', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:44:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d806bfbd-a1a3-4ad2-851a-5c504eeffbff tempest-AttachVolumeShelveTestJSON-1538487283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0f00002-6e02-418d-81b2-1b1cac363672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:44:29 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[207971fe-5b2e-4045-9a44-a3f77985f046]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:44:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c2cfaa77-c47a-474d-a665-3706b0e9e6c0 tempest-SnapshotsActionsTest-587741653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:29 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-d806bfbd-a1a3-4ad2-851a-5c504eeffbff tempest-AttachVolumeShelveTestJSON-1538487283 None] Volume volume-fb9648fd-713a-412b-95bf-9377e419b496 (fb9648fd-713a-412b-95bf-9377e419b496): created successfully Jul 31 10:44:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d806bfbd-a1a3-4ad2-851a-5c504eeffbff tempest-AttachVolumeShelveTestJSON-1538487283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0f00002-6e02-418d-81b2-1b1cac363672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:44:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d806bfbd-a1a3-4ad2-851a-5c504eeffbff tempest-AttachVolumeShelveTestJSON-1538487283 None] Flow 'volume_create_manager' (21c8ef16-f5d8-4583-b497-965d9cb8e3aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:44:29 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-d806bfbd-a1a3-4ad2-851a-5c504eeffbff tempest-AttachVolumeShelveTestJSON-1538487283 None] Created volume successfully. Jul 31 10:44:29 devstack sudo[94777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc Jul 31 10:44:29 devstack sudo[94777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:30 devstack sudo[94777]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c2cfaa77-c47a-474d-a665-3706b0e9e6c0 tempest-SnapshotsActionsTest-587741653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc" returned: 0 in 0.444s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c2cfaa77-c47a-474d-a665-3706b0e9e6c0 tempest-SnapshotsActionsTest-587741653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:30 devstack sudo[94785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 1G Jul 31 10:44:30 devstack sudo[94785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:30 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-bebd21dc-9bf9-4a28-8136-4363d448b0e1 tempest-AttachVolumeNegativeTest-304126598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:44:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bebd21dc-9bf9-4a28-8136-4363d448b0e1 tempest-AttachVolumeNegativeTest-304126598 None] Flow 'volume_create_manager' (108a57f1-602c-4e9f-9e80-2dc76d1a75df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:44:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bebd21dc-9bf9-4a28-8136-4363d448b0e1 tempest-AttachVolumeNegativeTest-304126598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b150dfd-c23b-47e6-a0d2-05808d0352be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:44:30 devstack sudo[94785]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c2cfaa77-c47a-474d-a665-3706b0e9e6c0 tempest-SnapshotsActionsTest-587741653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 1G" returned: 0 in 0.602s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c2cfaa77-c47a-474d-a665-3706b0e9e6c0 tempest-SnapshotsActionsTest-587741653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bebd21dc-9bf9-4a28-8136-4363d448b0e1 tempest-AttachVolumeNegativeTest-304126598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b150dfd-c23b-47e6-a0d2-05808d0352be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-828252760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b96cacf-8e61-457e-9024-dfa1451fac15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='150270d988f34405bc30eabafd7ce55d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:44:31Z,use_quota=True,user_id='060655ab58f94503b45dab890a6c4419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:44:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bebd21dc-9bf9-4a28-8136-4363d448b0e1 tempest-AttachVolumeNegativeTest-304126598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d915ffe1-e755-44fa-a87a-36ea3f5e94c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:44:30 devstack sudo[94792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 Jul 31 10:44:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bebd21dc-9bf9-4a28-8136-4363d448b0e1 tempest-AttachVolumeNegativeTest-304126598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d915ffe1-e755-44fa-a87a-36ea3f5e94c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:44:30 devstack sudo[94792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bebd21dc-9bf9-4a28-8136-4363d448b0e1 tempest-AttachVolumeNegativeTest-304126598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6331f872-3472-4433-b74a-01541bf26bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:44:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bebd21dc-9bf9-4a28-8136-4363d448b0e1 tempest-AttachVolumeNegativeTest-304126598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6331f872-3472-4433-b74a-01541bf26bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b96cacf-8e61-457e-9024-dfa1451fac15', 'volume_name': 'volume-1b96cacf-8e61-457e-9024-dfa1451fac15', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:44:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bebd21dc-9bf9-4a28-8136-4363d448b0e1 tempest-AttachVolumeNegativeTest-304126598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68fc84c0-7441-4d11-b172-c2c289914f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:44:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bebd21dc-9bf9-4a28-8136-4363d448b0e1 tempest-AttachVolumeNegativeTest-304126598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68fc84c0-7441-4d11-b172-c2c289914f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:44:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bebd21dc-9bf9-4a28-8136-4363d448b0e1 tempest-AttachVolumeNegativeTest-304126598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af14917-bcc7-4649-8593-0e7633367ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:44:30 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-bebd21dc-9bf9-4a28-8136-4363d448b0e1 tempest-AttachVolumeNegativeTest-304126598 None] Volume 1b96cacf-8e61-457e-9024-dfa1451fac15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b96cacf-8e61-457e-9024-dfa1451fac15', 'volume_size': 1} Jul 31 10:44:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-bebd21dc-9bf9-4a28-8136-4363d448b0e1 tempest-AttachVolumeNegativeTest-304126598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:44:31 devstack sudo[94792]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c2cfaa77-c47a-474d-a665-3706b0e9e6c0 tempest-SnapshotsActionsTest-587741653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12" returned: 0 in 0.374s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:31 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-c2cfaa77-c47a-474d-a665-3706b0e9e6c0 tempest-SnapshotsActionsTest-587741653 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 is being set with open permissions: ugo+rw Jul 31 10:44:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c2cfaa77-c47a-474d-a665-3706b0e9e6c0 tempest-SnapshotsActionsTest-587741653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:31 devstack sudo[94800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 Jul 31 10:44:31 devstack sudo[94800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:31 devstack sudo[94800]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c2cfaa77-c47a-474d-a665-3706b0e9e6c0 tempest-SnapshotsActionsTest-587741653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12" returned: 0 in 0.318s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c2cfaa77-c47a-474d-a665-3706b0e9e6c0 tempest-SnapshotsActionsTest-587741653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:31 devstack sudo[94803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.info Jul 31 10:44:31 devstack sudo[94803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:31 devstack sudo[94803]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c2cfaa77-c47a-474d-a665-3706b0e9e6c0 tempest-SnapshotsActionsTest-587741653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.info" returned: 0 in 0.319s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:31 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-c2cfaa77-c47a-474d-a665-3706b0e9e6c0 tempest-SnapshotsActionsTest-587741653 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.info is being set with open permissions: ugo+rw Jul 31 10:44:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c2cfaa77-c47a-474d-a665-3706b0e9e6c0 tempest-SnapshotsActionsTest-587741653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:32 devstack sudo[94806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.info Jul 31 10:44:32 devstack sudo[94806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:32 devstack sudo[94806]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c2cfaa77-c47a-474d-a665-3706b0e9e6c0 tempest-SnapshotsActionsTest-587741653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.info" returned: 0 in 0.288s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c2cfaa77-c47a-474d-a665-3706b0e9e6c0 tempest-SnapshotsActionsTest-587741653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.492s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:44:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-bebd21dc-9bf9-4a28-8136-4363d448b0e1 tempest-AttachVolumeNegativeTest-304126598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.333s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:44:32 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-bebd21dc-9bf9-4a28-8136-4363d448b0e1 tempest-AttachVolumeNegativeTest-304126598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-828252760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b96cacf-8e61-457e-9024-dfa1451fac15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='150270d988f34405bc30eabafd7ce55d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:44:31Z,use_quota=True,user_id='060655ab58f94503b45dab890a6c4419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:44:32 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-bebd21dc-9bf9-4a28-8136-4363d448b0e1 tempest-AttachVolumeNegativeTest-304126598 None] Creating volume 1b96cacf-8e61-457e-9024-dfa1451fac15 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:44:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-bebd21dc-9bf9-4a28-8136-4363d448b0e1 tempest-AttachVolumeNegativeTest-304126598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:44:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-bebd21dc-9bf9-4a28-8136-4363d448b0e1 tempest-AttachVolumeNegativeTest-304126598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:44:32 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-bebd21dc-9bf9-4a28-8136-4363d448b0e1 tempest-AttachVolumeNegativeTest-304126598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:44:32 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-bebd21dc-9bf9-4a28-8136-4363d448b0e1 tempest-AttachVolumeNegativeTest-304126598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:44:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-bebd21dc-9bf9-4a28-8136-4363d448b0e1 tempest-AttachVolumeNegativeTest-304126598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:44:32 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-bebd21dc-9bf9-4a28-8136-4363d448b0e1 tempest-AttachVolumeNegativeTest-304126598 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:44:32 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-bebd21dc-9bf9-4a28-8136-4363d448b0e1 tempest-AttachVolumeNegativeTest-304126598 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:44:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bebd21dc-9bf9-4a28-8136-4363d448b0e1 tempest-AttachVolumeNegativeTest-304126598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1b96cacf-8e61-457e-9024-dfa1451fac15 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:32 devstack sudo[94809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1b96cacf-8e61-457e-9024-dfa1451fac15 1073741824 Jul 31 10:44:32 devstack sudo[94809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:32 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-c2cfaa77-c47a-474d-a665-3706b0e9e6c0 tempest-SnapshotsActionsTest-587741653 None] Create snapshot completed successfully Jul 31 10:44:33 devstack sudo[94809]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bebd21dc-9bf9-4a28-8136-4363d448b0e1 tempest-AttachVolumeNegativeTest-304126598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1b96cacf-8e61-457e-9024-dfa1451fac15 1073741824" returned: 0 in 0.693s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bebd21dc-9bf9-4a28-8136-4363d448b0e1 tempest-AttachVolumeNegativeTest-304126598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1b96cacf-8e61-457e-9024-dfa1451fac15 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:33 devstack sudo[94824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1b96cacf-8e61-457e-9024-dfa1451fac15 Jul 31 10:44:33 devstack sudo[94824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:33 devstack sudo[94824]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bebd21dc-9bf9-4a28-8136-4363d448b0e1 tempest-AttachVolumeNegativeTest-304126598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1b96cacf-8e61-457e-9024-dfa1451fac15" returned: 0 in 0.323s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:33 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-bebd21dc-9bf9-4a28-8136-4363d448b0e1 tempest-AttachVolumeNegativeTest-304126598 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:44:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-bebd21dc-9bf9-4a28-8136-4363d448b0e1 tempest-AttachVolumeNegativeTest-304126598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:44:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bebd21dc-9bf9-4a28-8136-4363d448b0e1 tempest-AttachVolumeNegativeTest-304126598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af14917-bcc7-4649-8593-0e7633367ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b96cacf-8e61-457e-9024-dfa1451fac15', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:44:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bebd21dc-9bf9-4a28-8136-4363d448b0e1 tempest-AttachVolumeNegativeTest-304126598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ea2c498-4fb3-4260-87f2-5162027960f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:44:33 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-bebd21dc-9bf9-4a28-8136-4363d448b0e1 tempest-AttachVolumeNegativeTest-304126598 None] Volume volume-1b96cacf-8e61-457e-9024-dfa1451fac15 (1b96cacf-8e61-457e-9024-dfa1451fac15): created successfully Jul 31 10:44:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bebd21dc-9bf9-4a28-8136-4363d448b0e1 tempest-AttachVolumeNegativeTest-304126598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ea2c498-4fb3-4260-87f2-5162027960f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:44:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bebd21dc-9bf9-4a28-8136-4363d448b0e1 tempest-AttachVolumeNegativeTest-304126598 None] Flow 'volume_create_manager' (108a57f1-602c-4e9f-9e80-2dc76d1a75df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:44:33 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-bebd21dc-9bf9-4a28-8136-4363d448b0e1 tempest-AttachVolumeNegativeTest-304126598 None] Created volume successfully. Jul 31 10:44:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-05e60a66-d463-4f8d-bfa2-a9452aa8ca79 tempest-SnapshotsActionsTest-587741653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:44:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-05e60a66-d463-4f8d-bfa2-a9452aa8ca79 tempest-SnapshotsActionsTest-587741653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:44:34 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-05e60a66-d463-4f8d-bfa2-a9452aa8ca79 tempest-SnapshotsActionsTest-587741653 None] Creating offline snapshot 123cef71-be0c-4079-a2ca-7107d3d6f67b of volume 8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:44:34 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f7c8d0-073f-4cbf-bfd4-273500064a6a]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:44:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-05e60a66-d463-4f8d-bfa2-a9452aa8ca79 tempest-SnapshotsActionsTest-587741653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:34 devstack sudo[94839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 Jul 31 10:44:34 devstack sudo[94839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:35 devstack sudo[94839]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-05e60a66-d463-4f8d-bfa2-a9452aa8ca79 tempest-SnapshotsActionsTest-587741653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12" returned: 0 in 0.567s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:35 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-05e60a66-d463-4f8d-bfa2-a9452aa8ca79 tempest-SnapshotsActionsTest-587741653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:44:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-05e60a66-d463-4f8d-bfa2-a9452aa8ca79 tempest-SnapshotsActionsTest-587741653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.123cef71-be0c-4079-a2ca-7107d3d6f67b 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:35 devstack sudo[94854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.123cef71-be0c-4079-a2ca-7107d3d6f67b 1G Jul 31 10:44:35 devstack sudo[94854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-728f1b57-8342-4fe6-bbc7-4b7670539b88 req-19749be2-1b35-4e2e-be8b-ed2251fe1598 tempest-AttachVolumeNegativeTest-304126598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:44:35 devstack sudo[94854]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-05e60a66-d463-4f8d-bfa2-a9452aa8ca79 tempest-SnapshotsActionsTest-587741653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.123cef71-be0c-4079-a2ca-7107d3d6f67b 1G" returned: 0 in 0.728s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-05e60a66-d463-4f8d-bfa2-a9452aa8ca79 tempest-SnapshotsActionsTest-587741653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.123cef71-be0c-4079-a2ca-7107d3d6f67b {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:35 devstack sudo[94862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.123cef71-be0c-4079-a2ca-7107d3d6f67b Jul 31 10:44:35 devstack sudo[94862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:36 devstack sudo[94862]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-05e60a66-d463-4f8d-bfa2-a9452aa8ca79 tempest-SnapshotsActionsTest-587741653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.123cef71-be0c-4079-a2ca-7107d3d6f67b" returned: 0 in 0.372s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:36 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-05e60a66-d463-4f8d-bfa2-a9452aa8ca79 tempest-SnapshotsActionsTest-587741653 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.123cef71-be0c-4079-a2ca-7107d3d6f67b is being set with open permissions: ugo+rw Jul 31 10:44:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-05e60a66-d463-4f8d-bfa2-a9452aa8ca79 tempest-SnapshotsActionsTest-587741653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.123cef71-be0c-4079-a2ca-7107d3d6f67b {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:36 devstack sudo[94867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.123cef71-be0c-4079-a2ca-7107d3d6f67b Jul 31 10:44:36 devstack sudo[94867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:36 devstack sudo[94867]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-05e60a66-d463-4f8d-bfa2-a9452aa8ca79 tempest-SnapshotsActionsTest-587741653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.123cef71-be0c-4079-a2ca-7107d3d6f67b" returned: 0 in 0.292s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-05e60a66-d463-4f8d-bfa2-a9452aa8ca79 tempest-SnapshotsActionsTest-587741653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.129s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:44:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-728f1b57-8342-4fe6-bbc7-4b7670539b88 req-19749be2-1b35-4e2e-be8b-ed2251fe1598 tempest-AttachVolumeNegativeTest-304126598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.241s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:44:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-728f1b57-8342-4fe6-bbc7-4b7670539b88 req-19749be2-1b35-4e2e-be8b-ed2251fe1598 tempest-AttachVolumeNegativeTest-304126598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:44:36 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-05e60a66-d463-4f8d-bfa2-a9452aa8ca79 tempest-SnapshotsActionsTest-587741653 None] Create snapshot completed successfully Jul 31 10:44:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-728f1b57-8342-4fe6-bbc7-4b7670539b88 req-19749be2-1b35-4e2e-be8b-ed2251fe1598 tempest-AttachVolumeNegativeTest-304126598 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c', 'name': 'volume-1b96cacf-8e61-457e-9024-dfa1451fac15', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7cbdb856-dcc1-4d37-a432-af2aa6546c3f', 'enforce_multipath': True} {{(pid=89090) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:44:36 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-728f1b57-8342-4fe6-bbc7-4b7670539b88 req-19749be2-1b35-4e2e-be8b-ed2251fe1598 tempest-AttachVolumeNegativeTest-304126598 None] attachment_update completed successfully. Jul 31 10:44:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6d954559-41c7-4f9f-9ac1-9ccd043ba9a6 tempest-SnapshotsActionsTest-1669610203 None] Acquiring lock "cinder-123cef71-be0c-4079-a2ca-7107d3d6f67b-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:44:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6d954559-41c7-4f9f-9ac1-9ccd043ba9a6 tempest-SnapshotsActionsTest-1669610203 None] Lock "cinder-123cef71-be0c-4079-a2ca-7107d3d6f67b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:44:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6d954559-41c7-4f9f-9ac1-9ccd043ba9a6 tempest-SnapshotsActionsTest-1669610203 None] Acquiring lock "cinder-quobyte-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:44:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6d954559-41c7-4f9f-9ac1-9ccd043ba9a6 tempest-SnapshotsActionsTest-1669610203 None] Lock "cinder-quobyte-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc" acquired by "delete_snapshot" :: waited 0.023s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:44:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6d954559-41c7-4f9f-9ac1-9ccd043ba9a6 tempest-SnapshotsActionsTest-1669610203 None] Acquiring lock "cinder-quobyte-123cef71-be0c-4079-a2ca-7107d3d6f67b" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:44:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6d954559-41c7-4f9f-9ac1-9ccd043ba9a6 tempest-SnapshotsActionsTest-1669610203 None] Lock "cinder-quobyte-123cef71-be0c-4079-a2ca-7107d3d6f67b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:44:37 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-6d954559-41c7-4f9f-9ac1-9ccd043ba9a6 tempest-SnapshotsActionsTest-1669610203 None] Deleting offline snapshot 123cef71-be0c-4079-a2ca-7107d3d6f67b of volume 8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:44:37 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-6d954559-41c7-4f9f-9ac1-9ccd043ba9a6 tempest-SnapshotsActionsTest-1669610203 None] snapshot_file for this snap is: volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.123cef71-be0c-4079-a2ca-7107d3d6f67b {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:44:37 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[4643a751-9b4f-4e40-b20f-63bf3131ef8b]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:44:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6d954559-41c7-4f9f-9ac1-9ccd043ba9a6 tempest-SnapshotsActionsTest-1669610203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.123cef71-be0c-4079-a2ca-7107d3d6f67b {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:38 devstack sudo[95258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.123cef71-be0c-4079-a2ca-7107d3d6f67b Jul 31 10:44:38 devstack sudo[95258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:38 devstack sudo[95258]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6d954559-41c7-4f9f-9ac1-9ccd043ba9a6 tempest-SnapshotsActionsTest-1669610203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.123cef71-be0c-4079-a2ca-7107d3d6f67b" returned: 0 in 0.616s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:38 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-6d954559-41c7-4f9f-9ac1-9ccd043ba9a6 tempest-SnapshotsActionsTest-1669610203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:44:38 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae7d1e0-91fd-4a0d-836d-492608d8d43f]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:44:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6d954559-41c7-4f9f-9ac1-9ccd043ba9a6 tempest-SnapshotsActionsTest-1669610203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:38 devstack sudo[95265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 Jul 31 10:44:38 devstack sudo[95265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:39 devstack sudo[95265]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6d954559-41c7-4f9f-9ac1-9ccd043ba9a6 tempest-SnapshotsActionsTest-1669610203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12" returned: 0 in 0.547s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:39 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-6d954559-41c7-4f9f-9ac1-9ccd043ba9a6 tempest-SnapshotsActionsTest-1669610203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:44:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6d954559-41c7-4f9f-9ac1-9ccd043ba9a6 tempest-SnapshotsActionsTest-1669610203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.123cef71-be0c-4079-a2ca-7107d3d6f67b {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:39 devstack sudo[95271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.123cef71-be0c-4079-a2ca-7107d3d6f67b Jul 31 10:44:39 devstack sudo[95271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:39 devstack sudo[95271]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6d954559-41c7-4f9f-9ac1-9ccd043ba9a6 tempest-SnapshotsActionsTest-1669610203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.123cef71-be0c-4079-a2ca-7107d3d6f67b" returned: 0 in 0.558s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6d954559-41c7-4f9f-9ac1-9ccd043ba9a6 tempest-SnapshotsActionsTest-1669610203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.123cef71-be0c-4079-a2ca-7107d3d6f67b {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:39 devstack sudo[95306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.123cef71-be0c-4079-a2ca-7107d3d6f67b Jul 31 10:44:39 devstack sudo[95306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:39 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-fc660d87-c5a9-425a-90e7-72cfd88aa880 req-cff47a52-f8f3-4ed6-81f3-dc9182371e42 tempest-AttachVolumeNegativeTest-304126598 None] Terminate volume connection completed successfully. Jul 31 10:44:39 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-fc660d87-c5a9-425a-90e7-72cfd88aa880 req-cff47a52-f8f3-4ed6-81f3-dc9182371e42 tempest-AttachVolumeNegativeTest-304126598 None] Deleting attachment 7cbdb856-dcc1-4d37-a432-af2aa6546c3f. {{(pid=89090) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:44:40 devstack sudo[95306]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6d954559-41c7-4f9f-9ac1-9ccd043ba9a6 tempest-SnapshotsActionsTest-1669610203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.123cef71-be0c-4079-a2ca-7107d3d6f67b" returned: 0 in 0.416s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:40 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6d954559-41c7-4f9f-9ac1-9ccd043ba9a6 tempest-SnapshotsActionsTest-1669610203 None] Lock "cinder-quobyte-123cef71-be0c-4079-a2ca-7107d3d6f67b" released by "_delete_snapshot" :: held 2.310s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:44:40 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6d954559-41c7-4f9f-9ac1-9ccd043ba9a6 tempest-SnapshotsActionsTest-1669610203 None] Lock "cinder-quobyte-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc" released by "delete_snapshot" :: held 2.340s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:44:40 devstack cinder-volume[89090]: WARNING cinder.quota [None req-6d954559-41c7-4f9f-9ac1-9ccd043ba9a6 tempest-SnapshotsActionsTest-1669610203 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:44:40 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-6d954559-41c7-4f9f-9ac1-9ccd043ba9a6 tempest-SnapshotsActionsTest-1669610203 None] Created reservations ['43c864e2-0d2c-4ddd-8c58-09e047ed330e', 'bcb3cfe8-758b-4b9f-b178-02f55756bb5f', '7522a38e-c60a-4b8d-9434-c0d75fa6898d', '8b4cbbbd-1963-44ad-8ed1-26b235f69dcf'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:44:40 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-6d954559-41c7-4f9f-9ac1-9ccd043ba9a6 tempest-SnapshotsActionsTest-1669610203 None] Delete snapshot completed successfully. Jul 31 10:44:40 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6d954559-41c7-4f9f-9ac1-9ccd043ba9a6 tempest-SnapshotsActionsTest-1669610203 None] Lock "cinder-123cef71-be0c-4079-a2ca-7107d3d6f67b-delete_snapshot" released by "delete_snapshot" :: held 2.626s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:44:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-80956a42-a253-4837-8d45-2fca8bd8236d tempest-SnapshotsActionsTest-587741653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:44:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-80956a42-a253-4837-8d45-2fca8bd8236d tempest-SnapshotsActionsTest-587741653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:44:42 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-80956a42-a253-4837-8d45-2fca8bd8236d tempest-SnapshotsActionsTest-587741653 None] Creating offline snapshot bff65347-1f46-4952-95b5-8092119e73fd of volume 8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:44:42 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2e3647-0c5c-4246-a713-94e0bc60ba3c]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:44:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-80956a42-a253-4837-8d45-2fca8bd8236d tempest-SnapshotsActionsTest-587741653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:42 devstack sudo[95347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 Jul 31 10:44:42 devstack sudo[95347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:42 devstack sudo[95347]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-80956a42-a253-4837-8d45-2fca8bd8236d tempest-SnapshotsActionsTest-587741653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12" returned: 0 in 0.806s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:42 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-80956a42-a253-4837-8d45-2fca8bd8236d tempest-SnapshotsActionsTest-587741653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:44:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-80956a42-a253-4837-8d45-2fca8bd8236d tempest-SnapshotsActionsTest-587741653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.bff65347-1f46-4952-95b5-8092119e73fd 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:42 devstack sudo[95354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.bff65347-1f46-4952-95b5-8092119e73fd 1G Jul 31 10:44:42 devstack sudo[95354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:43 devstack sudo[95354]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-80956a42-a253-4837-8d45-2fca8bd8236d tempest-SnapshotsActionsTest-587741653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.bff65347-1f46-4952-95b5-8092119e73fd 1G" returned: 0 in 0.630s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-80956a42-a253-4837-8d45-2fca8bd8236d tempest-SnapshotsActionsTest-587741653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.bff65347-1f46-4952-95b5-8092119e73fd {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:43 devstack sudo[95360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.bff65347-1f46-4952-95b5-8092119e73fd Jul 31 10:44:43 devstack sudo[95360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:43 devstack sudo[95360]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-80956a42-a253-4837-8d45-2fca8bd8236d tempest-SnapshotsActionsTest-587741653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.bff65347-1f46-4952-95b5-8092119e73fd" returned: 0 in 0.411s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:43 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-80956a42-a253-4837-8d45-2fca8bd8236d tempest-SnapshotsActionsTest-587741653 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.bff65347-1f46-4952-95b5-8092119e73fd is being set with open permissions: ugo+rw Jul 31 10:44:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-80956a42-a253-4837-8d45-2fca8bd8236d tempest-SnapshotsActionsTest-587741653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.bff65347-1f46-4952-95b5-8092119e73fd {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:43 devstack sudo[95365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.bff65347-1f46-4952-95b5-8092119e73fd Jul 31 10:44:43 devstack sudo[95365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:44 devstack sudo[95365]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-80956a42-a253-4837-8d45-2fca8bd8236d tempest-SnapshotsActionsTest-587741653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.bff65347-1f46-4952-95b5-8092119e73fd" returned: 0 in 0.338s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-80956a42-a253-4837-8d45-2fca8bd8236d tempest-SnapshotsActionsTest-587741653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.403s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:44:44 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-80956a42-a253-4837-8d45-2fca8bd8236d tempest-SnapshotsActionsTest-587741653 None] Create snapshot completed successfully Jul 31 10:44:45 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-348f5bd8-c3dd-4b91-b360-66f15f687a19 tempest-SnapshotsActionsTest-1669610203 None] Acquiring lock "cinder-bff65347-1f46-4952-95b5-8092119e73fd-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:44:45 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-348f5bd8-c3dd-4b91-b360-66f15f687a19 tempest-SnapshotsActionsTest-1669610203 None] Lock "cinder-bff65347-1f46-4952-95b5-8092119e73fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:44:45 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-348f5bd8-c3dd-4b91-b360-66f15f687a19 tempest-SnapshotsActionsTest-1669610203 None] Acquiring lock "cinder-quobyte-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:44:45 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-348f5bd8-c3dd-4b91-b360-66f15f687a19 tempest-SnapshotsActionsTest-1669610203 None] Lock "cinder-quobyte-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc" acquired by "delete_snapshot" :: waited 0.029s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:44:45 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-348f5bd8-c3dd-4b91-b360-66f15f687a19 tempest-SnapshotsActionsTest-1669610203 None] Acquiring lock "cinder-quobyte-bff65347-1f46-4952-95b5-8092119e73fd" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:44:45 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-348f5bd8-c3dd-4b91-b360-66f15f687a19 tempest-SnapshotsActionsTest-1669610203 None] Lock "cinder-quobyte-bff65347-1f46-4952-95b5-8092119e73fd" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:44:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-348f5bd8-c3dd-4b91-b360-66f15f687a19 tempest-SnapshotsActionsTest-1669610203 None] Deleting offline snapshot bff65347-1f46-4952-95b5-8092119e73fd of volume 8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:44:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-348f5bd8-c3dd-4b91-b360-66f15f687a19 tempest-SnapshotsActionsTest-1669610203 None] snapshot_file for this snap is: volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.bff65347-1f46-4952-95b5-8092119e73fd {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:44:45 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8c3a4c-e813-41e4-a7be-2d0f9b8d7e36]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:44:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-348f5bd8-c3dd-4b91-b360-66f15f687a19 tempest-SnapshotsActionsTest-1669610203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.bff65347-1f46-4952-95b5-8092119e73fd {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:45 devstack sudo[95371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.bff65347-1f46-4952-95b5-8092119e73fd Jul 31 10:44:45 devstack sudo[95371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:45 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:44:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:44:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:44:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:44:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:44:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:44:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:45 devstack sudo[95375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:44:45 devstack sudo[95375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:46 devstack sudo[95371]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-348f5bd8-c3dd-4b91-b360-66f15f687a19 tempest-SnapshotsActionsTest-1669610203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.bff65347-1f46-4952-95b5-8092119e73fd" returned: 0 in 0.751s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:46 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-348f5bd8-c3dd-4b91-b360-66f15f687a19 tempest-SnapshotsActionsTest-1669610203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:44:46 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68a853b-9bd4-4db4-a8b0-69f1957a00cd]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:44:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-348f5bd8-c3dd-4b91-b360-66f15f687a19 tempest-SnapshotsActionsTest-1669610203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:46 devstack sudo[95375]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.505s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:46 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:44:46 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager._thread_info {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:44:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread count: 28 {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:44:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread info: [<_MainThread(MainThread, started 134005426110592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:44:46 devstack sudo[95379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 Jul 31 10:44:46 devstack sudo[95379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:46 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-81ddf02a-87fa-4c74-a954-a4e45f5c5cef tempest-VolumesActionsTest-1848272351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:44:46 devstack sudo[95379]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-81ddf02a-87fa-4c74-a954-a4e45f5c5cef tempest-VolumesActionsTest-1848272351 None] Flow 'volume_create_manager' (859cadfa-55dd-44e7-9701-214991a88573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:44:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-81ddf02a-87fa-4c74-a954-a4e45f5c5cef tempest-VolumesActionsTest-1848272351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4fc065b-6254-4ba8-87fb-87e79f9f752b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:44:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-348f5bd8-c3dd-4b91-b360-66f15f687a19 tempest-SnapshotsActionsTest-1669610203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12" returned: 0 in 0.714s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:46 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-348f5bd8-c3dd-4b91-b360-66f15f687a19 tempest-SnapshotsActionsTest-1669610203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:44:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-348f5bd8-c3dd-4b91-b360-66f15f687a19 tempest-SnapshotsActionsTest-1669610203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.bff65347-1f46-4952-95b5-8092119e73fd {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-81ddf02a-87fa-4c74-a954-a4e45f5c5cef tempest-VolumesActionsTest-1848272351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4fc065b-6254-4ba8-87fb-87e79f9f752b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1447740341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd979657-441f-44ff-a3e3-c53502d968a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57995fc32664cc2aa81a1b7c222eb0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:44:47Z,use_quota=True,user_id='0dbb5fc82f13402dae03e32072a1068c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:44:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-81ddf02a-87fa-4c74-a954-a4e45f5c5cef tempest-VolumesActionsTest-1848272351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab5fb582-cadd-40c0-9311-f909fd34441c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:44:46 devstack sudo[95386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.bff65347-1f46-4952-95b5-8092119e73fd Jul 31 10:44:46 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-81ddf02a-87fa-4c74-a954-a4e45f5c5cef tempest-VolumesActionsTest-1848272351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab5fb582-cadd-40c0-9311-f909fd34441c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:44:47 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-81ddf02a-87fa-4c74-a954-a4e45f5c5cef tempest-VolumesActionsTest-1848272351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2468f294-a927-4d0f-bea2-d91ab853092a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:44:47 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-81ddf02a-87fa-4c74-a954-a4e45f5c5cef tempest-VolumesActionsTest-1848272351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2468f294-a927-4d0f-bea2-d91ab853092a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd979657-441f-44ff-a3e3-c53502d968a1', 'volume_name': 'volume-dd979657-441f-44ff-a3e3-c53502d968a1', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:44:47 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-81ddf02a-87fa-4c74-a954-a4e45f5c5cef tempest-VolumesActionsTest-1848272351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e369e8-7901-42e7-8b00-a73942779f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:44:47 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-81ddf02a-87fa-4c74-a954-a4e45f5c5cef tempest-VolumesActionsTest-1848272351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e369e8-7901-42e7-8b00-a73942779f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:44:47 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-81ddf02a-87fa-4c74-a954-a4e45f5c5cef tempest-VolumesActionsTest-1848272351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30025190-f788-478a-8645-8a95913d7d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:44:47 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-81ddf02a-87fa-4c74-a954-a4e45f5c5cef tempest-VolumesActionsTest-1848272351 None] Volume dd979657-441f-44ff-a3e3-c53502d968a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd979657-441f-44ff-a3e3-c53502d968a1', 'volume_size': 1} Jul 31 10:44:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-81ddf02a-87fa-4c74-a954-a4e45f5c5cef tempest-VolumesActionsTest-1848272351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:44:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-81ddf02a-87fa-4c74-a954-a4e45f5c5cef tempest-VolumesActionsTest-1848272351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:44:47 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-81ddf02a-87fa-4c74-a954-a4e45f5c5cef tempest-VolumesActionsTest-1848272351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1447740341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd979657-441f-44ff-a3e3-c53502d968a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57995fc32664cc2aa81a1b7c222eb0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:44:47Z,use_quota=True,user_id='0dbb5fc82f13402dae03e32072a1068c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:44:47 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-81ddf02a-87fa-4c74-a954-a4e45f5c5cef tempest-VolumesActionsTest-1848272351 None] Creating volume dd979657-441f-44ff-a3e3-c53502d968a1 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:44:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-81ddf02a-87fa-4c74-a954-a4e45f5c5cef tempest-VolumesActionsTest-1848272351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:44:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-81ddf02a-87fa-4c74-a954-a4e45f5c5cef tempest-VolumesActionsTest-1848272351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:44:47 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-81ddf02a-87fa-4c74-a954-a4e45f5c5cef tempest-VolumesActionsTest-1848272351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:44:47 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-81ddf02a-87fa-4c74-a954-a4e45f5c5cef tempest-VolumesActionsTest-1848272351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:44:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-81ddf02a-87fa-4c74-a954-a4e45f5c5cef tempest-VolumesActionsTest-1848272351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:44:47 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-81ddf02a-87fa-4c74-a954-a4e45f5c5cef tempest-VolumesActionsTest-1848272351 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:44:47 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-81ddf02a-87fa-4c74-a954-a4e45f5c5cef tempest-VolumesActionsTest-1848272351 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:44:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-81ddf02a-87fa-4c74-a954-a4e45f5c5cef tempest-VolumesActionsTest-1848272351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-dd979657-441f-44ff-a3e3-c53502d968a1 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:47 devstack sudo[95388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-dd979657-441f-44ff-a3e3-c53502d968a1 1073741824 Jul 31 10:44:47 devstack sudo[95388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:47 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-2e1ce7f3-b90b-4cf7-97eb-03e7183e9a62 req-e778c983-6c4b-40c0-bc99-19ce09c7cc53 tempest-AttachVolumeShelveTestJSON-1538487283 None] No connector for attachment b593504d-1090-4441-b4b4-b1d3318442d7; skipping storage backend terminate_connection call. {{(pid=89090) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 31 10:44:47 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-2e1ce7f3-b90b-4cf7-97eb-03e7183e9a62 req-e778c983-6c4b-40c0-bc99-19ce09c7cc53 tempest-AttachVolumeShelveTestJSON-1538487283 None] Deleting attachment b593504d-1090-4441-b4b4-b1d3318442d7. {{(pid=89090) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:44:47 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-348f5bd8-c3dd-4b91-b360-66f15f687a19 tempest-SnapshotsActionsTest-1669610203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.bff65347-1f46-4952-95b5-8092119e73fd" returned: 0 in 0.671s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-348f5bd8-c3dd-4b91-b360-66f15f687a19 tempest-SnapshotsActionsTest-1669610203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.bff65347-1f46-4952-95b5-8092119e73fd {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:47 devstack sudo[95397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.bff65347-1f46-4952-95b5-8092119e73fd Jul 31 10:44:47 devstack sudo[95397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:47 devstack sudo[95388]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-81ddf02a-87fa-4c74-a954-a4e45f5c5cef tempest-VolumesActionsTest-1848272351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-dd979657-441f-44ff-a3e3-c53502d968a1 1073741824" returned: 0 in 0.778s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-81ddf02a-87fa-4c74-a954-a4e45f5c5cef tempest-VolumesActionsTest-1848272351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-dd979657-441f-44ff-a3e3-c53502d968a1 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:48 devstack sudo[95400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-dd979657-441f-44ff-a3e3-c53502d968a1 Jul 31 10:44:48 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:48 devstack sudo[95397]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-348f5bd8-c3dd-4b91-b360-66f15f687a19 tempest-SnapshotsActionsTest-1669610203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.bff65347-1f46-4952-95b5-8092119e73fd" returned: 0 in 0.463s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:48 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-348f5bd8-c3dd-4b91-b360-66f15f687a19 tempest-SnapshotsActionsTest-1669610203 None] Lock "cinder-quobyte-bff65347-1f46-4952-95b5-8092119e73fd" released by "_delete_snapshot" :: held 2.859s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:44:48 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-348f5bd8-c3dd-4b91-b360-66f15f687a19 tempest-SnapshotsActionsTest-1669610203 None] Lock "cinder-quobyte-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc" released by "delete_snapshot" :: held 2.895s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:44:48 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-348f5bd8-c3dd-4b91-b360-66f15f687a19 tempest-SnapshotsActionsTest-1669610203 None] Created reservations ['93b7eb49-f110-464e-9a57-1686f18465ae', '744f57d9-a7f4-4816-947f-2220430239dd', 'ecc9cde0-614f-4a43-8a4e-e9fd0e585d73', '6c7312e8-f25f-41ce-9a1f-f488d39dae9d'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:44:48 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:48 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-348f5bd8-c3dd-4b91-b360-66f15f687a19 tempest-SnapshotsActionsTest-1669610203 None] Delete snapshot completed successfully. Jul 31 10:44:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-81ddf02a-87fa-4c74-a954-a4e45f5c5cef tempest-VolumesActionsTest-1848272351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-dd979657-441f-44ff-a3e3-c53502d968a1" returned: 0 in 0.532s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:48 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-81ddf02a-87fa-4c74-a954-a4e45f5c5cef tempest-VolumesActionsTest-1848272351 None] <== create_volume: return (1424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:44:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-81ddf02a-87fa-4c74-a954-a4e45f5c5cef tempest-VolumesActionsTest-1848272351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.429s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:44:48 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-348f5bd8-c3dd-4b91-b360-66f15f687a19 tempest-SnapshotsActionsTest-1669610203 None] Lock "cinder-bff65347-1f46-4952-95b5-8092119e73fd-delete_snapshot" released by "delete_snapshot" :: held 3.250s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:44:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-81ddf02a-87fa-4c74-a954-a4e45f5c5cef tempest-VolumesActionsTest-1848272351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30025190-f788-478a-8645-8a95913d7d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd979657-441f-44ff-a3e3-c53502d968a1', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:44:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-81ddf02a-87fa-4c74-a954-a4e45f5c5cef tempest-VolumesActionsTest-1848272351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a0cb0c2-fc38-4fb7-9b86-5fcd6febcafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:44:48 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-81ddf02a-87fa-4c74-a954-a4e45f5c5cef tempest-VolumesActionsTest-1848272351 None] Volume volume-dd979657-441f-44ff-a3e3-c53502d968a1 (dd979657-441f-44ff-a3e3-c53502d968a1): created successfully Jul 31 10:44:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-81ddf02a-87fa-4c74-a954-a4e45f5c5cef tempest-VolumesActionsTest-1848272351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a0cb0c2-fc38-4fb7-9b86-5fcd6febcafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:44:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-81ddf02a-87fa-4c74-a954-a4e45f5c5cef tempest-VolumesActionsTest-1848272351 None] Flow 'volume_create_manager' (859cadfa-55dd-44e7-9701-214991a88573) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:44:48 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-81ddf02a-87fa-4c74-a954-a4e45f5c5cef tempest-VolumesActionsTest-1848272351 None] Created volume successfully. Jul 31 10:44:48 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ab7a7ff8-72b2-45ea-9057-1e4d7e6aec50 tempest-AttachVolumeNegativeTest-304126598 None] Acquiring lock "cinder-1b96cacf-8e61-457e-9024-dfa1451fac15-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:44:48 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ab7a7ff8-72b2-45ea-9057-1e4d7e6aec50 tempest-AttachVolumeNegativeTest-304126598 None] Lock "cinder-1b96cacf-8e61-457e-9024-dfa1451fac15-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:44:48 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ab7a7ff8-72b2-45ea-9057-1e4d7e6aec50 tempest-AttachVolumeNegativeTest-304126598 None] Acquiring lock "cinder-quobyte-1b96cacf-8e61-457e-9024-dfa1451fac15" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:44:48 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ab7a7ff8-72b2-45ea-9057-1e4d7e6aec50 tempest-AttachVolumeNegativeTest-304126598 None] Lock "cinder-quobyte-1b96cacf-8e61-457e-9024-dfa1451fac15" acquired by "delete_volume" :: waited 0.036s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:44:48 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a34fa2-4518-4639-977e-b1a2350afd1b]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:44:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ab7a7ff8-72b2-45ea-9057-1e4d7e6aec50 tempest-AttachVolumeNegativeTest-304126598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1b96cacf-8e61-457e-9024-dfa1451fac15 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:48 devstack sudo[95405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1b96cacf-8e61-457e-9024-dfa1451fac15 Jul 31 10:44:48 devstack sudo[95405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-22249f69-cdf9-4162-b7e4-953781abb68e tempest-SnapshotsActionsTest-587741653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:44:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-22249f69-cdf9-4162-b7e4-953781abb68e tempest-SnapshotsActionsTest-587741653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:44:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-22249f69-cdf9-4162-b7e4-953781abb68e tempest-SnapshotsActionsTest-587741653 None] Creating offline snapshot 586c1b43-b5a2-4c0e-a60b-714566285176 of volume 8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:44:49 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6999bfb-721d-42ad-bf32-935f93ff6c20]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:44:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-22249f69-cdf9-4162-b7e4-953781abb68e tempest-SnapshotsActionsTest-587741653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:49 devstack sudo[95407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 Jul 31 10:44:49 devstack sudo[95407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:49 devstack sudo[95405]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ab7a7ff8-72b2-45ea-9057-1e4d7e6aec50 tempest-AttachVolumeNegativeTest-304126598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1b96cacf-8e61-457e-9024-dfa1451fac15" returned: 0 in 0.643s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ab7a7ff8-72b2-45ea-9057-1e4d7e6aec50 tempest-AttachVolumeNegativeTest-304126598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1b96cacf-8e61-457e-9024-dfa1451fac15 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:49 devstack sudo[95412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1b96cacf-8e61-457e-9024-dfa1451fac15 Jul 31 10:44:49 devstack sudo[95412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:49 devstack sudo[95407]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-22249f69-cdf9-4162-b7e4-953781abb68e tempest-SnapshotsActionsTest-587741653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12" returned: 0 in 0.641s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-22249f69-cdf9-4162-b7e4-953781abb68e tempest-SnapshotsActionsTest-587741653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:44:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-22249f69-cdf9-4162-b7e4-953781abb68e tempest-SnapshotsActionsTest-587741653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.586c1b43-b5a2-4c0e-a60b-714566285176 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:49 devstack sudo[95421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.586c1b43-b5a2-4c0e-a60b-714566285176 1G Jul 31 10:44:49 devstack sudo[95421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:49 devstack sudo[95412]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ab7a7ff8-72b2-45ea-9057-1e4d7e6aec50 tempest-AttachVolumeNegativeTest-304126598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1b96cacf-8e61-457e-9024-dfa1451fac15" returned: 0 in 0.517s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:49 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ab7a7ff8-72b2-45ea-9057-1e4d7e6aec50 tempest-AttachVolumeNegativeTest-304126598 None] Lock "cinder-quobyte-1b96cacf-8e61-457e-9024-dfa1451fac15" released by "delete_volume" :: held 1.228s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:44:50 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-ab7a7ff8-72b2-45ea-9057-1e4d7e6aec50 tempest-AttachVolumeNegativeTest-304126598 None] Created reservations ['cedf98fe-0af7-497b-92e4-147716c9718d', 'bd64da14-d4ae-422d-ac9d-3cfc1c5a4d2a', '5dce0104-380a-45db-82a4-c04007a6f0e8', 'b0bda72f-b0f8-4c76-b03e-a2e14a8962e6'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:44:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ab7a7ff8-72b2-45ea-9057-1e4d7e6aec50 tempest-AttachVolumeNegativeTest-304126598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:44:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ab7a7ff8-72b2-45ea-9057-1e4d7e6aec50 tempest-AttachVolumeNegativeTest-304126598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:44:50 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ab7a7ff8-72b2-45ea-9057-1e4d7e6aec50 tempest-AttachVolumeNegativeTest-304126598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:44:50 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ab7a7ff8-72b2-45ea-9057-1e4d7e6aec50 tempest-AttachVolumeNegativeTest-304126598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:44:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ab7a7ff8-72b2-45ea-9057-1e4d7e6aec50 tempest-AttachVolumeNegativeTest-304126598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:44:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ab7a7ff8-72b2-45ea-9057-1e4d7e6aec50 tempest-AttachVolumeNegativeTest-304126598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:50 devstack sudo[95425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:44:50 devstack sudo[95425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:50 devstack sudo[95421]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-22249f69-cdf9-4162-b7e4-953781abb68e tempest-SnapshotsActionsTest-587741653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.586c1b43-b5a2-4c0e-a60b-714566285176 1G" returned: 0 in 0.697s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-22249f69-cdf9-4162-b7e4-953781abb68e tempest-SnapshotsActionsTest-587741653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.586c1b43-b5a2-4c0e-a60b-714566285176 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:50 devstack sudo[95433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.586c1b43-b5a2-4c0e-a60b-714566285176 Jul 31 10:44:50 devstack sudo[95433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:50 devstack sudo[95425]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ab7a7ff8-72b2-45ea-9057-1e4d7e6aec50 tempest-AttachVolumeNegativeTest-304126598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.445s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:50 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-ab7a7ff8-72b2-45ea-9057-1e4d7e6aec50 tempest-AttachVolumeNegativeTest-304126598 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:44:50 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-ab7a7ff8-72b2-45ea-9057-1e4d7e6aec50 tempest-AttachVolumeNegativeTest-304126598 None] Deleted volume successfully. Jul 31 10:44:50 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ab7a7ff8-72b2-45ea-9057-1e4d7e6aec50 tempest-AttachVolumeNegativeTest-304126598 None] Lock "cinder-1b96cacf-8e61-457e-9024-dfa1451fac15-delete_volume" released by "delete_volume" :: held 2.086s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:44:50 devstack sudo[95433]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-22249f69-cdf9-4162-b7e4-953781abb68e tempest-SnapshotsActionsTest-587741653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.586c1b43-b5a2-4c0e-a60b-714566285176" returned: 0 in 0.402s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:50 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-22249f69-cdf9-4162-b7e4-953781abb68e tempest-SnapshotsActionsTest-587741653 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.586c1b43-b5a2-4c0e-a60b-714566285176 is being set with open permissions: ugo+rw Jul 31 10:44:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-22249f69-cdf9-4162-b7e4-953781abb68e tempest-SnapshotsActionsTest-587741653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.586c1b43-b5a2-4c0e-a60b-714566285176 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:51 devstack sudo[95440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.586c1b43-b5a2-4c0e-a60b-714566285176 Jul 31 10:44:51 devstack sudo[95440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:51 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ff6e14a8-d524-472c-95fe-eb2cdfb6cfe9 tempest-AttachVolumeNegativeTest-304126598 None] Acquiring lock "cinder-bf10d8be-4a7f-4826-a778-b6386c3368ce-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:44:51 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ff6e14a8-d524-472c-95fe-eb2cdfb6cfe9 tempest-AttachVolumeNegativeTest-304126598 None] Lock "cinder-bf10d8be-4a7f-4826-a778-b6386c3368ce-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:44:51 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ff6e14a8-d524-472c-95fe-eb2cdfb6cfe9 tempest-AttachVolumeNegativeTest-304126598 None] Acquiring lock "cinder-quobyte-bf10d8be-4a7f-4826-a778-b6386c3368ce" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:44:51 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ff6e14a8-d524-472c-95fe-eb2cdfb6cfe9 tempest-AttachVolumeNegativeTest-304126598 None] Lock "cinder-quobyte-bf10d8be-4a7f-4826-a778-b6386c3368ce" acquired by "delete_volume" :: waited 0.022s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:44:51 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[45dc254e-e885-456f-bb65-178ddc30198e]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:44:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ff6e14a8-d524-472c-95fe-eb2cdfb6cfe9 tempest-AttachVolumeNegativeTest-304126598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bf10d8be-4a7f-4826-a778-b6386c3368ce {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:51 devstack sudo[95440]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-22249f69-cdf9-4162-b7e4-953781abb68e tempest-SnapshotsActionsTest-587741653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.586c1b43-b5a2-4c0e-a60b-714566285176" returned: 0 in 0.418s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-22249f69-cdf9-4162-b7e4-953781abb68e tempest-SnapshotsActionsTest-587741653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.347s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:44:51 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-22249f69-cdf9-4162-b7e4-953781abb68e tempest-SnapshotsActionsTest-587741653 None] Create snapshot completed successfully Jul 31 10:44:51 devstack sudo[95443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bf10d8be-4a7f-4826-a778-b6386c3368ce Jul 31 10:44:51 devstack sudo[95443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:51 devstack sudo[95443]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ff6e14a8-d524-472c-95fe-eb2cdfb6cfe9 tempest-AttachVolumeNegativeTest-304126598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bf10d8be-4a7f-4826-a778-b6386c3368ce" returned: 0 in 0.567s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ff6e14a8-d524-472c-95fe-eb2cdfb6cfe9 tempest-AttachVolumeNegativeTest-304126598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bf10d8be-4a7f-4826-a778-b6386c3368ce {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:51 devstack sudo[95449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bf10d8be-4a7f-4826-a778-b6386c3368ce Jul 31 10:44:51 devstack sudo[95449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:52 devstack sudo[95449]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ff6e14a8-d524-472c-95fe-eb2cdfb6cfe9 tempest-AttachVolumeNegativeTest-304126598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bf10d8be-4a7f-4826-a778-b6386c3368ce" returned: 0 in 0.307s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:52 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ff6e14a8-d524-472c-95fe-eb2cdfb6cfe9 tempest-AttachVolumeNegativeTest-304126598 None] Lock "cinder-quobyte-bf10d8be-4a7f-4826-a778-b6386c3368ce" released by "delete_volume" :: held 0.935s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:44:52 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-ff6e14a8-d524-472c-95fe-eb2cdfb6cfe9 tempest-AttachVolumeNegativeTest-304126598 None] Created reservations ['fbe6e789-8e70-4be5-8e34-49da68841d09', 'dff7ee58-ff7d-4091-8268-7b10c25d28e4', 'f1dd79de-ceb9-41d6-84d8-0bb0ab617dab', '71df9f21-dbfb-4e3b-924b-d6c5d66bd55d'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:44:52 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f3aef77c-9624-4900-adaf-d1f5dc91e4a5 tempest-SnapshotsActionsTest-1669610203 None] Acquiring lock "cinder-586c1b43-b5a2-4c0e-a60b-714566285176-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:44:52 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f3aef77c-9624-4900-adaf-d1f5dc91e4a5 tempest-SnapshotsActionsTest-1669610203 None] Lock "cinder-586c1b43-b5a2-4c0e-a60b-714566285176-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:44:52 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f3aef77c-9624-4900-adaf-d1f5dc91e4a5 tempest-SnapshotsActionsTest-1669610203 None] Acquiring lock "cinder-quobyte-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:44:52 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f3aef77c-9624-4900-adaf-d1f5dc91e4a5 tempest-SnapshotsActionsTest-1669610203 None] Lock "cinder-quobyte-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:44:52 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f3aef77c-9624-4900-adaf-d1f5dc91e4a5 tempest-SnapshotsActionsTest-1669610203 None] Acquiring lock "cinder-quobyte-586c1b43-b5a2-4c0e-a60b-714566285176" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:44:52 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f3aef77c-9624-4900-adaf-d1f5dc91e4a5 tempest-SnapshotsActionsTest-1669610203 None] Lock "cinder-quobyte-586c1b43-b5a2-4c0e-a60b-714566285176" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:44:52 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-f3aef77c-9624-4900-adaf-d1f5dc91e4a5 tempest-SnapshotsActionsTest-1669610203 None] Deleting offline snapshot 586c1b43-b5a2-4c0e-a60b-714566285176 of volume 8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:44:52 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-f3aef77c-9624-4900-adaf-d1f5dc91e4a5 tempest-SnapshotsActionsTest-1669610203 None] snapshot_file for this snap is: volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.586c1b43-b5a2-4c0e-a60b-714566285176 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:44:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ff6e14a8-d524-472c-95fe-eb2cdfb6cfe9 tempest-AttachVolumeNegativeTest-304126598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:44:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ff6e14a8-d524-472c-95fe-eb2cdfb6cfe9 tempest-AttachVolumeNegativeTest-304126598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:44:52 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ff6e14a8-d524-472c-95fe-eb2cdfb6cfe9 tempest-AttachVolumeNegativeTest-304126598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:44:52 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ff6e14a8-d524-472c-95fe-eb2cdfb6cfe9 tempest-AttachVolumeNegativeTest-304126598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:44:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ff6e14a8-d524-472c-95fe-eb2cdfb6cfe9 tempest-AttachVolumeNegativeTest-304126598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:44:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ff6e14a8-d524-472c-95fe-eb2cdfb6cfe9 tempest-AttachVolumeNegativeTest-304126598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:52 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85a31ed-41c2-4e3a-b56d-1da9fd945c0e]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:44:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f3aef77c-9624-4900-adaf-d1f5dc91e4a5 tempest-SnapshotsActionsTest-1669610203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.586c1b43-b5a2-4c0e-a60b-714566285176 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:52 devstack sudo[95452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:44:52 devstack sudo[95452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:52 devstack sudo[95453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.586c1b43-b5a2-4c0e-a60b-714566285176 Jul 31 10:44:52 devstack sudo[95453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:53 devstack sudo[95452]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ff6e14a8-d524-472c-95fe-eb2cdfb6cfe9 tempest-AttachVolumeNegativeTest-304126598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.568s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:53 devstack sudo[95453]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:53 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-ff6e14a8-d524-472c-95fe-eb2cdfb6cfe9 tempest-AttachVolumeNegativeTest-304126598 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:44:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f3aef77c-9624-4900-adaf-d1f5dc91e4a5 tempest-SnapshotsActionsTest-1669610203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.586c1b43-b5a2-4c0e-a60b-714566285176" returned: 0 in 0.555s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:53 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-f3aef77c-9624-4900-adaf-d1f5dc91e4a5 tempest-SnapshotsActionsTest-1669610203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:44:53 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-ff6e14a8-d524-472c-95fe-eb2cdfb6cfe9 tempest-AttachVolumeNegativeTest-304126598 None] Deleted volume successfully. Jul 31 10:44:53 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cba25c-0e43-40ab-9a47-f7f971a4b32b]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:44:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f3aef77c-9624-4900-adaf-d1f5dc91e4a5 tempest-SnapshotsActionsTest-1669610203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:53 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ff6e14a8-d524-472c-95fe-eb2cdfb6cfe9 tempest-AttachVolumeNegativeTest-304126598 None] Lock "cinder-bf10d8be-4a7f-4826-a778-b6386c3368ce-delete_volume" released by "delete_volume" :: held 2.060s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:44:53 devstack sudo[95471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 Jul 31 10:44:53 devstack sudo[95471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:53 devstack sudo[95471]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f3aef77c-9624-4900-adaf-d1f5dc91e4a5 tempest-SnapshotsActionsTest-1669610203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12" returned: 0 in 0.534s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:53 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-f3aef77c-9624-4900-adaf-d1f5dc91e4a5 tempest-SnapshotsActionsTest-1669610203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:44:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f3aef77c-9624-4900-adaf-d1f5dc91e4a5 tempest-SnapshotsActionsTest-1669610203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.586c1b43-b5a2-4c0e-a60b-714566285176 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:53 devstack sudo[95485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.586c1b43-b5a2-4c0e-a60b-714566285176 Jul 31 10:44:53 devstack sudo[95485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:54 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2cd1d6dc-20b7-4d74-b5c0-79d1e55c5189 tempest-AttachVolumeNegativeTest-304126598 None] Acquiring lock "cinder-6215dc6d-f1fe-4cea-b931-ba2fca1e70fa-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:44:54 devstack sudo[95485]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f3aef77c-9624-4900-adaf-d1f5dc91e4a5 tempest-SnapshotsActionsTest-1669610203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.586c1b43-b5a2-4c0e-a60b-714566285176" returned: 0 in 0.590s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f3aef77c-9624-4900-adaf-d1f5dc91e4a5 tempest-SnapshotsActionsTest-1669610203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.586c1b43-b5a2-4c0e-a60b-714566285176 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:54 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2cd1d6dc-20b7-4d74-b5c0-79d1e55c5189 tempest-AttachVolumeNegativeTest-304126598 None] Lock "cinder-6215dc6d-f1fe-4cea-b931-ba2fca1e70fa-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:44:54 devstack sudo[95490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.586c1b43-b5a2-4c0e-a60b-714566285176 Jul 31 10:44:54 devstack sudo[95490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:54 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2cd1d6dc-20b7-4d74-b5c0-79d1e55c5189 tempest-AttachVolumeNegativeTest-304126598 None] Acquiring lock "cinder-quobyte-6215dc6d-f1fe-4cea-b931-ba2fca1e70fa" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:44:54 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2cd1d6dc-20b7-4d74-b5c0-79d1e55c5189 tempest-AttachVolumeNegativeTest-304126598 None] Lock "cinder-quobyte-6215dc6d-f1fe-4cea-b931-ba2fca1e70fa" acquired by "delete_volume" :: waited 0.020s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:44:54 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7c04f2-a402-4571-bba5-ae74739ec32e]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:44:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2cd1d6dc-20b7-4d74-b5c0-79d1e55c5189 tempest-AttachVolumeNegativeTest-304126598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6215dc6d-f1fe-4cea-b931-ba2fca1e70fa {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:54 devstack sudo[95490]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f3aef77c-9624-4900-adaf-d1f5dc91e4a5 tempest-SnapshotsActionsTest-1669610203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.586c1b43-b5a2-4c0e-a60b-714566285176" returned: 0 in 0.420s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:54 devstack sudo[95492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6215dc6d-f1fe-4cea-b931-ba2fca1e70fa Jul 31 10:44:54 devstack sudo[95492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:54 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f3aef77c-9624-4900-adaf-d1f5dc91e4a5 tempest-SnapshotsActionsTest-1669610203 None] Lock "cinder-quobyte-586c1b43-b5a2-4c0e-a60b-714566285176" released by "_delete_snapshot" :: held 2.339s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:44:54 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f3aef77c-9624-4900-adaf-d1f5dc91e4a5 tempest-SnapshotsActionsTest-1669610203 None] Lock "cinder-quobyte-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc" released by "delete_snapshot" :: held 2.402s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:44:55 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-f3aef77c-9624-4900-adaf-d1f5dc91e4a5 tempest-SnapshotsActionsTest-1669610203 None] Created reservations ['bb4d077e-6cd9-4833-95b8-6d080dc89b45', '4113b7be-131e-4a81-b279-5a0cb877e81a', '6d75056a-5e89-4fd2-bae2-8cb011585429', '161f548d-2f84-4781-b921-e611ce97e0e8'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:44:55 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-f3aef77c-9624-4900-adaf-d1f5dc91e4a5 tempest-SnapshotsActionsTest-1669610203 None] Delete snapshot completed successfully. Jul 31 10:44:55 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f3aef77c-9624-4900-adaf-d1f5dc91e4a5 tempest-SnapshotsActionsTest-1669610203 None] Lock "cinder-586c1b43-b5a2-4c0e-a60b-714566285176-delete_snapshot" released by "delete_snapshot" :: held 2.819s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:44:55 devstack sudo[95492]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2cd1d6dc-20b7-4d74-b5c0-79d1e55c5189 tempest-AttachVolumeNegativeTest-304126598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6215dc6d-f1fe-4cea-b931-ba2fca1e70fa" returned: 0 in 0.819s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2cd1d6dc-20b7-4d74-b5c0-79d1e55c5189 tempest-AttachVolumeNegativeTest-304126598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6215dc6d-f1fe-4cea-b931-ba2fca1e70fa {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:55 devstack sudo[95499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6215dc6d-f1fe-4cea-b931-ba2fca1e70fa Jul 31 10:44:55 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:55 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2cd1d6dc-20b7-4d74-b5c0-79d1e55c5189 tempest-AttachVolumeNegativeTest-304126598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6215dc6d-f1fe-4cea-b931-ba2fca1e70fa" returned: 0 in 0.444s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:55 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2cd1d6dc-20b7-4d74-b5c0-79d1e55c5189 tempest-AttachVolumeNegativeTest-304126598 None] Lock "cinder-quobyte-6215dc6d-f1fe-4cea-b931-ba2fca1e70fa" released by "delete_volume" :: held 1.338s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:44:55 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-2cd1d6dc-20b7-4d74-b5c0-79d1e55c5189 tempest-AttachVolumeNegativeTest-304126598 None] Created reservations ['bf171acf-d6e8-44b5-b173-fa91b226cdb2', '97aa3824-07a9-4d80-b710-29f86abb678f', '05aa690e-ed46-427c-a102-78ad179e1499', '48f986c3-1689-454b-952d-cb0344ef06ac'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:44:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2cd1d6dc-20b7-4d74-b5c0-79d1e55c5189 tempest-AttachVolumeNegativeTest-304126598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:44:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2cd1d6dc-20b7-4d74-b5c0-79d1e55c5189 tempest-AttachVolumeNegativeTest-304126598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:44:56 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2cd1d6dc-20b7-4d74-b5c0-79d1e55c5189 tempest-AttachVolumeNegativeTest-304126598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:44:56 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2cd1d6dc-20b7-4d74-b5c0-79d1e55c5189 tempest-AttachVolumeNegativeTest-304126598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:44:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2cd1d6dc-20b7-4d74-b5c0-79d1e55c5189 tempest-AttachVolumeNegativeTest-304126598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:44:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2cd1d6dc-20b7-4d74-b5c0-79d1e55c5189 tempest-AttachVolumeNegativeTest-304126598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:56 devstack sudo[95537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:44:56 devstack sudo[95537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-bd4da1f5-d162-4e81-b2a9-413bab56d07c tempest-SnapshotsActionsTest-587741653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:44:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-bd4da1f5-d162-4e81-b2a9-413bab56d07c tempest-SnapshotsActionsTest-587741653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:44:56 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-bd4da1f5-d162-4e81-b2a9-413bab56d07c tempest-SnapshotsActionsTest-587741653 None] Creating offline snapshot 03bcaaa4-0fc4-4be1-a52d-47de05a54ff6 of volume 8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:44:56 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[969f59de-5780-4dce-9eb4-2478df5411c7]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:44:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bd4da1f5-d162-4e81-b2a9-413bab56d07c tempest-SnapshotsActionsTest-587741653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:56 devstack sudo[95537]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2cd1d6dc-20b7-4d74-b5c0-79d1e55c5189 tempest-AttachVolumeNegativeTest-304126598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.505s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:56 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-2cd1d6dc-20b7-4d74-b5c0-79d1e55c5189 tempest-AttachVolumeNegativeTest-304126598 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:44:56 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-2cd1d6dc-20b7-4d74-b5c0-79d1e55c5189 tempest-AttachVolumeNegativeTest-304126598 None] Deleted volume successfully. Jul 31 10:44:56 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2cd1d6dc-20b7-4d74-b5c0-79d1e55c5189 tempest-AttachVolumeNegativeTest-304126598 None] Lock "cinder-6215dc6d-f1fe-4cea-b931-ba2fca1e70fa-delete_volume" released by "delete_volume" :: held 2.403s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:44:56 devstack sudo[95542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 Jul 31 10:44:56 devstack sudo[95542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:57 devstack sudo[95542]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bd4da1f5-d162-4e81-b2a9-413bab56d07c tempest-SnapshotsActionsTest-587741653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12" returned: 0 in 0.981s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:57 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-bd4da1f5-d162-4e81-b2a9-413bab56d07c tempest-SnapshotsActionsTest-587741653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:44:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bd4da1f5-d162-4e81-b2a9-413bab56d07c tempest-SnapshotsActionsTest-587741653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.03bcaaa4-0fc4-4be1-a52d-47de05a54ff6 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:57 devstack sudo[95578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.03bcaaa4-0fc4-4be1-a52d-47de05a54ff6 1G Jul 31 10:44:57 devstack sudo[95578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:58 devstack sudo[95578]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bd4da1f5-d162-4e81-b2a9-413bab56d07c tempest-SnapshotsActionsTest-587741653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.03bcaaa4-0fc4-4be1-a52d-47de05a54ff6 1G" returned: 0 in 0.853s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bd4da1f5-d162-4e81-b2a9-413bab56d07c tempest-SnapshotsActionsTest-587741653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.03bcaaa4-0fc4-4be1-a52d-47de05a54ff6 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:58 devstack sudo[95610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.03bcaaa4-0fc4-4be1-a52d-47de05a54ff6 Jul 31 10:44:58 devstack sudo[95610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:59 devstack sudo[95610]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bd4da1f5-d162-4e81-b2a9-413bab56d07c tempest-SnapshotsActionsTest-587741653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.03bcaaa4-0fc4-4be1-a52d-47de05a54ff6" returned: 0 in 0.598s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:59 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-bd4da1f5-d162-4e81-b2a9-413bab56d07c tempest-SnapshotsActionsTest-587741653 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.03bcaaa4-0fc4-4be1-a52d-47de05a54ff6 is being set with open permissions: ugo+rw Jul 31 10:44:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bd4da1f5-d162-4e81-b2a9-413bab56d07c tempest-SnapshotsActionsTest-587741653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.03bcaaa4-0fc4-4be1-a52d-47de05a54ff6 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:59 devstack sudo[95640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.03bcaaa4-0fc4-4be1-a52d-47de05a54ff6 Jul 31 10:44:59 devstack sudo[95640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:59 devstack sudo[95640]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bd4da1f5-d162-4e81-b2a9-413bab56d07c tempest-SnapshotsActionsTest-587741653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.03bcaaa4-0fc4-4be1-a52d-47de05a54ff6" returned: 0 in 0.545s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-bd4da1f5-d162-4e81-b2a9-413bab56d07c tempest-SnapshotsActionsTest-587741653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.226s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:44:59 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-bd4da1f5-d162-4e81-b2a9-413bab56d07c tempest-SnapshotsActionsTest-587741653 None] Create snapshot completed successfully Jul 31 10:45:01 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1e4baf53-4f37-44fc-9936-56bca0b6cc6f tempest-SnapshotsActionsTest-1669610203 None] Acquiring lock "cinder-03bcaaa4-0fc4-4be1-a52d-47de05a54ff6-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:45:01 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1e4baf53-4f37-44fc-9936-56bca0b6cc6f tempest-SnapshotsActionsTest-1669610203 None] Lock "cinder-03bcaaa4-0fc4-4be1-a52d-47de05a54ff6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:45:01 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1e4baf53-4f37-44fc-9936-56bca0b6cc6f tempest-SnapshotsActionsTest-1669610203 None] Acquiring lock "cinder-quobyte-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:45:01 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1e4baf53-4f37-44fc-9936-56bca0b6cc6f tempest-SnapshotsActionsTest-1669610203 None] Lock "cinder-quobyte-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc" acquired by "delete_snapshot" :: waited 0.059s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:45:01 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1e4baf53-4f37-44fc-9936-56bca0b6cc6f tempest-SnapshotsActionsTest-1669610203 None] Acquiring lock "cinder-quobyte-03bcaaa4-0fc4-4be1-a52d-47de05a54ff6" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:45:01 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1e4baf53-4f37-44fc-9936-56bca0b6cc6f tempest-SnapshotsActionsTest-1669610203 None] Lock "cinder-quobyte-03bcaaa4-0fc4-4be1-a52d-47de05a54ff6" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:45:01 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-1e4baf53-4f37-44fc-9936-56bca0b6cc6f tempest-SnapshotsActionsTest-1669610203 None] Deleting offline snapshot 03bcaaa4-0fc4-4be1-a52d-47de05a54ff6 of volume 8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:45:01 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-1e4baf53-4f37-44fc-9936-56bca0b6cc6f tempest-SnapshotsActionsTest-1669610203 None] snapshot_file for this snap is: volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.03bcaaa4-0fc4-4be1-a52d-47de05a54ff6 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:45:01 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1c8893-7b62-422f-bb35-9d87255fd31e]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:45:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1e4baf53-4f37-44fc-9936-56bca0b6cc6f tempest-SnapshotsActionsTest-1669610203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.03bcaaa4-0fc4-4be1-a52d-47de05a54ff6 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:45:01 devstack sudo[95694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.03bcaaa4-0fc4-4be1-a52d-47de05a54ff6 Jul 31 10:45:01 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:45:02 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root Jul 31 10:45:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1e4baf53-4f37-44fc-9936-56bca0b6cc6f tempest-SnapshotsActionsTest-1669610203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.03bcaaa4-0fc4-4be1-a52d-47de05a54ff6" returned: 0 in 0.646s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:45:02 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-1e4baf53-4f37-44fc-9936-56bca0b6cc6f tempest-SnapshotsActionsTest-1669610203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:45:02 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[944a4ec8-5c0a-4f52-ad8e-a399a8c8a755]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:45:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1e4baf53-4f37-44fc-9936-56bca0b6cc6f tempest-SnapshotsActionsTest-1669610203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:45:02 devstack sudo[95699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 Jul 31 10:45:02 devstack sudo[95699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:45:02 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-3c683566-f9f7-4934-bfdb-c1dd9311d321 tempest-VolumesActionsTest-1848272351 None] Acquiring lock "cinder-dd979657-441f-44ff-a3e3-c53502d968a1" by "attach_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:45:02 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-3c683566-f9f7-4934-bfdb-c1dd9311d321 tempest-VolumesActionsTest-1848272351 None] Lock "cinder-dd979657-441f-44ff-a3e3-c53502d968a1" acquired by "attach_volume" :: waited 0.039s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:45:03 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-3c683566-f9f7-4934-bfdb-c1dd9311d321 tempest-VolumesActionsTest-1848272351 None] Attaching volume dd979657-441f-44ff-a3e3-c53502d968a1 to instance fd0a1ae9-9bb7-44a5-8ac7-c284a8d6f33e at mountpoint /dev/vdb on host None. Jul 31 10:45:03 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-3c683566-f9f7-4934-bfdb-c1dd9311d321 tempest-VolumesActionsTest-1848272351 None] Attach volume completed successfully. Jul 31 10:45:03 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-3c683566-f9f7-4934-bfdb-c1dd9311d321 tempest-VolumesActionsTest-1848272351 None] Lock "cinder-dd979657-441f-44ff-a3e3-c53502d968a1" released by "attach_volume" :: held 0.249s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:45:03 devstack sudo[95699]: pam_unix(sudo:session): session closed for user root Jul 31 10:45:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1e4baf53-4f37-44fc-9936-56bca0b6cc6f tempest-SnapshotsActionsTest-1669610203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12" returned: 0 in 0.905s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:45:03 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-1e4baf53-4f37-44fc-9936-56bca0b6cc6f tempest-SnapshotsActionsTest-1669610203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:45:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1e4baf53-4f37-44fc-9936-56bca0b6cc6f tempest-SnapshotsActionsTest-1669610203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.03bcaaa4-0fc4-4be1-a52d-47de05a54ff6 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:45:03 devstack sudo[95708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.03bcaaa4-0fc4-4be1-a52d-47de05a54ff6 Jul 31 10:45:03 devstack sudo[95708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:45:03 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6b17c323-e56e-46e0-b497-410e7f83dde3 tempest-VolumesActionsTest-1848272351 None] Acquiring lock "cinder-dd979657-441f-44ff-a3e3-c53502d968a1-detach_volume" by "detach_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:45:03 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6b17c323-e56e-46e0-b497-410e7f83dde3 tempest-VolumesActionsTest-1848272351 None] Lock "cinder-dd979657-441f-44ff-a3e3-c53502d968a1-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:45:03 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-6b17c323-e56e-46e0-b497-410e7f83dde3 tempest-VolumesActionsTest-1848272351 None] Detaching volume dd979657-441f-44ff-a3e3-c53502d968a1 from instance fd0a1ae9-9bb7-44a5-8ac7-c284a8d6f33e. Jul 31 10:45:03 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-6b17c323-e56e-46e0-b497-410e7f83dde3 tempest-VolumesActionsTest-1848272351 None] Detach volume completed successfully. Jul 31 10:45:03 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6b17c323-e56e-46e0-b497-410e7f83dde3 tempest-VolumesActionsTest-1848272351 None] Lock "cinder-dd979657-441f-44ff-a3e3-c53502d968a1-detach_volume" released by "detach_volume" :: held 0.228s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:45:04 devstack sudo[95708]: pam_unix(sudo:session): session closed for user root Jul 31 10:45:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1e4baf53-4f37-44fc-9936-56bca0b6cc6f tempest-SnapshotsActionsTest-1669610203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.03bcaaa4-0fc4-4be1-a52d-47de05a54ff6" returned: 0 in 1.220s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:45:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1e4baf53-4f37-44fc-9936-56bca0b6cc6f tempest-SnapshotsActionsTest-1669610203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.03bcaaa4-0fc4-4be1-a52d-47de05a54ff6 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:45:04 devstack sudo[95747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.03bcaaa4-0fc4-4be1-a52d-47de05a54ff6 Jul 31 10:45:04 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:45:04 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root Jul 31 10:45:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1e4baf53-4f37-44fc-9936-56bca0b6cc6f tempest-SnapshotsActionsTest-1669610203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.03bcaaa4-0fc4-4be1-a52d-47de05a54ff6" returned: 0 in 0.473s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:45:04 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1e4baf53-4f37-44fc-9936-56bca0b6cc6f tempest-SnapshotsActionsTest-1669610203 None] Lock "cinder-quobyte-03bcaaa4-0fc4-4be1-a52d-47de05a54ff6" released by "_delete_snapshot" :: held 3.498s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:45:04 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1e4baf53-4f37-44fc-9936-56bca0b6cc6f tempest-SnapshotsActionsTest-1669610203 None] Lock "cinder-quobyte-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc" released by "delete_snapshot" :: held 3.548s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:45:05 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-1e4baf53-4f37-44fc-9936-56bca0b6cc6f tempest-SnapshotsActionsTest-1669610203 None] Created reservations ['e0dea744-78b6-4167-ab38-1c57cfa96d25', '9b484e27-4793-4ee9-a337-c30f2c214a64', '392d3173-3df3-4d15-9791-2c013b719377', '25dae9db-0945-424a-9cdd-3cc7b3e27cc0'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:45:05 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-1e4baf53-4f37-44fc-9936-56bca0b6cc6f tempest-SnapshotsActionsTest-1669610203 None] Delete snapshot completed successfully. Jul 31 10:45:05 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1e4baf53-4f37-44fc-9936-56bca0b6cc6f tempest-SnapshotsActionsTest-1669610203 None] Lock "cinder-03bcaaa4-0fc4-4be1-a52d-47de05a54ff6-delete_snapshot" released by "delete_snapshot" :: held 3.839s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:45:06 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-54967e29-708c-4485-8cc8-f7a350c2c4ae tempest-SnapshotsActionsTest-587741653 None] Acquiring lock "cinder-4b7f7261-c1e0-4883-b4ba-0689cfa9db12-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:45:06 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-54967e29-708c-4485-8cc8-f7a350c2c4ae tempest-SnapshotsActionsTest-587741653 None] Lock "cinder-4b7f7261-c1e0-4883-b4ba-0689cfa9db12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:45:06 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-54967e29-708c-4485-8cc8-f7a350c2c4ae tempest-SnapshotsActionsTest-587741653 None] Acquiring lock "cinder-quobyte-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:45:06 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-54967e29-708c-4485-8cc8-f7a350c2c4ae tempest-SnapshotsActionsTest-587741653 None] Lock "cinder-quobyte-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc" acquired by "delete_snapshot" :: waited 0.075s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:45:06 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-54967e29-708c-4485-8cc8-f7a350c2c4ae tempest-SnapshotsActionsTest-587741653 None] Acquiring lock "cinder-quobyte-4b7f7261-c1e0-4883-b4ba-0689cfa9db12" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:45:06 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-54967e29-708c-4485-8cc8-f7a350c2c4ae tempest-SnapshotsActionsTest-587741653 None] Lock "cinder-quobyte-4b7f7261-c1e0-4883-b4ba-0689cfa9db12" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:45:06 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-54967e29-708c-4485-8cc8-f7a350c2c4ae tempest-SnapshotsActionsTest-587741653 None] Deleting offline snapshot 4b7f7261-c1e0-4883-b4ba-0689cfa9db12 of volume 8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:45:06 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-54967e29-708c-4485-8cc8-f7a350c2c4ae tempest-SnapshotsActionsTest-587741653 None] snapshot_file for this snap is: volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:45:06 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd87e25-dbd5-43ab-9494-41e6875b9f30]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:45:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-54967e29-708c-4485-8cc8-f7a350c2c4ae tempest-SnapshotsActionsTest-587741653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:45:07 devstack sudo[95819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 Jul 31 10:45:07 devstack sudo[95819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:45:07 devstack sudo[95819]: pam_unix(sudo:session): session closed for user root Jul 31 10:45:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-54967e29-708c-4485-8cc8-f7a350c2c4ae tempest-SnapshotsActionsTest-587741653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12" returned: 0 in 0.562s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:45:07 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-54967e29-708c-4485-8cc8-f7a350c2c4ae tempest-SnapshotsActionsTest-587741653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:45:07 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a25d82-246a-4915-85e3-ffc707dafc5b]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:45:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-54967e29-708c-4485-8cc8-f7a350c2c4ae tempest-SnapshotsActionsTest-587741653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:45:07 devstack sudo[95828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc Jul 31 10:45:07 devstack sudo[95828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:45:08 devstack sudo[95828]: pam_unix(sudo:session): session closed for user root Jul 31 10:45:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-54967e29-708c-4485-8cc8-f7a350c2c4ae tempest-SnapshotsActionsTest-587741653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc" returned: 0 in 0.789s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:45:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-54967e29-708c-4485-8cc8-f7a350c2c4ae tempest-SnapshotsActionsTest-587741653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:45:08 devstack sudo[95835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 Jul 31 10:45:08 devstack sudo[95835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:45:09 devstack sudo[95835]: pam_unix(sudo:session): session closed for user root Jul 31 10:45:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-54967e29-708c-4485-8cc8-f7a350c2c4ae tempest-SnapshotsActionsTest-587741653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12" returned: 0 in 0.800s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:45:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-54967e29-708c-4485-8cc8-f7a350c2c4ae tempest-SnapshotsActionsTest-587741653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:45:09 devstack sudo[95840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12 Jul 31 10:45:09 devstack sudo[95840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:45:09 devstack sudo[95840]: pam_unix(sudo:session): session closed for user root Jul 31 10:45:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-54967e29-708c-4485-8cc8-f7a350c2c4ae tempest-SnapshotsActionsTest-587741653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc.4b7f7261-c1e0-4883-b4ba-0689cfa9db12" returned: 0 in 0.340s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:45:09 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-54967e29-708c-4485-8cc8-f7a350c2c4ae tempest-SnapshotsActionsTest-587741653 None] Lock "cinder-quobyte-4b7f7261-c1e0-4883-b4ba-0689cfa9db12" released by "_delete_snapshot" :: held 2.726s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:45:09 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-54967e29-708c-4485-8cc8-f7a350c2c4ae tempest-SnapshotsActionsTest-587741653 None] Lock "cinder-quobyte-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc" released by "delete_snapshot" :: held 2.781s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:45:09 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-54967e29-708c-4485-8cc8-f7a350c2c4ae tempest-SnapshotsActionsTest-587741653 None] Created reservations ['5159b120-32c2-40a3-b78f-c9deded7ee57', '03652e49-7484-42db-b9b9-2a15a9b13750', 'e98b4407-ad9b-40c8-8f02-baf6d3eab423', 'f9be97af-c957-45c1-b688-23e6ccea0b5e'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:45:09 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-54967e29-708c-4485-8cc8-f7a350c2c4ae tempest-SnapshotsActionsTest-587741653 None] Delete snapshot completed successfully. Jul 31 10:45:09 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-54967e29-708c-4485-8cc8-f7a350c2c4ae tempest-SnapshotsActionsTest-587741653 None] Lock "cinder-4b7f7261-c1e0-4883-b4ba-0689cfa9db12-delete_snapshot" released by "delete_snapshot" :: held 3.193s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:45:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-bd88de7a-cde0-4cae-a82e-5d03c72ea252 tempest-SnapshotsActionsTest-587741653 None] Acquiring lock "cinder-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:45:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-bd88de7a-cde0-4cae-a82e-5d03c72ea252 tempest-SnapshotsActionsTest-587741653 None] Lock "cinder-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:45:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-bd88de7a-cde0-4cae-a82e-5d03c72ea252 tempest-SnapshotsActionsTest-587741653 None] Acquiring lock "cinder-quobyte-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:45:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-bd88de7a-cde0-4cae-a82e-5d03c72ea252 tempest-SnapshotsActionsTest-587741653 None] Lock "cinder-quobyte-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc" acquired by "delete_volume" :: waited 0.017s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:45:10 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[80046459-3bb4-4f64-b1b2-073f6af74f98]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:45:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bd88de7a-cde0-4cae-a82e-5d03c72ea252 tempest-SnapshotsActionsTest-587741653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:45:10 devstack sudo[95853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc Jul 31 10:45:10 devstack sudo[95853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:45:10 devstack sudo[95853]: pam_unix(sudo:session): session closed for user root Jul 31 10:45:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bd88de7a-cde0-4cae-a82e-5d03c72ea252 tempest-SnapshotsActionsTest-587741653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc" returned: 0 in 0.576s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:45:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bd88de7a-cde0-4cae-a82e-5d03c72ea252 tempest-SnapshotsActionsTest-587741653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:45:10 devstack sudo[95860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc Jul 31 10:45:10 devstack sudo[95860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:45:11 devstack sudo[95860]: pam_unix(sudo:session): session closed for user root Jul 31 10:45:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bd88de7a-cde0-4cae-a82e-5d03c72ea252 tempest-SnapshotsActionsTest-587741653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc" returned: 0 in 0.417s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:45:11 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-bd88de7a-cde0-4cae-a82e-5d03c72ea252 tempest-SnapshotsActionsTest-587741653 None] Lock "cinder-quobyte-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc" released by "delete_volume" :: held 1.109s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:45:11 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-bd88de7a-cde0-4cae-a82e-5d03c72ea252 tempest-SnapshotsActionsTest-587741653 None] Created reservations ['97877a2c-7542-4f9e-977c-f430b296489c', '458ce323-3a38-4ce5-baf7-e67fb21e3d84', '0964c2c5-498f-4ba8-b890-fd1e59b0c340', '33b45db3-0387-4d85-abd4-50fcd1771e6e'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:45:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-bd88de7a-cde0-4cae-a82e-5d03c72ea252 tempest-SnapshotsActionsTest-587741653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:45:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-bd88de7a-cde0-4cae-a82e-5d03c72ea252 tempest-SnapshotsActionsTest-587741653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:45:11 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-bd88de7a-cde0-4cae-a82e-5d03c72ea252 tempest-SnapshotsActionsTest-587741653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:45:11 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-bd88de7a-cde0-4cae-a82e-5d03c72ea252 tempest-SnapshotsActionsTest-587741653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:45:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-bd88de7a-cde0-4cae-a82e-5d03c72ea252 tempest-SnapshotsActionsTest-587741653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:45:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bd88de7a-cde0-4cae-a82e-5d03c72ea252 tempest-SnapshotsActionsTest-587741653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:45:11 devstack sudo[95863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:45:11 devstack sudo[95863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:45:11 devstack sudo[95863]: pam_unix(sudo:session): session closed for user root Jul 31 10:45:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bd88de7a-cde0-4cae-a82e-5d03c72ea252 tempest-SnapshotsActionsTest-587741653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.445s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:45:11 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-bd88de7a-cde0-4cae-a82e-5d03c72ea252 tempest-SnapshotsActionsTest-587741653 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:45:11 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-bd88de7a-cde0-4cae-a82e-5d03c72ea252 tempest-SnapshotsActionsTest-587741653 None] Deleted volume successfully. Jul 31 10:45:12 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-bd88de7a-cde0-4cae-a82e-5d03c72ea252 tempest-SnapshotsActionsTest-587741653 None] Lock "cinder-8b4e6af0-5e36-4f45-9bd0-b8d901f45bbc-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:45:14 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [req-24bfa622-05b9-47e1-95b5-9e10120c9ad0 req-17429bc7-40dd-40b2-90a6-5f89d737ffad tempest-VolumesGetTestJSON-545874460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:45:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-24bfa622-05b9-47e1-95b5-9e10120c9ad0 req-17429bc7-40dd-40b2-90a6-5f89d737ffad tempest-VolumesGetTestJSON-545874460 None] Flow 'volume_create_manager' (96d77439-0832-49dd-80cc-3a0b6cc03754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:45:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-24bfa622-05b9-47e1-95b5-9e10120c9ad0 req-17429bc7-40dd-40b2-90a6-5f89d737ffad tempest-VolumesGetTestJSON-545874460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f195da5-00ad-45d5-9370-d1c3c7c8f07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:45:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-24bfa622-05b9-47e1-95b5-9e10120c9ad0 req-17429bc7-40dd-40b2-90a6-5f89d737ffad tempest-VolumesGetTestJSON-545874460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f195da5-00ad-45d5-9370-d1c3c7c8f07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2016778508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=280be81e-9c45-4d1c-83db-bab0abfb21d0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='76a83f55abd64e4aad454e6bb9191e36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:45:14Z,use_quota=True,user_id='075695eeaa304cafaada3047f9bde541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:45:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-24bfa622-05b9-47e1-95b5-9e10120c9ad0 req-17429bc7-40dd-40b2-90a6-5f89d737ffad tempest-VolumesGetTestJSON-545874460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (732a3604-9b2f-4312-a069-53b8aa634d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:45:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-24bfa622-05b9-47e1-95b5-9e10120c9ad0 req-17429bc7-40dd-40b2-90a6-5f89d737ffad tempest-VolumesGetTestJSON-545874460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (732a3604-9b2f-4312-a069-53b8aa634d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:45:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-24bfa622-05b9-47e1-95b5-9e10120c9ad0 req-17429bc7-40dd-40b2-90a6-5f89d737ffad tempest-VolumesGetTestJSON-545874460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f54e5cd-16ff-48ff-9cf9-51d3c6a522d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:45:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-24bfa622-05b9-47e1-95b5-9e10120c9ad0 req-17429bc7-40dd-40b2-90a6-5f89d737ffad tempest-VolumesGetTestJSON-545874460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f54e5cd-16ff-48ff-9cf9-51d3c6a522d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '280be81e-9c45-4d1c-83db-bab0abfb21d0', 'volume_name': 'volume-280be81e-9c45-4d1c-83db-bab0abfb21d0', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:45:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-24bfa622-05b9-47e1-95b5-9e10120c9ad0 req-17429bc7-40dd-40b2-90a6-5f89d737ffad tempest-VolumesGetTestJSON-545874460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d63be6d-81b6-4372-8384-c6ca5dba5645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:45:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-24bfa622-05b9-47e1-95b5-9e10120c9ad0 req-17429bc7-40dd-40b2-90a6-5f89d737ffad tempest-VolumesGetTestJSON-545874460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d63be6d-81b6-4372-8384-c6ca5dba5645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:45:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-24bfa622-05b9-47e1-95b5-9e10120c9ad0 req-17429bc7-40dd-40b2-90a6-5f89d737ffad tempest-VolumesGetTestJSON-545874460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5736acee-a30f-409f-9ff6-de4b5bc3615f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:45:14 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [req-24bfa622-05b9-47e1-95b5-9e10120c9ad0 req-17429bc7-40dd-40b2-90a6-5f89d737ffad tempest-VolumesGetTestJSON-545874460 None] Volume 280be81e-9c45-4d1c-83db-bab0abfb21d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-280be81e-9c45-4d1c-83db-bab0abfb21d0', 'volume_size': 1} Jul 31 10:45:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-24bfa622-05b9-47e1-95b5-9e10120c9ad0 req-17429bc7-40dd-40b2-90a6-5f89d737ffad tempest-VolumesGetTestJSON-545874460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:45:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-24bfa622-05b9-47e1-95b5-9e10120c9ad0 req-17429bc7-40dd-40b2-90a6-5f89d737ffad tempest-VolumesGetTestJSON-545874460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:45:14 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [req-24bfa622-05b9-47e1-95b5-9e10120c9ad0 req-17429bc7-40dd-40b2-90a6-5f89d737ffad tempest-VolumesGetTestJSON-545874460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2016778508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=280be81e-9c45-4d1c-83db-bab0abfb21d0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='76a83f55abd64e4aad454e6bb9191e36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:45:14Z,use_quota=True,user_id='075695eeaa304cafaada3047f9bde541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:45:14 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [req-24bfa622-05b9-47e1-95b5-9e10120c9ad0 req-17429bc7-40dd-40b2-90a6-5f89d737ffad tempest-VolumesGetTestJSON-545874460 None] Creating volume 280be81e-9c45-4d1c-83db-bab0abfb21d0 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:45:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-24bfa622-05b9-47e1-95b5-9e10120c9ad0 req-17429bc7-40dd-40b2-90a6-5f89d737ffad tempest-VolumesGetTestJSON-545874460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:45:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-24bfa622-05b9-47e1-95b5-9e10120c9ad0 req-17429bc7-40dd-40b2-90a6-5f89d737ffad tempest-VolumesGetTestJSON-545874460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:45:14 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [req-24bfa622-05b9-47e1-95b5-9e10120c9ad0 req-17429bc7-40dd-40b2-90a6-5f89d737ffad tempest-VolumesGetTestJSON-545874460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:45:14 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [req-24bfa622-05b9-47e1-95b5-9e10120c9ad0 req-17429bc7-40dd-40b2-90a6-5f89d737ffad tempest-VolumesGetTestJSON-545874460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:45:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-24bfa622-05b9-47e1-95b5-9e10120c9ad0 req-17429bc7-40dd-40b2-90a6-5f89d737ffad tempest-VolumesGetTestJSON-545874460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:45:14 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [req-24bfa622-05b9-47e1-95b5-9e10120c9ad0 req-17429bc7-40dd-40b2-90a6-5f89d737ffad tempest-VolumesGetTestJSON-545874460 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:45:14 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [req-24bfa622-05b9-47e1-95b5-9e10120c9ad0 req-17429bc7-40dd-40b2-90a6-5f89d737ffad tempest-VolumesGetTestJSON-545874460 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:45:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-24bfa622-05b9-47e1-95b5-9e10120c9ad0 req-17429bc7-40dd-40b2-90a6-5f89d737ffad tempest-VolumesGetTestJSON-545874460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-280be81e-9c45-4d1c-83db-bab0abfb21d0 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:45:14 devstack sudo[95883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-280be81e-9c45-4d1c-83db-bab0abfb21d0 1073741824 Jul 31 10:45:14 devstack sudo[95883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:45:15 devstack sudo[95883]: pam_unix(sudo:session): session closed for user root Jul 31 10:45:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-24bfa622-05b9-47e1-95b5-9e10120c9ad0 req-17429bc7-40dd-40b2-90a6-5f89d737ffad tempest-VolumesGetTestJSON-545874460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-280be81e-9c45-4d1c-83db-bab0abfb21d0 1073741824" returned: 0 in 0.750s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:45:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-24bfa622-05b9-47e1-95b5-9e10120c9ad0 req-17429bc7-40dd-40b2-90a6-5f89d737ffad tempest-VolumesGetTestJSON-545874460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-280be81e-9c45-4d1c-83db-bab0abfb21d0 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:45:15 devstack sudo[95890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-280be81e-9c45-4d1c-83db-bab0abfb21d0 Jul 31 10:45:15 devstack sudo[95890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:45:15 devstack sudo[95890]: pam_unix(sudo:session): session closed for user root Jul 31 10:45:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-24bfa622-05b9-47e1-95b5-9e10120c9ad0 req-17429bc7-40dd-40b2-90a6-5f89d737ffad tempest-VolumesGetTestJSON-545874460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-280be81e-9c45-4d1c-83db-bab0abfb21d0" returned: 0 in 0.542s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:45:16 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [req-24bfa622-05b9-47e1-95b5-9e10120c9ad0 req-17429bc7-40dd-40b2-90a6-5f89d737ffad tempest-VolumesGetTestJSON-545874460 None] <== create_volume: return (1371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:45:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-24bfa622-05b9-47e1-95b5-9e10120c9ad0 req-17429bc7-40dd-40b2-90a6-5f89d737ffad tempest-VolumesGetTestJSON-545874460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:45:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-24bfa622-05b9-47e1-95b5-9e10120c9ad0 req-17429bc7-40dd-40b2-90a6-5f89d737ffad tempest-VolumesGetTestJSON-545874460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5736acee-a30f-409f-9ff6-de4b5bc3615f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-280be81e-9c45-4d1c-83db-bab0abfb21d0', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:45:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-24bfa622-05b9-47e1-95b5-9e10120c9ad0 req-17429bc7-40dd-40b2-90a6-5f89d737ffad tempest-VolumesGetTestJSON-545874460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bff12dd-4c0b-4249-a0d3-022f9faa695b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:45:16 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [req-24bfa622-05b9-47e1-95b5-9e10120c9ad0 req-17429bc7-40dd-40b2-90a6-5f89d737ffad tempest-VolumesGetTestJSON-545874460 None] Volume volume-280be81e-9c45-4d1c-83db-bab0abfb21d0 (280be81e-9c45-4d1c-83db-bab0abfb21d0): created successfully Jul 31 10:45:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-24bfa622-05b9-47e1-95b5-9e10120c9ad0 req-17429bc7-40dd-40b2-90a6-5f89d737ffad tempest-VolumesGetTestJSON-545874460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bff12dd-4c0b-4249-a0d3-022f9faa695b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:45:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-24bfa622-05b9-47e1-95b5-9e10120c9ad0 req-17429bc7-40dd-40b2-90a6-5f89d737ffad tempest-VolumesGetTestJSON-545874460 None] Flow 'volume_create_manager' (96d77439-0832-49dd-80cc-3a0b6cc03754) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:45:16 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-24bfa622-05b9-47e1-95b5-9e10120c9ad0 req-17429bc7-40dd-40b2-90a6-5f89d737ffad tempest-VolumesGetTestJSON-545874460 None] Created volume successfully. Jul 31 10:45:18 devstack cinder-volume[89090]: DEBUG cinder.coordination [req-fb4df115-0c73-4afb-8fb8-5a24e9ca7bba req-5d655843-7516-4abd-a8e9-020baa44cc71 tempest-VolumesGetTestJSON-545874460 None] Acquiring lock "cinder-280be81e-9c45-4d1c-83db-bab0abfb21d0-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:45:18 devstack cinder-volume[89090]: DEBUG cinder.coordination [req-fb4df115-0c73-4afb-8fb8-5a24e9ca7bba req-5d655843-7516-4abd-a8e9-020baa44cc71 tempest-VolumesGetTestJSON-545874460 None] Lock "cinder-280be81e-9c45-4d1c-83db-bab0abfb21d0-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:45:18 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=99,cinder:UPDATE=101,cinder:DELETE=13,cinder:INSERT=36 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:45:18 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=94,cinder:INSERT=18,cinder:UPDATE=112,cinder:DELETE=5 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:45:18 devstack cinder-volume[89090]: DEBUG cinder.coordination [req-fb4df115-0c73-4afb-8fb8-5a24e9ca7bba req-5d655843-7516-4abd-a8e9-020baa44cc71 tempest-VolumesGetTestJSON-545874460 None] Acquiring lock "cinder-quobyte-280be81e-9c45-4d1c-83db-bab0abfb21d0" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:45:18 devstack cinder-volume[89090]: DEBUG cinder.coordination [req-fb4df115-0c73-4afb-8fb8-5a24e9ca7bba req-5d655843-7516-4abd-a8e9-020baa44cc71 tempest-VolumesGetTestJSON-545874460 None] Lock "cinder-quobyte-280be81e-9c45-4d1c-83db-bab0abfb21d0" acquired by "delete_volume" :: waited 0.047s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:45:18 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b6bb92-675b-49c6-81fa-cd4e054114c6]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:45:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-fb4df115-0c73-4afb-8fb8-5a24e9ca7bba req-5d655843-7516-4abd-a8e9-020baa44cc71 tempest-VolumesGetTestJSON-545874460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-280be81e-9c45-4d1c-83db-bab0abfb21d0 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:45:18 devstack sudo[95977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-280be81e-9c45-4d1c-83db-bab0abfb21d0 Jul 31 10:45:18 devstack sudo[95977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:45:19 devstack sudo[95977]: pam_unix(sudo:session): session closed for user root Jul 31 10:45:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-fb4df115-0c73-4afb-8fb8-5a24e9ca7bba req-5d655843-7516-4abd-a8e9-020baa44cc71 tempest-VolumesGetTestJSON-545874460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-280be81e-9c45-4d1c-83db-bab0abfb21d0" returned: 0 in 0.601s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:45:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-fb4df115-0c73-4afb-8fb8-5a24e9ca7bba req-5d655843-7516-4abd-a8e9-020baa44cc71 tempest-VolumesGetTestJSON-545874460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-280be81e-9c45-4d1c-83db-bab0abfb21d0 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:45:19 devstack sudo[95983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-280be81e-9c45-4d1c-83db-bab0abfb21d0 Jul 31 10:45:19 devstack sudo[95983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:45:19 devstack sudo[95983]: pam_unix(sudo:session): session closed for user root Jul 31 10:45:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-fb4df115-0c73-4afb-8fb8-5a24e9ca7bba req-5d655843-7516-4abd-a8e9-020baa44cc71 tempest-VolumesGetTestJSON-545874460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-280be81e-9c45-4d1c-83db-bab0abfb21d0" returned: 0 in 0.410s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:45:19 devstack cinder-volume[89090]: DEBUG cinder.coordination [req-fb4df115-0c73-4afb-8fb8-5a24e9ca7bba req-5d655843-7516-4abd-a8e9-020baa44cc71 tempest-VolumesGetTestJSON-545874460 None] Lock "cinder-quobyte-280be81e-9c45-4d1c-83db-bab0abfb21d0" released by "delete_volume" :: held 1.105s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:45:19 devstack cinder-volume[89090]: DEBUG cinder.quota [req-fb4df115-0c73-4afb-8fb8-5a24e9ca7bba req-5d655843-7516-4abd-a8e9-020baa44cc71 tempest-VolumesGetTestJSON-545874460 None] Created reservations ['c70c7a5d-ce2f-453a-9467-5850ed2108ea', 'ed568bd4-84e7-4eb6-9705-855f6b619bb1', 'b4c6234c-cb74-45d8-b3cc-5918ec5354e6', '3f168b65-ed18-41f6-8358-923acc4b5060'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:45:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-fb4df115-0c73-4afb-8fb8-5a24e9ca7bba req-5d655843-7516-4abd-a8e9-020baa44cc71 tempest-VolumesGetTestJSON-545874460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:45:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-fb4df115-0c73-4afb-8fb8-5a24e9ca7bba req-5d655843-7516-4abd-a8e9-020baa44cc71 tempest-VolumesGetTestJSON-545874460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:45:20 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [req-fb4df115-0c73-4afb-8fb8-5a24e9ca7bba req-5d655843-7516-4abd-a8e9-020baa44cc71 tempest-VolumesGetTestJSON-545874460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:45:20 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [req-fb4df115-0c73-4afb-8fb8-5a24e9ca7bba req-5d655843-7516-4abd-a8e9-020baa44cc71 tempest-VolumesGetTestJSON-545874460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:45:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-fb4df115-0c73-4afb-8fb8-5a24e9ca7bba req-5d655843-7516-4abd-a8e9-020baa44cc71 tempest-VolumesGetTestJSON-545874460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:45:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-fb4df115-0c73-4afb-8fb8-5a24e9ca7bba req-5d655843-7516-4abd-a8e9-020baa44cc71 tempest-VolumesGetTestJSON-545874460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:45:20 devstack sudo[95988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:45:20 devstack sudo[95988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:45:20 devstack sudo[95988]: pam_unix(sudo:session): session closed for user root Jul 31 10:45:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-fb4df115-0c73-4afb-8fb8-5a24e9ca7bba req-5d655843-7516-4abd-a8e9-020baa44cc71 tempest-VolumesGetTestJSON-545874460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.866s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:45:20 devstack cinder-volume[89090]: DEBUG cinder.manager [req-fb4df115-0c73-4afb-8fb8-5a24e9ca7bba req-5d655843-7516-4abd-a8e9-020baa44cc71 tempest-VolumesGetTestJSON-545874460 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:45:20 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-fb4df115-0c73-4afb-8fb8-5a24e9ca7bba req-5d655843-7516-4abd-a8e9-020baa44cc71 tempest-VolumesGetTestJSON-545874460 None] Deleted volume successfully. Jul 31 10:45:20 devstack cinder-volume[89090]: DEBUG cinder.coordination [req-fb4df115-0c73-4afb-8fb8-5a24e9ca7bba req-5d655843-7516-4abd-a8e9-020baa44cc71 tempest-VolumesGetTestJSON-545874460 None] Lock "cinder-280be81e-9c45-4d1c-83db-bab0abfb21d0-delete_volume" released by "delete_volume" :: held 2.625s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:45:22 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-13f58b7f-7210-401f-8af0-cd449c0a63de tempest-VolumesActionsTest-1848272351 None] Acquiring lock "cinder-dd979657-441f-44ff-a3e3-c53502d968a1" by "attach_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:45:22 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-13f58b7f-7210-401f-8af0-cd449c0a63de tempest-VolumesActionsTest-1848272351 None] Lock "cinder-dd979657-441f-44ff-a3e3-c53502d968a1" acquired by "attach_volume" :: waited 0.029s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:45:22 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-13f58b7f-7210-401f-8af0-cd449c0a63de tempest-VolumesActionsTest-1848272351 None] Attaching volume dd979657-441f-44ff-a3e3-c53502d968a1 to instance b71b637f-9571-45c4-80e0-dbffc06097f3 at mountpoint /dev/vdb on host None. Jul 31 10:45:22 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-13f58b7f-7210-401f-8af0-cd449c0a63de tempest-VolumesActionsTest-1848272351 None] Attach volume completed successfully. Jul 31 10:45:22 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-13f58b7f-7210-401f-8af0-cd449c0a63de tempest-VolumesActionsTest-1848272351 None] Lock "cinder-dd979657-441f-44ff-a3e3-c53502d968a1" released by "attach_volume" :: held 0.187s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:45:22 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-82e0f1d9-27e3-4f47-af84-4f0fc65f1802 tempest-VolumesActionsTest-1848272351 None] Acquiring lock "cinder-dd979657-441f-44ff-a3e3-c53502d968a1-detach_volume" by "detach_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:45:22 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-82e0f1d9-27e3-4f47-af84-4f0fc65f1802 tempest-VolumesActionsTest-1848272351 None] Lock "cinder-dd979657-441f-44ff-a3e3-c53502d968a1-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:45:22 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-82e0f1d9-27e3-4f47-af84-4f0fc65f1802 tempest-VolumesActionsTest-1848272351 None] Detaching volume dd979657-441f-44ff-a3e3-c53502d968a1 from instance b71b637f-9571-45c4-80e0-dbffc06097f3. Jul 31 10:45:22 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-82e0f1d9-27e3-4f47-af84-4f0fc65f1802 tempest-VolumesActionsTest-1848272351 None] Detach volume completed successfully. Jul 31 10:45:22 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-82e0f1d9-27e3-4f47-af84-4f0fc65f1802 tempest-VolumesActionsTest-1848272351 None] Lock "cinder-dd979657-441f-44ff-a3e3-c53502d968a1-detach_volume" released by "detach_volume" :: held 0.113s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:45:28 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e340f6d-d5eb-4457-8134-a55765131966 tempest-VolumesTestJSON-215539168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:45:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2e340f6d-d5eb-4457-8134-a55765131966 tempest-VolumesTestJSON-215539168 None] Flow 'volume_create_manager' (cbdbf53f-0c53-4b2a-994e-9d950a2c6c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:45:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2e340f6d-d5eb-4457-8134-a55765131966 tempest-VolumesTestJSON-215539168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39413e96-a427-4f61-8dc9-c739a1773041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:45:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2e340f6d-d5eb-4457-8134-a55765131966 tempest-VolumesTestJSON-215539168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39413e96-a427-4f61-8dc9-c739a1773041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-423990791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bc711be-ac10-47c5-839e-8914bd8ce166,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7df4e762d189494fa496ee895564f317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:45:28Z,use_quota=True,user_id='70f1fe70434c4ad0b3af862add407c68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:45:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2e340f6d-d5eb-4457-8134-a55765131966 tempest-VolumesTestJSON-215539168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a13ed38-8be3-4eff-8be5-68eacbfa79d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:45:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2e340f6d-d5eb-4457-8134-a55765131966 tempest-VolumesTestJSON-215539168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a13ed38-8be3-4eff-8be5-68eacbfa79d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:45:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2e340f6d-d5eb-4457-8134-a55765131966 tempest-VolumesTestJSON-215539168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a4dca03-7128-4fd9-bbab-eaad10d85963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:45:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2e340f6d-d5eb-4457-8134-a55765131966 tempest-VolumesTestJSON-215539168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a4dca03-7128-4fd9-bbab-eaad10d85963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bc711be-ac10-47c5-839e-8914bd8ce166', 'volume_name': 'volume-5bc711be-ac10-47c5-839e-8914bd8ce166', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:45:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2e340f6d-d5eb-4457-8134-a55765131966 tempest-VolumesTestJSON-215539168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6214f71-aa91-4546-823f-96f2d3a45b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:45:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2e340f6d-d5eb-4457-8134-a55765131966 tempest-VolumesTestJSON-215539168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6214f71-aa91-4546-823f-96f2d3a45b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:45:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2e340f6d-d5eb-4457-8134-a55765131966 tempest-VolumesTestJSON-215539168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba21361-5c61-4f16-8307-49487f8b96f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:45:28 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-2e340f6d-d5eb-4457-8134-a55765131966 tempest-VolumesTestJSON-215539168 None] Volume 5bc711be-ac10-47c5-839e-8914bd8ce166: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bc711be-ac10-47c5-839e-8914bd8ce166', 'volume_size': 1} Jul 31 10:45:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2e340f6d-d5eb-4457-8134-a55765131966 tempest-VolumesTestJSON-215539168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:45:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2e340f6d-d5eb-4457-8134-a55765131966 tempest-VolumesTestJSON-215539168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:45:28 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2e340f6d-d5eb-4457-8134-a55765131966 tempest-VolumesTestJSON-215539168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-423990791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bc711be-ac10-47c5-839e-8914bd8ce166,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7df4e762d189494fa496ee895564f317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:45:28Z,use_quota=True,user_id='70f1fe70434c4ad0b3af862add407c68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:45:28 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-2e340f6d-d5eb-4457-8134-a55765131966 tempest-VolumesTestJSON-215539168 None] Creating volume 5bc711be-ac10-47c5-839e-8914bd8ce166 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:45:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2e340f6d-d5eb-4457-8134-a55765131966 tempest-VolumesTestJSON-215539168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:45:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2e340f6d-d5eb-4457-8134-a55765131966 tempest-VolumesTestJSON-215539168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:45:28 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2e340f6d-d5eb-4457-8134-a55765131966 tempest-VolumesTestJSON-215539168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:45:28 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2e340f6d-d5eb-4457-8134-a55765131966 tempest-VolumesTestJSON-215539168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:45:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2e340f6d-d5eb-4457-8134-a55765131966 tempest-VolumesTestJSON-215539168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:45:28 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2e340f6d-d5eb-4457-8134-a55765131966 tempest-VolumesTestJSON-215539168 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:45:28 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-2e340f6d-d5eb-4457-8134-a55765131966 tempest-VolumesTestJSON-215539168 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:45:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2e340f6d-d5eb-4457-8134-a55765131966 tempest-VolumesTestJSON-215539168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5bc711be-ac10-47c5-839e-8914bd8ce166 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:45:28 devstack sudo[96021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5bc711be-ac10-47c5-839e-8914bd8ce166 1073741824 Jul 31 10:45:28 devstack sudo[96021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:45:28 devstack sudo[96021]: pam_unix(sudo:session): session closed for user root Jul 31 10:45:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2e340f6d-d5eb-4457-8134-a55765131966 tempest-VolumesTestJSON-215539168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5bc711be-ac10-47c5-839e-8914bd8ce166 1073741824" returned: 0 in 0.523s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:45:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2e340f6d-d5eb-4457-8134-a55765131966 tempest-VolumesTestJSON-215539168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5bc711be-ac10-47c5-839e-8914bd8ce166 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:45:28 devstack sudo[96027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5bc711be-ac10-47c5-839e-8914bd8ce166 Jul 31 10:45:28 devstack sudo[96027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:45:29 devstack sudo[96027]: pam_unix(sudo:session): session closed for user root Jul 31 10:45:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2e340f6d-d5eb-4457-8134-a55765131966 tempest-VolumesTestJSON-215539168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5bc711be-ac10-47c5-839e-8914bd8ce166" returned: 0 in 0.308s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:45:29 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2e340f6d-d5eb-4457-8134-a55765131966 tempest-VolumesTestJSON-215539168 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:45:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2e340f6d-d5eb-4457-8134-a55765131966 tempest-VolumesTestJSON-215539168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:45:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2e340f6d-d5eb-4457-8134-a55765131966 tempest-VolumesTestJSON-215539168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba21361-5c61-4f16-8307-49487f8b96f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bc711be-ac10-47c5-839e-8914bd8ce166', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:45:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2e340f6d-d5eb-4457-8134-a55765131966 tempest-VolumesTestJSON-215539168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1117e50e-3f97-4ac8-817f-e91f8d1f4b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:45:29 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-2e340f6d-d5eb-4457-8134-a55765131966 tempest-VolumesTestJSON-215539168 None] Volume volume-5bc711be-ac10-47c5-839e-8914bd8ce166 (5bc711be-ac10-47c5-839e-8914bd8ce166): created successfully Jul 31 10:45:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2e340f6d-d5eb-4457-8134-a55765131966 tempest-VolumesTestJSON-215539168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1117e50e-3f97-4ac8-817f-e91f8d1f4b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:45:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2e340f6d-d5eb-4457-8134-a55765131966 tempest-VolumesTestJSON-215539168 None] Flow 'volume_create_manager' (cbdbf53f-0c53-4b2a-994e-9d950a2c6c13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:45:29 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-2e340f6d-d5eb-4457-8134-a55765131966 tempest-VolumesTestJSON-215539168 None] Created volume successfully. Jul 31 10:45:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3a07d889-ea3b-4e9b-ae2e-5ae539ada938 tempest-VolumesActionsTest-1848272351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:45:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3a07d889-ea3b-4e9b-ae2e-5ae539ada938 tempest-VolumesActionsTest-1848272351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:45:29 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[d112f797-98cb-4ade-94de-a68c88ffcb45]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:45:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3a07d889-ea3b-4e9b-ae2e-5ae539ada938 tempest-VolumesActionsTest-1848272351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-dd979657-441f-44ff-a3e3-c53502d968a1 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:45:29 devstack sudo[96030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-dd979657-441f-44ff-a3e3-c53502d968a1 Jul 31 10:45:29 devstack sudo[96030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:45:30 devstack sudo[96030]: pam_unix(sudo:session): session closed for user root Jul 31 10:45:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3a07d889-ea3b-4e9b-ae2e-5ae539ada938 tempest-VolumesActionsTest-1848272351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-dd979657-441f-44ff-a3e3-c53502d968a1" returned: 0 in 0.458s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:45:30 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f3dc13-208d-4f43-adc4-12094f1e4db5]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:45:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3a07d889-ea3b-4e9b-ae2e-5ae539ada938 tempest-VolumesActionsTest-1848272351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-dd979657-441f-44ff-a3e3-c53502d968a1 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:45:30 devstack sudo[96038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-dd979657-441f-44ff-a3e3-c53502d968a1 Jul 31 10:45:30 devstack sudo[96038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:45:30 devstack sudo[96038]: pam_unix(sudo:session): session closed for user root Jul 31 10:45:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3a07d889-ea3b-4e9b-ae2e-5ae539ada938 tempest-VolumesActionsTest-1848272351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-dd979657-441f-44ff-a3e3-c53502d968a1" returned: 0 in 0.520s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:45:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3a07d889-ea3b-4e9b-ae2e-5ae539ada938 tempest-VolumesActionsTest-1848272351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-dd979657-441f-44ff-a3e3-c53502d968a1 /opt/stack/data/cinder/conversion/dd979657-441f-44ff-a3e3-c53502d968a1.temp_image.c76638fa-105e-43e5-9e47-ed5de1153417y0vf3n04.img {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:45:30 devstack sudo[96043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-dd979657-441f-44ff-a3e3-c53502d968a1 /opt/stack/data/cinder/conversion/dd979657-441f-44ff-a3e3-c53502d968a1.temp_image.c76638fa-105e-43e5-9e47-ed5de1153417y0vf3n04.img Jul 31 10:45:30 devstack sudo[96043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:45:31 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-d61d417c-9f9c-487c-80ef-74117e5696fe tempest-VolumesTestJSON-215539168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:45:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d61d417c-9f9c-487c-80ef-74117e5696fe tempest-VolumesTestJSON-215539168 None] Flow 'volume_create_manager' (fc83fb2d-9fe0-4780-b529-614e486c19b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:45:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d61d417c-9f9c-487c-80ef-74117e5696fe tempest-VolumesTestJSON-215539168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e71f1248-f340-427f-8669-3fc9361ba8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:45:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d61d417c-9f9c-487c-80ef-74117e5696fe tempest-VolumesTestJSON-215539168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e71f1248-f340-427f-8669-3fc9361ba8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-767784694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=261c7cea-d49b-420f-ae2d-e2ee73ce7408,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7df4e762d189494fa496ee895564f317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:45:31Z,use_quota=True,user_id='70f1fe70434c4ad0b3af862add407c68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:45:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d61d417c-9f9c-487c-80ef-74117e5696fe tempest-VolumesTestJSON-215539168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be0c0681-5040-433c-b7d0-723d1c33dc21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:45:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d61d417c-9f9c-487c-80ef-74117e5696fe tempest-VolumesTestJSON-215539168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be0c0681-5040-433c-b7d0-723d1c33dc21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:45:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d61d417c-9f9c-487c-80ef-74117e5696fe tempest-VolumesTestJSON-215539168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e06b2702-d47e-4e96-8f24-ca862825d4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:45:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d61d417c-9f9c-487c-80ef-74117e5696fe tempest-VolumesTestJSON-215539168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e06b2702-d47e-4e96-8f24-ca862825d4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '261c7cea-d49b-420f-ae2d-e2ee73ce7408', 'volume_name': 'volume-261c7cea-d49b-420f-ae2d-e2ee73ce7408', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:45:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d61d417c-9f9c-487c-80ef-74117e5696fe tempest-VolumesTestJSON-215539168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75fa1e93-6678-4997-acae-7e7af30e8730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:45:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d61d417c-9f9c-487c-80ef-74117e5696fe tempest-VolumesTestJSON-215539168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75fa1e93-6678-4997-acae-7e7af30e8730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:45:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d61d417c-9f9c-487c-80ef-74117e5696fe tempest-VolumesTestJSON-215539168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4df0765-2a30-4257-8ec2-ccf979e8efef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:45:31 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-d61d417c-9f9c-487c-80ef-74117e5696fe tempest-VolumesTestJSON-215539168 None] Volume 261c7cea-d49b-420f-ae2d-e2ee73ce7408: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-261c7cea-d49b-420f-ae2d-e2ee73ce7408', 'volume_size': 1} Jul 31 10:45:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d61d417c-9f9c-487c-80ef-74117e5696fe tempest-VolumesTestJSON-215539168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:45:37 devstack sudo[96043]: pam_unix(sudo:session): session closed for user root Jul 31 10:45:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3a07d889-ea3b-4e9b-ae2e-5ae539ada938 tempest-VolumesActionsTest-1848272351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-dd979657-441f-44ff-a3e3-c53502d968a1 /opt/stack/data/cinder/conversion/dd979657-441f-44ff-a3e3-c53502d968a1.temp_image.c76638fa-105e-43e5-9e47-ed5de1153417y0vf3n04.img" returned: 0 in 6.590s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:45:37 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e18c57-ca1c-41c5-8f20-ef8ab271eb39]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:45:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3a07d889-ea3b-4e9b-ae2e-5ae539ada938 tempest-VolumesActionsTest-1848272351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-dd979657-441f-44ff-a3e3-c53502d968a1 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:45:37 devstack sudo[96102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-dd979657-441f-44ff-a3e3-c53502d968a1 Jul 31 10:45:37 devstack sudo[96102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:45:38 devstack sudo[96102]: pam_unix(sudo:session): session closed for user root Jul 31 10:45:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3a07d889-ea3b-4e9b-ae2e-5ae539ada938 tempest-VolumesActionsTest-1848272351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-dd979657-441f-44ff-a3e3-c53502d968a1" returned: 0 in 0.709s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:45:38 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-3a07d889-ea3b-4e9b-ae2e-5ae539ada938 tempest-VolumesActionsTest-1848272351 None] Image conversion details: src /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-dd979657-441f-44ff-a3e3-c53502d968a1, size 1024.00 MB, duration 6.59 sec, destination /opt/stack/data/cinder/conversion/dd979657-441f-44ff-a3e3-c53502d968a1.temp_image.c76638fa-105e-43e5-9e47-ed5de1153417y0vf3n04.img {{(pid=89090) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 10:45:38 devstack cinder-volume[89090]: INFO cinder.image.image_utils [None req-3a07d889-ea3b-4e9b-ae2e-5ae539ada938 tempest-VolumesActionsTest-1848272351 None] Converted 1024.00 MB image at 155.37 MB/s Jul 31 10:45:38 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-3a07d889-ea3b-4e9b-ae2e-5ae539ada938 tempest-VolumesActionsTest-1848272351 None] c76638fa-105e-43e5-9e47-ed5de1153417 was raw, no need to convert to raw {{(pid=89090) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 31 10:45:40 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9386bdae-6ada-45e5-9fe9-2c5dd9276483 tempest-AttachVolumeShelveTestJSON-1538487283 None] Acquiring lock "cinder-fb9648fd-713a-412b-95bf-9377e419b496-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:45:40 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9386bdae-6ada-45e5-9fe9-2c5dd9276483 tempest-AttachVolumeShelveTestJSON-1538487283 None] Lock "cinder-fb9648fd-713a-412b-95bf-9377e419b496-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:45:40 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9386bdae-6ada-45e5-9fe9-2c5dd9276483 tempest-AttachVolumeShelveTestJSON-1538487283 None] Acquiring lock "cinder-quobyte-fb9648fd-713a-412b-95bf-9377e419b496" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:45:40 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9386bdae-6ada-45e5-9fe9-2c5dd9276483 tempest-AttachVolumeShelveTestJSON-1538487283 None] Lock "cinder-quobyte-fb9648fd-713a-412b-95bf-9377e419b496" acquired by "delete_volume" :: waited 0.023s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:45:40 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f4865c-8542-4296-907a-4da8ac04a761]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:45:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9386bdae-6ada-45e5-9fe9-2c5dd9276483 tempest-AttachVolumeShelveTestJSON-1538487283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fb9648fd-713a-412b-95bf-9377e419b496 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:45:40 devstack sudo[96108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fb9648fd-713a-412b-95bf-9377e419b496 Jul 31 10:45:40 devstack sudo[96108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:45:40 devstack sudo[96108]: pam_unix(sudo:session): session closed for user root Jul 31 10:45:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9386bdae-6ada-45e5-9fe9-2c5dd9276483 tempest-AttachVolumeShelveTestJSON-1538487283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fb9648fd-713a-412b-95bf-9377e419b496" returned: 0 in 0.526s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:45:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9386bdae-6ada-45e5-9fe9-2c5dd9276483 tempest-AttachVolumeShelveTestJSON-1538487283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fb9648fd-713a-412b-95bf-9377e419b496 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:45:40 devstack sudo[96114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fb9648fd-713a-412b-95bf-9377e419b496 Jul 31 10:45:40 devstack sudo[96114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:45:41 devstack sudo[96114]: pam_unix(sudo:session): session closed for user root Jul 31 10:45:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9386bdae-6ada-45e5-9fe9-2c5dd9276483 tempest-AttachVolumeShelveTestJSON-1538487283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fb9648fd-713a-412b-95bf-9377e419b496" returned: 0 in 0.321s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:45:41 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9386bdae-6ada-45e5-9fe9-2c5dd9276483 tempest-AttachVolumeShelveTestJSON-1538487283 None] Lock "cinder-quobyte-fb9648fd-713a-412b-95bf-9377e419b496" released by "delete_volume" :: held 0.922s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:45:41 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-9386bdae-6ada-45e5-9fe9-2c5dd9276483 tempest-AttachVolumeShelveTestJSON-1538487283 None] Created reservations ['65aeb6bc-3009-4b9b-bcaa-b2e6bf520291', '607d97c4-d91b-4d3d-8a6d-78c1d69bdc19', 'd0f2d82d-0832-4a6d-b0b3-f9d170a7f805', 'e952cd9a-5ae9-49b1-9a03-da531efd305c'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:45:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9386bdae-6ada-45e5-9fe9-2c5dd9276483 tempest-AttachVolumeShelveTestJSON-1538487283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:45:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9386bdae-6ada-45e5-9fe9-2c5dd9276483 tempest-AttachVolumeShelveTestJSON-1538487283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:45:41 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-9386bdae-6ada-45e5-9fe9-2c5dd9276483 tempest-AttachVolumeShelveTestJSON-1538487283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:45:41 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-9386bdae-6ada-45e5-9fe9-2c5dd9276483 tempest-AttachVolumeShelveTestJSON-1538487283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:45:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9386bdae-6ada-45e5-9fe9-2c5dd9276483 tempest-AttachVolumeShelveTestJSON-1538487283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:45:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9386bdae-6ada-45e5-9fe9-2c5dd9276483 tempest-AttachVolumeShelveTestJSON-1538487283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:45:41 devstack sudo[96117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:45:41 devstack sudo[96117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:45:41 devstack sudo[96117]: pam_unix(sudo:session): session closed for user root Jul 31 10:45:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9386bdae-6ada-45e5-9fe9-2c5dd9276483 tempest-AttachVolumeShelveTestJSON-1538487283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.354s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:45:41 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-9386bdae-6ada-45e5-9fe9-2c5dd9276483 tempest-AttachVolumeShelveTestJSON-1538487283 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:45:41 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-9386bdae-6ada-45e5-9fe9-2c5dd9276483 tempest-AttachVolumeShelveTestJSON-1538487283 None] Deleted volume successfully. Jul 31 10:45:41 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9386bdae-6ada-45e5-9fe9-2c5dd9276483 tempest-AttachVolumeShelveTestJSON-1538487283 None] Lock "cinder-fb9648fd-713a-412b-95bf-9377e419b496-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:45:45 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:45:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:45:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:45:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:45:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:45:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:45:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:45:45 devstack sudo[96121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:45:45 devstack sudo[96121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:45:46 devstack sudo[96121]: pam_unix(sudo:session): session closed for user root Jul 31 10:45:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.355s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:45:46 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:45:46 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager._thread_info {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:45:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread count: 28 {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:45:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread info: [<_MainThread(MainThread, started 134005426110592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:45:46 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2cf41e9-8265-4c2a-8193-7afbf9662274 tempest-SnapshotMetadataTestJSON-1577768266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:45:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a2cf41e9-8265-4c2a-8193-7afbf9662274 tempest-SnapshotMetadataTestJSON-1577768266 None] Flow 'volume_create_manager' (eeed9ef9-2f0e-4415-9975-6275fd5fa374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:45:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a2cf41e9-8265-4c2a-8193-7afbf9662274 tempest-SnapshotMetadataTestJSON-1577768266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2900e06-0c57-4b59-a18b-a482372f7485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:45:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a2cf41e9-8265-4c2a-8193-7afbf9662274 tempest-SnapshotMetadataTestJSON-1577768266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2900e06-0c57-4b59-a18b-a482372f7485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-668309273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=314e6a53-c637-4969-aec9-b016780a9439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b17655703644c08ff7c0bc1fc60a68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:45:46Z,use_quota=True,user_id='44b4e609de894db5b0441133363afb34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:45:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a2cf41e9-8265-4c2a-8193-7afbf9662274 tempest-SnapshotMetadataTestJSON-1577768266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd17f64d-53ec-4e16-9c17-06d38876aa95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:45:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a2cf41e9-8265-4c2a-8193-7afbf9662274 tempest-SnapshotMetadataTestJSON-1577768266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd17f64d-53ec-4e16-9c17-06d38876aa95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:45:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a2cf41e9-8265-4c2a-8193-7afbf9662274 tempest-SnapshotMetadataTestJSON-1577768266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f4c17d3-dbe4-4ec6-aaeb-36b7d998fe5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:45:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a2cf41e9-8265-4c2a-8193-7afbf9662274 tempest-SnapshotMetadataTestJSON-1577768266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f4c17d3-dbe4-4ec6-aaeb-36b7d998fe5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '314e6a53-c637-4969-aec9-b016780a9439', 'volume_name': 'volume-314e6a53-c637-4969-aec9-b016780a9439', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:45:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a2cf41e9-8265-4c2a-8193-7afbf9662274 tempest-SnapshotMetadataTestJSON-1577768266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0776c291-ffd7-4392-966a-91b06897b17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:45:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a2cf41e9-8265-4c2a-8193-7afbf9662274 tempest-SnapshotMetadataTestJSON-1577768266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0776c291-ffd7-4392-966a-91b06897b17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:45:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a2cf41e9-8265-4c2a-8193-7afbf9662274 tempest-SnapshotMetadataTestJSON-1577768266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6db22190-0e32-4ad7-a463-fd7f723cacd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:45:46 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-a2cf41e9-8265-4c2a-8193-7afbf9662274 tempest-SnapshotMetadataTestJSON-1577768266 None] Volume 314e6a53-c637-4969-aec9-b016780a9439: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-314e6a53-c637-4969-aec9-b016780a9439', 'volume_size': 1} Jul 31 10:45:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a2cf41e9-8265-4c2a-8193-7afbf9662274 tempest-SnapshotMetadataTestJSON-1577768266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:45:51 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=21,cinder:INSERT=8,cinder:UPDATE=20,cinder:DELETE=3 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:45:56 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=22,cinder:INSERT=3,cinder:UPDATE=25 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:46:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3a07d889-ea3b-4e9b-ae2e-5ae539ada938 tempest-VolumesActionsTest-1848272351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 32.545s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:46:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3a07d889-ea3b-4e9b-ae2e-5ae539ada938 tempest-VolumesActionsTest-1848272351 None] Uploaded volume to glance image-id: c76638fa-105e-43e5-9e47-ed5de1153417. {{(pid=89090) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 31 10:46:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d61d417c-9f9c-487c-80ef-74117e5696fe tempest-VolumesTestJSON-215539168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 31.027s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:46:02 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d61d417c-9f9c-487c-80ef-74117e5696fe tempest-VolumesTestJSON-215539168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-767784694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=261c7cea-d49b-420f-ae2d-e2ee73ce7408,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7df4e762d189494fa496ee895564f317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:45:31Z,use_quota=True,user_id='70f1fe70434c4ad0b3af862add407c68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:46:02 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-d61d417c-9f9c-487c-80ef-74117e5696fe tempest-VolumesTestJSON-215539168 None] Creating volume 261c7cea-d49b-420f-ae2d-e2ee73ce7408 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:46:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d61d417c-9f9c-487c-80ef-74117e5696fe tempest-VolumesTestJSON-215539168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:46:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d61d417c-9f9c-487c-80ef-74117e5696fe tempest-VolumesTestJSON-215539168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:46:02 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d61d417c-9f9c-487c-80ef-74117e5696fe tempest-VolumesTestJSON-215539168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:46:02 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d61d417c-9f9c-487c-80ef-74117e5696fe tempest-VolumesTestJSON-215539168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:46:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d61d417c-9f9c-487c-80ef-74117e5696fe tempest-VolumesTestJSON-215539168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:46:02 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d61d417c-9f9c-487c-80ef-74117e5696fe tempest-VolumesTestJSON-215539168 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:46:02 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-d61d417c-9f9c-487c-80ef-74117e5696fe tempest-VolumesTestJSON-215539168 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:46:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d61d417c-9f9c-487c-80ef-74117e5696fe tempest-VolumesTestJSON-215539168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-261c7cea-d49b-420f-ae2d-e2ee73ce7408 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:02 devstack sudo[96165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-261c7cea-d49b-420f-ae2d-e2ee73ce7408 1073741824 Jul 31 10:46:02 devstack sudo[96165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:02 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-3a07d889-ea3b-4e9b-ae2e-5ae539ada938 tempest-VolumesActionsTest-1848272351 None] Copy volume to image completed successfully. Jul 31 10:46:02 devstack sudo[96165]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d61d417c-9f9c-487c-80ef-74117e5696fe tempest-VolumesTestJSON-215539168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-261c7cea-d49b-420f-ae2d-e2ee73ce7408 1073741824" returned: 0 in 0.656s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d61d417c-9f9c-487c-80ef-74117e5696fe tempest-VolumesTestJSON-215539168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-261c7cea-d49b-420f-ae2d-e2ee73ce7408 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:02 devstack sudo[96171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-261c7cea-d49b-420f-ae2d-e2ee73ce7408 Jul 31 10:46:03 devstack sudo[96171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:03 devstack sudo[96171]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d61d417c-9f9c-487c-80ef-74117e5696fe tempest-VolumesTestJSON-215539168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-261c7cea-d49b-420f-ae2d-e2ee73ce7408" returned: 0 in 0.312s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:03 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d61d417c-9f9c-487c-80ef-74117e5696fe tempest-VolumesTestJSON-215539168 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:46:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d61d417c-9f9c-487c-80ef-74117e5696fe tempest-VolumesTestJSON-215539168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:46:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a2cf41e9-8265-4c2a-8193-7afbf9662274 tempest-SnapshotMetadataTestJSON-1577768266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.714s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:46:03 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a2cf41e9-8265-4c2a-8193-7afbf9662274 tempest-SnapshotMetadataTestJSON-1577768266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-668309273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=314e6a53-c637-4969-aec9-b016780a9439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b17655703644c08ff7c0bc1fc60a68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:45:46Z,use_quota=True,user_id='44b4e609de894db5b0441133363afb34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:46:03 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-a2cf41e9-8265-4c2a-8193-7afbf9662274 tempest-SnapshotMetadataTestJSON-1577768266 None] Creating volume 314e6a53-c637-4969-aec9-b016780a9439 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:46:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a2cf41e9-8265-4c2a-8193-7afbf9662274 tempest-SnapshotMetadataTestJSON-1577768266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:46:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a2cf41e9-8265-4c2a-8193-7afbf9662274 tempest-SnapshotMetadataTestJSON-1577768266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:46:03 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a2cf41e9-8265-4c2a-8193-7afbf9662274 tempest-SnapshotMetadataTestJSON-1577768266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:46:03 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a2cf41e9-8265-4c2a-8193-7afbf9662274 tempest-SnapshotMetadataTestJSON-1577768266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:46:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a2cf41e9-8265-4c2a-8193-7afbf9662274 tempest-SnapshotMetadataTestJSON-1577768266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:46:03 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a2cf41e9-8265-4c2a-8193-7afbf9662274 tempest-SnapshotMetadataTestJSON-1577768266 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:46:03 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-a2cf41e9-8265-4c2a-8193-7afbf9662274 tempest-SnapshotMetadataTestJSON-1577768266 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:46:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a2cf41e9-8265-4c2a-8193-7afbf9662274 tempest-SnapshotMetadataTestJSON-1577768266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d61d417c-9f9c-487c-80ef-74117e5696fe tempest-VolumesTestJSON-215539168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4df0765-2a30-4257-8ec2-ccf979e8efef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-261c7cea-d49b-420f-ae2d-e2ee73ce7408', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d61d417c-9f9c-487c-80ef-74117e5696fe tempest-VolumesTestJSON-215539168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba0cd654-8aae-4a0f-8ed9-1b457a9556f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:03 devstack sudo[96174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439 1073741824 Jul 31 10:46:03 devstack sudo[96174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:03 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-d61d417c-9f9c-487c-80ef-74117e5696fe tempest-VolumesTestJSON-215539168 None] Volume volume-261c7cea-d49b-420f-ae2d-e2ee73ce7408 (261c7cea-d49b-420f-ae2d-e2ee73ce7408): created successfully Jul 31 10:46:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d61d417c-9f9c-487c-80ef-74117e5696fe tempest-VolumesTestJSON-215539168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba0cd654-8aae-4a0f-8ed9-1b457a9556f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d61d417c-9f9c-487c-80ef-74117e5696fe tempest-VolumesTestJSON-215539168 None] Flow 'volume_create_manager' (fc83fb2d-9fe0-4780-b529-614e486c19b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:46:03 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-d61d417c-9f9c-487c-80ef-74117e5696fe tempest-VolumesTestJSON-215539168 None] Created volume successfully. Jul 31 10:46:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-218f2411-2e53-42c9-9dfc-2c6e2115949b tempest-VolumesActionsTest-1848272351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:46:03 devstack sudo[96174]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a2cf41e9-8265-4c2a-8193-7afbf9662274 tempest-SnapshotMetadataTestJSON-1577768266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439 1073741824" returned: 0 in 0.616s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a2cf41e9-8265-4c2a-8193-7afbf9662274 tempest-SnapshotMetadataTestJSON-1577768266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:03 devstack sudo[96180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439 Jul 31 10:46:03 devstack sudo[96180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:04 devstack sudo[96180]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a2cf41e9-8265-4c2a-8193-7afbf9662274 tempest-SnapshotMetadataTestJSON-1577768266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439" returned: 0 in 0.299s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a2cf41e9-8265-4c2a-8193-7afbf9662274 tempest-SnapshotMetadataTestJSON-1577768266 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:46:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a2cf41e9-8265-4c2a-8193-7afbf9662274 tempest-SnapshotMetadataTestJSON-1577768266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:46:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-218f2411-2e53-42c9-9dfc-2c6e2115949b tempest-VolumesActionsTest-1848272351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.434s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:46:04 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a2cf41e9-8265-4c2a-8193-7afbf9662274 tempest-SnapshotMetadataTestJSON-1577768266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6db22190-0e32-4ad7-a463-fd7f723cacd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-314e6a53-c637-4969-aec9-b016780a9439', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:04 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a2cf41e9-8265-4c2a-8193-7afbf9662274 tempest-SnapshotMetadataTestJSON-1577768266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (019defa3-000a-4bb9-915c-d0c37ad9b3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:04 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa84da7-977a-4659-9216-f5e692e089a9]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:46:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-218f2411-2e53-42c9-9dfc-2c6e2115949b tempest-VolumesActionsTest-1848272351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-dd979657-441f-44ff-a3e3-c53502d968a1 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:04 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-a2cf41e9-8265-4c2a-8193-7afbf9662274 tempest-SnapshotMetadataTestJSON-1577768266 None] Volume volume-314e6a53-c637-4969-aec9-b016780a9439 (314e6a53-c637-4969-aec9-b016780a9439): created successfully Jul 31 10:46:04 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a2cf41e9-8265-4c2a-8193-7afbf9662274 tempest-SnapshotMetadataTestJSON-1577768266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (019defa3-000a-4bb9-915c-d0c37ad9b3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:04 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a2cf41e9-8265-4c2a-8193-7afbf9662274 tempest-SnapshotMetadataTestJSON-1577768266 None] Flow 'volume_create_manager' (eeed9ef9-2f0e-4415-9975-6275fd5fa374) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:46:04 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-a2cf41e9-8265-4c2a-8193-7afbf9662274 tempest-SnapshotMetadataTestJSON-1577768266 None] Created volume successfully. Jul 31 10:46:04 devstack sudo[96183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-dd979657-441f-44ff-a3e3-c53502d968a1 Jul 31 10:46:04 devstack sudo[96183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:04 devstack sudo[96183]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-218f2411-2e53-42c9-9dfc-2c6e2115949b tempest-VolumesActionsTest-1848272351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-dd979657-441f-44ff-a3e3-c53502d968a1" returned: 0 in 0.484s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:04 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8fbdcd-fd1e-418b-8f20-6e527872bed5]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:46:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-218f2411-2e53-42c9-9dfc-2c6e2115949b tempest-VolumesActionsTest-1848272351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-dd979657-441f-44ff-a3e3-c53502d968a1 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:04 devstack sudo[96188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-dd979657-441f-44ff-a3e3-c53502d968a1 Jul 31 10:46:04 devstack sudo[96188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:05 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6227009-e9ed-45cc-8447-0282a8dc8cd0 tempest-VolumesTestJSON-215539168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:46:05 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b6227009-e9ed-45cc-8447-0282a8dc8cd0 tempest-VolumesTestJSON-215539168 None] Flow 'volume_create_manager' (ceb43609-d940-4862-b249-fe798b4f212a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:46:05 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b6227009-e9ed-45cc-8447-0282a8dc8cd0 tempest-VolumesTestJSON-215539168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff900830-4c66-4e08-a06b-0c79979b78ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:05 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b6227009-e9ed-45cc-8447-0282a8dc8cd0 tempest-VolumesTestJSON-215539168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff900830-4c66-4e08-a06b-0c79979b78ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-213355569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5b69d88-622a-47a8-a888-41dc7cf07f3d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7df4e762d189494fa496ee895564f317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:46:05Z,use_quota=True,user_id='70f1fe70434c4ad0b3af862add407c68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:05 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b6227009-e9ed-45cc-8447-0282a8dc8cd0 tempest-VolumesTestJSON-215539168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a15ea313-6251-48f6-adbe-974a56fb5b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:05 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b6227009-e9ed-45cc-8447-0282a8dc8cd0 tempest-VolumesTestJSON-215539168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a15ea313-6251-48f6-adbe-974a56fb5b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:05 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b6227009-e9ed-45cc-8447-0282a8dc8cd0 tempest-VolumesTestJSON-215539168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b0eeb5b-ff78-42f4-88b9-d9a1701975d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:05 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b6227009-e9ed-45cc-8447-0282a8dc8cd0 tempest-VolumesTestJSON-215539168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b0eeb5b-ff78-42f4-88b9-d9a1701975d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5b69d88-622a-47a8-a888-41dc7cf07f3d', 'volume_name': 'volume-a5b69d88-622a-47a8-a888-41dc7cf07f3d', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:05 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b6227009-e9ed-45cc-8447-0282a8dc8cd0 tempest-VolumesTestJSON-215539168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e25cc280-afca-4bea-9197-d12456b05b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:05 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b6227009-e9ed-45cc-8447-0282a8dc8cd0 tempest-VolumesTestJSON-215539168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e25cc280-afca-4bea-9197-d12456b05b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:05 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b6227009-e9ed-45cc-8447-0282a8dc8cd0 tempest-VolumesTestJSON-215539168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76a285c3-3a71-4594-abb9-e2fd34a573ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:05 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-b6227009-e9ed-45cc-8447-0282a8dc8cd0 tempest-VolumesTestJSON-215539168 None] Volume a5b69d88-622a-47a8-a888-41dc7cf07f3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5b69d88-622a-47a8-a888-41dc7cf07f3d', 'volume_size': 1} Jul 31 10:46:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b6227009-e9ed-45cc-8447-0282a8dc8cd0 tempest-VolumesTestJSON-215539168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:46:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7e628783-302d-4c0c-bf2b-6f3e6d4c2656 tempest-SnapshotMetadataTestJSON-1577768266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:46:05 devstack sudo[96188]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-218f2411-2e53-42c9-9dfc-2c6e2115949b tempest-VolumesActionsTest-1848272351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-dd979657-441f-44ff-a3e3-c53502d968a1" returned: 0 in 0.516s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-218f2411-2e53-42c9-9dfc-2c6e2115949b tempest-VolumesActionsTest-1848272351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-dd979657-441f-44ff-a3e3-c53502d968a1 /opt/stack/data/cinder/conversion/dd979657-441f-44ff-a3e3-c53502d968a1.temp_image.dcf67c1d-736a-4aad-9854-19b2dfd4559c4ldn3nvf.img {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:05 devstack sudo[96193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-dd979657-441f-44ff-a3e3-c53502d968a1 /opt/stack/data/cinder/conversion/dd979657-441f-44ff-a3e3-c53502d968a1.temp_image.dcf67c1d-736a-4aad-9854-19b2dfd4559c4ldn3nvf.img Jul 31 10:46:05 devstack sudo[96193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:09 devstack sudo[96193]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-218f2411-2e53-42c9-9dfc-2c6e2115949b tempest-VolumesActionsTest-1848272351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-dd979657-441f-44ff-a3e3-c53502d968a1 /opt/stack/data/cinder/conversion/dd979657-441f-44ff-a3e3-c53502d968a1.temp_image.dcf67c1d-736a-4aad-9854-19b2dfd4559c4ldn3nvf.img" returned: 0 in 4.601s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:09 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[938c541b-7baf-4644-9571-bdefdb2e3a93]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:46:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-218f2411-2e53-42c9-9dfc-2c6e2115949b tempest-VolumesActionsTest-1848272351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-dd979657-441f-44ff-a3e3-c53502d968a1 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:10 devstack sudo[96216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-dd979657-441f-44ff-a3e3-c53502d968a1 Jul 31 10:46:10 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:10 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-218f2411-2e53-42c9-9dfc-2c6e2115949b tempest-VolumesActionsTest-1848272351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-dd979657-441f-44ff-a3e3-c53502d968a1" returned: 0 in 0.690s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:10 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-218f2411-2e53-42c9-9dfc-2c6e2115949b tempest-VolumesActionsTest-1848272351 None] Image conversion details: src /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-dd979657-441f-44ff-a3e3-c53502d968a1, size 1024.00 MB, duration 4.60 sec, destination /opt/stack/data/cinder/conversion/dd979657-441f-44ff-a3e3-c53502d968a1.temp_image.dcf67c1d-736a-4aad-9854-19b2dfd4559c4ldn3nvf.img {{(pid=89090) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 10:46:10 devstack cinder-volume[89090]: INFO cinder.image.image_utils [None req-218f2411-2e53-42c9-9dfc-2c6e2115949b tempest-VolumesActionsTest-1848272351 None] Converted 1024.00 MB image at 222.46 MB/s Jul 31 10:46:10 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-218f2411-2e53-42c9-9dfc-2c6e2115949b tempest-VolumesActionsTest-1848272351 None] dcf67c1d-736a-4aad-9854-19b2dfd4559c was raw, converting to qcow2 {{(pid=89090) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 31 10:46:10 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad20498-6bc1-44ed-a3a4-3b05d1039a4a]: (4, 'raw') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:46:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-218f2411-2e53-42c9-9dfc-2c6e2115949b tempest-VolumesActionsTest-1848272351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/dd979657-441f-44ff-a3e3-c53502d968a1.temp_image.dcf67c1d-736a-4aad-9854-19b2dfd4559c4ldn3nvf.img {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:10 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/dd979657-441f-44ff-a3e3-c53502d968a1.temp_image.dcf67c1d-736a-4aad-9854-19b2dfd4559c4ldn3nvf.img Jul 31 10:46:10 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:11 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-218f2411-2e53-42c9-9dfc-2c6e2115949b tempest-VolumesActionsTest-1848272351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/dd979657-441f-44ff-a3e3-c53502d968a1.temp_image.dcf67c1d-736a-4aad-9854-19b2dfd4559c4ldn3nvf.img" returned: 0 in 0.408s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-218f2411-2e53-42c9-9dfc-2c6e2115949b tempest-VolumesActionsTest-1848272351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/dd979657-441f-44ff-a3e3-c53502d968a1.temp_image.dcf67c1d-736a-4aad-9854-19b2dfd4559c4ldn3nvf.img {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:11 devstack sudo[96226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/dd979657-441f-44ff-a3e3-c53502d968a1.temp_image.dcf67c1d-736a-4aad-9854-19b2dfd4559c4ldn3nvf.img Jul 31 10:46:11 devstack sudo[96226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:11 devstack sudo[96226]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-218f2411-2e53-42c9-9dfc-2c6e2115949b tempest-VolumesActionsTest-1848272351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/dd979657-441f-44ff-a3e3-c53502d968a1.temp_image.dcf67c1d-736a-4aad-9854-19b2dfd4559c4ldn3nvf.img" returned: 1 in 0.427s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-218f2411-2e53-42c9-9dfc-2c6e2115949b tempest-VolumesActionsTest-1848272351 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/dd979657-441f-44ff-a3e3-c53502d968a1.temp_image.dcf67c1d-736a-4aad-9854-19b2dfd4559c4ldn3nvf.img' failed. Not Retrying. {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 10:46:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-218f2411-2e53-42c9-9dfc-2c6e2115949b tempest-VolumesActionsTest-1848272351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/dd979657-441f-44ff-a3e3-c53502d968a1.temp_image.dcf67c1d-736a-4aad-9854-19b2dfd4559c4ldn3nvf.img /opt/stack/data/cinder/conversion/vol_upload_pg3f5mkg {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:11 devstack sudo[96235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/dd979657-441f-44ff-a3e3-c53502d968a1.temp_image.dcf67c1d-736a-4aad-9854-19b2dfd4559c4ldn3nvf.img /opt/stack/data/cinder/conversion/vol_upload_pg3f5mkg Jul 31 10:46:11 devstack sudo[96235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:11 devstack sudo[96235]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-218f2411-2e53-42c9-9dfc-2c6e2115949b tempest-VolumesActionsTest-1848272351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/dd979657-441f-44ff-a3e3-c53502d968a1.temp_image.dcf67c1d-736a-4aad-9854-19b2dfd4559c4ldn3nvf.img /opt/stack/data/cinder/conversion/vol_upload_pg3f5mkg" returned: 0 in 0.385s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:11 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-218f2411-2e53-42c9-9dfc-2c6e2115949b tempest-VolumesActionsTest-1848272351 None] Image conversion details: src /opt/stack/data/cinder/conversion/dd979657-441f-44ff-a3e3-c53502d968a1.temp_image.dcf67c1d-736a-4aad-9854-19b2dfd4559c4ldn3nvf.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_pg3f5mkg {{(pid=89090) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 10:46:11 devstack cinder-volume[89090]: INFO cinder.image.image_utils [None req-218f2411-2e53-42c9-9dfc-2c6e2115949b tempest-VolumesActionsTest-1848272351 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 31 10:46:11 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ccd08c-ac81-4cd8-8f31-ede1dd32bf63]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:46:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-218f2411-2e53-42c9-9dfc-2c6e2115949b tempest-VolumesActionsTest-1848272351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pg3f5mkg {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:12 devstack sudo[96250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pg3f5mkg Jul 31 10:46:12 devstack sudo[96250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:12 devstack sudo[96250]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-218f2411-2e53-42c9-9dfc-2c6e2115949b tempest-VolumesActionsTest-1848272351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pg3f5mkg" returned: 0 in 0.423s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-218f2411-2e53-42c9-9dfc-2c6e2115949b tempest-VolumesActionsTest-1848272351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.929s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:46:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-218f2411-2e53-42c9-9dfc-2c6e2115949b tempest-VolumesActionsTest-1848272351 None] Uploaded volume to glance image-id: dcf67c1d-736a-4aad-9854-19b2dfd4559c. {{(pid=89090) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 31 10:46:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b6227009-e9ed-45cc-8447-0282a8dc8cd0 tempest-VolumesTestJSON-215539168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.075s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:46:14 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-b6227009-e9ed-45cc-8447-0282a8dc8cd0 tempest-VolumesTestJSON-215539168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-213355569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5b69d88-622a-47a8-a888-41dc7cf07f3d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7df4e762d189494fa496ee895564f317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:46:05Z,use_quota=True,user_id='70f1fe70434c4ad0b3af862add407c68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:46:14 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-b6227009-e9ed-45cc-8447-0282a8dc8cd0 tempest-VolumesTestJSON-215539168 None] Creating volume a5b69d88-622a-47a8-a888-41dc7cf07f3d {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:46:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b6227009-e9ed-45cc-8447-0282a8dc8cd0 tempest-VolumesTestJSON-215539168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:46:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b6227009-e9ed-45cc-8447-0282a8dc8cd0 tempest-VolumesTestJSON-215539168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:46:14 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-b6227009-e9ed-45cc-8447-0282a8dc8cd0 tempest-VolumesTestJSON-215539168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:46:14 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-b6227009-e9ed-45cc-8447-0282a8dc8cd0 tempest-VolumesTestJSON-215539168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:46:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b6227009-e9ed-45cc-8447-0282a8dc8cd0 tempest-VolumesTestJSON-215539168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:46:14 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-b6227009-e9ed-45cc-8447-0282a8dc8cd0 tempest-VolumesTestJSON-215539168 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:46:14 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-b6227009-e9ed-45cc-8447-0282a8dc8cd0 tempest-VolumesTestJSON-215539168 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:46:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b6227009-e9ed-45cc-8447-0282a8dc8cd0 tempest-VolumesTestJSON-215539168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a5b69d88-622a-47a8-a888-41dc7cf07f3d 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:14 devstack sudo[96260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a5b69d88-622a-47a8-a888-41dc7cf07f3d 1073741824 Jul 31 10:46:14 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-218f2411-2e53-42c9-9dfc-2c6e2115949b tempest-VolumesActionsTest-1848272351 None] Copy volume to image completed successfully. Jul 31 10:46:14 devstack sudo[96260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:15 devstack sudo[96260]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b6227009-e9ed-45cc-8447-0282a8dc8cd0 tempest-VolumesTestJSON-215539168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a5b69d88-622a-47a8-a888-41dc7cf07f3d 1073741824" returned: 0 in 1.033s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b6227009-e9ed-45cc-8447-0282a8dc8cd0 tempest-VolumesTestJSON-215539168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a5b69d88-622a-47a8-a888-41dc7cf07f3d {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:15 devstack sudo[96310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a5b69d88-622a-47a8-a888-41dc7cf07f3d Jul 31 10:46:15 devstack sudo[96310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:15 devstack sudo[96310]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b6227009-e9ed-45cc-8447-0282a8dc8cd0 tempest-VolumesTestJSON-215539168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a5b69d88-622a-47a8-a888-41dc7cf07f3d" returned: 0 in 0.565s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:15 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-b6227009-e9ed-45cc-8447-0282a8dc8cd0 tempest-VolumesTestJSON-215539168 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:46:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b6227009-e9ed-45cc-8447-0282a8dc8cd0 tempest-VolumesTestJSON-215539168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:46:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7e628783-302d-4c0c-bf2b-6f3e6d4c2656 tempest-SnapshotMetadataTestJSON-1577768266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.607s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:46:15 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-7e628783-302d-4c0c-bf2b-6f3e6d4c2656 tempest-SnapshotMetadataTestJSON-1577768266 None] Creating offline snapshot 1806aed6-525e-470d-89e2-05479fe6f1b9 of volume 314e6a53-c637-4969-aec9-b016780a9439 {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:46:15 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b6227009-e9ed-45cc-8447-0282a8dc8cd0 tempest-VolumesTestJSON-215539168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76a285c3-3a71-4594-abb9-e2fd34a573ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5b69d88-622a-47a8-a888-41dc7cf07f3d', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:15 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b6227009-e9ed-45cc-8447-0282a8dc8cd0 tempest-VolumesTestJSON-215539168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (402a491a-09e2-49ff-adb9-2c73882697a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:15 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[1965574e-babb-44f7-803d-2bb76211ce88]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:46:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7e628783-302d-4c0c-bf2b-6f3e6d4c2656 tempest-SnapshotMetadataTestJSON-1577768266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:16 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-450583bc-45b0-49b9-af3d-593d3491d5ab tempest-VolumesActionsTest-1848272351 None] Acquiring lock "cinder-dd979657-441f-44ff-a3e3-c53502d968a1-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:46:16 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-b6227009-e9ed-45cc-8447-0282a8dc8cd0 tempest-VolumesTestJSON-215539168 None] Volume volume-a5b69d88-622a-47a8-a888-41dc7cf07f3d (a5b69d88-622a-47a8-a888-41dc7cf07f3d): created successfully Jul 31 10:46:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b6227009-e9ed-45cc-8447-0282a8dc8cd0 tempest-VolumesTestJSON-215539168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (402a491a-09e2-49ff-adb9-2c73882697a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b6227009-e9ed-45cc-8447-0282a8dc8cd0 tempest-VolumesTestJSON-215539168 None] Flow 'volume_create_manager' (ceb43609-d940-4862-b249-fe798b4f212a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:46:16 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-b6227009-e9ed-45cc-8447-0282a8dc8cd0 tempest-VolumesTestJSON-215539168 None] Created volume successfully. Jul 31 10:46:16 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-450583bc-45b0-49b9-af3d-593d3491d5ab tempest-VolumesActionsTest-1848272351 None] Lock "cinder-dd979657-441f-44ff-a3e3-c53502d968a1-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:46:16 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-450583bc-45b0-49b9-af3d-593d3491d5ab tempest-VolumesActionsTest-1848272351 None] Acquiring lock "cinder-quobyte-dd979657-441f-44ff-a3e3-c53502d968a1" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:46:16 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-450583bc-45b0-49b9-af3d-593d3491d5ab tempest-VolumesActionsTest-1848272351 None] Lock "cinder-quobyte-dd979657-441f-44ff-a3e3-c53502d968a1" acquired by "delete_volume" :: waited 0.020s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:46:16 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9b2112-8c35-41b1-b424-30a5fdb7fde3]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:46:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-450583bc-45b0-49b9-af3d-593d3491d5ab tempest-VolumesActionsTest-1848272351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-dd979657-441f-44ff-a3e3-c53502d968a1 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:16 devstack sudo[96333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439 Jul 31 10:46:16 devstack sudo[96333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:16 devstack sudo[96345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-dd979657-441f-44ff-a3e3-c53502d968a1 Jul 31 10:46:16 devstack sudo[96345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:16 devstack sudo[96333]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7e628783-302d-4c0c-bf2b-6f3e6d4c2656 tempest-SnapshotMetadataTestJSON-1577768266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439" returned: 0 in 0.546s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7e628783-302d-4c0c-bf2b-6f3e6d4c2656 tempest-SnapshotMetadataTestJSON-1577768266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439.1806aed6-525e-470d-89e2-05479fe6f1b9 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:16 devstack sudo[96359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439.1806aed6-525e-470d-89e2-05479fe6f1b9 1G Jul 31 10:46:16 devstack sudo[96359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:16 devstack sudo[96345]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-450583bc-45b0-49b9-af3d-593d3491d5ab tempest-VolumesActionsTest-1848272351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-dd979657-441f-44ff-a3e3-c53502d968a1" returned: 0 in 0.481s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-450583bc-45b0-49b9-af3d-593d3491d5ab tempest-VolumesActionsTest-1848272351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-dd979657-441f-44ff-a3e3-c53502d968a1 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:16 devstack sudo[96365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-dd979657-441f-44ff-a3e3-c53502d968a1 Jul 31 10:46:16 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:17 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-450583bc-45b0-49b9-af3d-593d3491d5ab tempest-VolumesActionsTest-1848272351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-dd979657-441f-44ff-a3e3-c53502d968a1" returned: 0 in 0.338s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:17 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-450583bc-45b0-49b9-af3d-593d3491d5ab tempest-VolumesActionsTest-1848272351 None] Lock "cinder-quobyte-dd979657-441f-44ff-a3e3-c53502d968a1" released by "delete_volume" :: held 0.869s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:46:17 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-450583bc-45b0-49b9-af3d-593d3491d5ab tempest-VolumesActionsTest-1848272351 None] Created reservations ['b98ca052-af75-40f6-93ec-5aee9cf83702', '90b0a41c-dc0a-4792-ba51-378b0ee902b6', '5035d361-0140-4960-9002-5b142ed72508', '4a8dbb61-4d4e-4f1d-8b11-79f6b65ab736'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:46:17 devstack sudo[96359]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7e628783-302d-4c0c-bf2b-6f3e6d4c2656 tempest-SnapshotMetadataTestJSON-1577768266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439.1806aed6-525e-470d-89e2-05479fe6f1b9 1G" returned: 0 in 0.653s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7e628783-302d-4c0c-bf2b-6f3e6d4c2656 tempest-SnapshotMetadataTestJSON-1577768266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-314e6a53-c637-4969-aec9-b016780a9439 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439.1806aed6-525e-470d-89e2-05479fe6f1b9 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:17 devstack sudo[96373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-314e6a53-c637-4969-aec9-b016780a9439 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439.1806aed6-525e-470d-89e2-05479fe6f1b9 Jul 31 10:46:17 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-450583bc-45b0-49b9-af3d-593d3491d5ab tempest-VolumesActionsTest-1848272351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:46:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-450583bc-45b0-49b9-af3d-593d3491d5ab tempest-VolumesActionsTest-1848272351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:46:17 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-450583bc-45b0-49b9-af3d-593d3491d5ab tempest-VolumesActionsTest-1848272351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:46:17 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-450583bc-45b0-49b9-af3d-593d3491d5ab tempest-VolumesActionsTest-1848272351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:46:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-450583bc-45b0-49b9-af3d-593d3491d5ab tempest-VolumesActionsTest-1848272351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:46:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-450583bc-45b0-49b9-af3d-593d3491d5ab tempest-VolumesActionsTest-1848272351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:17 devstack sudo[96375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:46:17 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:17 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-216ca706-6893-4979-95fa-8d83df27302c tempest-VolumesTestJSON-215539168 None] Acquiring lock "cinder-a5b69d88-622a-47a8-a888-41dc7cf07f3d-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:46:17 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-216ca706-6893-4979-95fa-8d83df27302c tempest-VolumesTestJSON-215539168 None] Lock "cinder-a5b69d88-622a-47a8-a888-41dc7cf07f3d-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:46:17 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-450583bc-45b0-49b9-af3d-593d3491d5ab tempest-VolumesActionsTest-1848272351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.552s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:17 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-450583bc-45b0-49b9-af3d-593d3491d5ab tempest-VolumesActionsTest-1848272351 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:46:17 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:17 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-450583bc-45b0-49b9-af3d-593d3491d5ab tempest-VolumesActionsTest-1848272351 None] Deleted volume successfully. Jul 31 10:46:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7e628783-302d-4c0c-bf2b-6f3e6d4c2656 tempest-SnapshotMetadataTestJSON-1577768266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-314e6a53-c637-4969-aec9-b016780a9439 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439.1806aed6-525e-470d-89e2-05479fe6f1b9" returned: 0 in 0.705s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:17 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-7e628783-302d-4c0c-bf2b-6f3e6d4c2656 tempest-SnapshotMetadataTestJSON-1577768266 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439.1806aed6-525e-470d-89e2-05479fe6f1b9 is being set with open permissions: ugo+rw Jul 31 10:46:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7e628783-302d-4c0c-bf2b-6f3e6d4c2656 tempest-SnapshotMetadataTestJSON-1577768266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439.1806aed6-525e-470d-89e2-05479fe6f1b9 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:17 devstack sudo[96384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439.1806aed6-525e-470d-89e2-05479fe6f1b9 Jul 31 10:46:17 devstack sudo[96384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:17 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-216ca706-6893-4979-95fa-8d83df27302c tempest-VolumesTestJSON-215539168 None] Acquiring lock "cinder-quobyte-a5b69d88-622a-47a8-a888-41dc7cf07f3d" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:46:17 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-450583bc-45b0-49b9-af3d-593d3491d5ab tempest-VolumesActionsTest-1848272351 None] Lock "cinder-dd979657-441f-44ff-a3e3-c53502d968a1-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:46:18 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-216ca706-6893-4979-95fa-8d83df27302c tempest-VolumesTestJSON-215539168 None] Lock "cinder-quobyte-a5b69d88-622a-47a8-a888-41dc7cf07f3d" acquired by "delete_volume" :: waited 0.041s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:46:18 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d52b24-fc1f-4316-bfd5-f14327fb0f80]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:46:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-216ca706-6893-4979-95fa-8d83df27302c tempest-VolumesTestJSON-215539168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a5b69d88-622a-47a8-a888-41dc7cf07f3d {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:18 devstack sudo[96386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a5b69d88-622a-47a8-a888-41dc7cf07f3d Jul 31 10:46:18 devstack sudo[96386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:18 devstack sudo[96384]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7e628783-302d-4c0c-bf2b-6f3e6d4c2656 tempest-SnapshotMetadataTestJSON-1577768266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439.1806aed6-525e-470d-89e2-05479fe6f1b9" returned: 0 in 0.450s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7e628783-302d-4c0c-bf2b-6f3e6d4c2656 tempest-SnapshotMetadataTestJSON-1577768266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:18 devstack sudo[96389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439.info Jul 31 10:46:18 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:18 devstack sudo[96386]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-216ca706-6893-4979-95fa-8d83df27302c tempest-VolumesTestJSON-215539168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a5b69d88-622a-47a8-a888-41dc7cf07f3d" returned: 0 in 0.620s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-216ca706-6893-4979-95fa-8d83df27302c tempest-VolumesTestJSON-215539168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a5b69d88-622a-47a8-a888-41dc7cf07f3d {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:18 devstack sudo[96394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a5b69d88-622a-47a8-a888-41dc7cf07f3d Jul 31 10:46:18 devstack sudo[96394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:18 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7e628783-302d-4c0c-bf2b-6f3e6d4c2656 tempest-SnapshotMetadataTestJSON-1577768266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439.info" returned: 0 in 0.458s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:18 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-7e628783-302d-4c0c-bf2b-6f3e6d4c2656 tempest-SnapshotMetadataTestJSON-1577768266 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439.info is being set with open permissions: ugo+rw Jul 31 10:46:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7e628783-302d-4c0c-bf2b-6f3e6d4c2656 tempest-SnapshotMetadataTestJSON-1577768266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:18 devstack sudo[96397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439.info Jul 31 10:46:18 devstack sudo[96397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:19 devstack sudo[96394]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-216ca706-6893-4979-95fa-8d83df27302c tempest-VolumesTestJSON-215539168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a5b69d88-622a-47a8-a888-41dc7cf07f3d" returned: 0 in 0.629s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:19 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-216ca706-6893-4979-95fa-8d83df27302c tempest-VolumesTestJSON-215539168 None] Lock "cinder-quobyte-a5b69d88-622a-47a8-a888-41dc7cf07f3d" released by "delete_volume" :: held 1.359s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:46:19 devstack sudo[96397]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7e628783-302d-4c0c-bf2b-6f3e6d4c2656 tempest-SnapshotMetadataTestJSON-1577768266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439.info" returned: 0 in 0.516s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7e628783-302d-4c0c-bf2b-6f3e6d4c2656 tempest-SnapshotMetadataTestJSON-1577768266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.526s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:46:19 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-7e628783-302d-4c0c-bf2b-6f3e6d4c2656 tempest-SnapshotMetadataTestJSON-1577768266 None] Create snapshot completed successfully Jul 31 10:46:19 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-216ca706-6893-4979-95fa-8d83df27302c tempest-VolumesTestJSON-215539168 None] Created reservations ['3ea0f4d3-038b-4430-a28d-887d65a093b2', '2369cb29-d9be-4e78-9634-84687a8b86d4', '690c41d7-3f82-4f08-b27e-b92f7e74fd06', 'b60f5dc9-e6c2-41ca-ab20-5bb92c9c06f5'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:46:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-216ca706-6893-4979-95fa-8d83df27302c tempest-VolumesTestJSON-215539168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:46:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-216ca706-6893-4979-95fa-8d83df27302c tempest-VolumesTestJSON-215539168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:46:19 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-216ca706-6893-4979-95fa-8d83df27302c tempest-VolumesTestJSON-215539168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:46:19 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-216ca706-6893-4979-95fa-8d83df27302c tempest-VolumesTestJSON-215539168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:46:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-216ca706-6893-4979-95fa-8d83df27302c tempest-VolumesTestJSON-215539168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:46:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-216ca706-6893-4979-95fa-8d83df27302c tempest-VolumesTestJSON-215539168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:19 devstack sudo[96401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:46:19 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:20 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-216ca706-6893-4979-95fa-8d83df27302c tempest-VolumesTestJSON-215539168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.486s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:20 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-216ca706-6893-4979-95fa-8d83df27302c tempest-VolumesTestJSON-215539168 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:46:20 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-216ca706-6893-4979-95fa-8d83df27302c tempest-VolumesTestJSON-215539168 None] Deleted volume successfully. Jul 31 10:46:20 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-216ca706-6893-4979-95fa-8d83df27302c tempest-VolumesTestJSON-215539168 None] Lock "cinder-a5b69d88-622a-47a8-a888-41dc7cf07f3d-delete_volume" released by "delete_volume" :: held 2.413s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:46:20 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-097e4b21-7d9e-4d85-b817-f57b41ad9c92 tempest-VolumesTestJSON-215539168 None] Acquiring lock "cinder-261c7cea-d49b-420f-ae2d-e2ee73ce7408-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:46:20 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-097e4b21-7d9e-4d85-b817-f57b41ad9c92 tempest-VolumesTestJSON-215539168 None] Lock "cinder-261c7cea-d49b-420f-ae2d-e2ee73ce7408-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:46:20 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-097e4b21-7d9e-4d85-b817-f57b41ad9c92 tempest-VolumesTestJSON-215539168 None] Acquiring lock "cinder-quobyte-261c7cea-d49b-420f-ae2d-e2ee73ce7408" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:46:20 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-097e4b21-7d9e-4d85-b817-f57b41ad9c92 tempest-VolumesTestJSON-215539168 None] Lock "cinder-quobyte-261c7cea-d49b-420f-ae2d-e2ee73ce7408" acquired by "delete_volume" :: waited 0.061s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:46:20 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af7176e-842a-41c9-862b-10d0b6882dc1]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:46:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-097e4b21-7d9e-4d85-b817-f57b41ad9c92 tempest-VolumesTestJSON-215539168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-261c7cea-d49b-420f-ae2d-e2ee73ce7408 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:20 devstack sudo[96405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-261c7cea-d49b-420f-ae2d-e2ee73ce7408 Jul 31 10:46:20 devstack sudo[96405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:21 devstack sudo[96405]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-097e4b21-7d9e-4d85-b817-f57b41ad9c92 tempest-VolumesTestJSON-215539168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-261c7cea-d49b-420f-ae2d-e2ee73ce7408" returned: 0 in 0.802s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-097e4b21-7d9e-4d85-b817-f57b41ad9c92 tempest-VolumesTestJSON-215539168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-261c7cea-d49b-420f-ae2d-e2ee73ce7408 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:21 devstack sudo[96410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-261c7cea-d49b-420f-ae2d-e2ee73ce7408 Jul 31 10:46:21 devstack sudo[96410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:21 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-50e85ad5-c813-4dba-8344-3e0ceeae7755 tempest-SnapshotMetadataTestJSON-1577768266 None] Acquiring lock "cinder-1806aed6-525e-470d-89e2-05479fe6f1b9-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:46:21 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-50e85ad5-c813-4dba-8344-3e0ceeae7755 tempest-SnapshotMetadataTestJSON-1577768266 None] Lock "cinder-1806aed6-525e-470d-89e2-05479fe6f1b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:46:21 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-50e85ad5-c813-4dba-8344-3e0ceeae7755 tempest-SnapshotMetadataTestJSON-1577768266 None] Acquiring lock "cinder-quobyte-314e6a53-c637-4969-aec9-b016780a9439" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:46:21 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-50e85ad5-c813-4dba-8344-3e0ceeae7755 tempest-SnapshotMetadataTestJSON-1577768266 None] Lock "cinder-quobyte-314e6a53-c637-4969-aec9-b016780a9439" acquired by "delete_snapshot" :: waited 0.035s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:46:21 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-50e85ad5-c813-4dba-8344-3e0ceeae7755 tempest-SnapshotMetadataTestJSON-1577768266 None] Acquiring lock "cinder-quobyte-1806aed6-525e-470d-89e2-05479fe6f1b9" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:46:21 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-50e85ad5-c813-4dba-8344-3e0ceeae7755 tempest-SnapshotMetadataTestJSON-1577768266 None] Lock "cinder-quobyte-1806aed6-525e-470d-89e2-05479fe6f1b9" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:46:21 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-50e85ad5-c813-4dba-8344-3e0ceeae7755 tempest-SnapshotMetadataTestJSON-1577768266 None] Deleting offline snapshot 1806aed6-525e-470d-89e2-05479fe6f1b9 of volume 314e6a53-c637-4969-aec9-b016780a9439 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:46:21 devstack sudo[96410]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:21 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-50e85ad5-c813-4dba-8344-3e0ceeae7755 tempest-SnapshotMetadataTestJSON-1577768266 None] snapshot_file for this snap is: volume-314e6a53-c637-4969-aec9-b016780a9439.1806aed6-525e-470d-89e2-05479fe6f1b9 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:46:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-097e4b21-7d9e-4d85-b817-f57b41ad9c92 tempest-VolumesTestJSON-215539168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-261c7cea-d49b-420f-ae2d-e2ee73ce7408" returned: 0 in 0.575s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:22 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8bf741-1972-4091-8c62-75e5b581a715]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:46:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-50e85ad5-c813-4dba-8344-3e0ceeae7755 tempest-SnapshotMetadataTestJSON-1577768266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439.1806aed6-525e-470d-89e2-05479fe6f1b9 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:22 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-097e4b21-7d9e-4d85-b817-f57b41ad9c92 tempest-VolumesTestJSON-215539168 None] Lock "cinder-quobyte-261c7cea-d49b-420f-ae2d-e2ee73ce7408" released by "delete_volume" :: held 1.502s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:46:22 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-097e4b21-7d9e-4d85-b817-f57b41ad9c92 tempest-VolumesTestJSON-215539168 None] Created reservations ['bf561207-3c5a-4e44-825e-8b116cddcff4', '024ea828-1b55-4f7f-a85e-aa6ed3b46867', 'd4c12b3c-687e-4a21-acca-b657f0054198', '8fc62da7-cb09-4475-bee9-a48621e85085'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:46:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-097e4b21-7d9e-4d85-b817-f57b41ad9c92 tempest-VolumesTestJSON-215539168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:46:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-097e4b21-7d9e-4d85-b817-f57b41ad9c92 tempest-VolumesTestJSON-215539168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:46:22 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-097e4b21-7d9e-4d85-b817-f57b41ad9c92 tempest-VolumesTestJSON-215539168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:46:22 devstack sudo[96415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439.1806aed6-525e-470d-89e2-05479fe6f1b9 Jul 31 10:46:22 devstack sudo[96415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:22 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-097e4b21-7d9e-4d85-b817-f57b41ad9c92 tempest-VolumesTestJSON-215539168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:46:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-097e4b21-7d9e-4d85-b817-f57b41ad9c92 tempest-VolumesTestJSON-215539168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:46:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-097e4b21-7d9e-4d85-b817-f57b41ad9c92 tempest-VolumesTestJSON-215539168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:22 devstack sudo[96418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:46:22 devstack sudo[96418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:22 devstack sudo[96418]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-097e4b21-7d9e-4d85-b817-f57b41ad9c92 tempest-VolumesTestJSON-215539168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.365s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:22 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-097e4b21-7d9e-4d85-b817-f57b41ad9c92 tempest-VolumesTestJSON-215539168 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:46:22 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-097e4b21-7d9e-4d85-b817-f57b41ad9c92 tempest-VolumesTestJSON-215539168 None] Deleted volume successfully. Jul 31 10:46:22 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-097e4b21-7d9e-4d85-b817-f57b41ad9c92 tempest-VolumesTestJSON-215539168 None] Lock "cinder-261c7cea-d49b-420f-ae2d-e2ee73ce7408-delete_volume" released by "delete_volume" :: held 2.338s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:46:22 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1c80304b-3d3e-4823-a182-4768ce815eba tempest-VolumesTestJSON-215539168 None] Acquiring lock "cinder-5bc711be-ac10-47c5-839e-8914bd8ce166-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:46:22 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1c80304b-3d3e-4823-a182-4768ce815eba tempest-VolumesTestJSON-215539168 None] Lock "cinder-5bc711be-ac10-47c5-839e-8914bd8ce166-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:46:22 devstack sudo[96415]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-50e85ad5-c813-4dba-8344-3e0ceeae7755 tempest-SnapshotMetadataTestJSON-1577768266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439.1806aed6-525e-470d-89e2-05479fe6f1b9" returned: 0 in 0.832s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:22 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-50e85ad5-c813-4dba-8344-3e0ceeae7755 tempest-SnapshotMetadataTestJSON-1577768266 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-314e6a53-c637-4969-aec9-b016780a9439(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:46:22 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ec2e1f-c072-4b3c-a44a-4ccaa1dbdafc]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:46:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-50e85ad5-c813-4dba-8344-3e0ceeae7755 tempest-SnapshotMetadataTestJSON-1577768266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:22 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1c80304b-3d3e-4823-a182-4768ce815eba tempest-VolumesTestJSON-215539168 None] Acquiring lock "cinder-quobyte-5bc711be-ac10-47c5-839e-8914bd8ce166" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:46:22 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1c80304b-3d3e-4823-a182-4768ce815eba tempest-VolumesTestJSON-215539168 None] Lock "cinder-quobyte-5bc711be-ac10-47c5-839e-8914bd8ce166" acquired by "delete_volume" :: waited 0.021s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:46:22 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[399da0e1-778f-4498-9d36-4f1af3aa3048]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:46:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1c80304b-3d3e-4823-a182-4768ce815eba tempest-VolumesTestJSON-215539168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5bc711be-ac10-47c5-839e-8914bd8ce166 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:23 devstack sudo[96424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439 Jul 31 10:46:23 devstack sudo[96424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:23 devstack sudo[96425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5bc711be-ac10-47c5-839e-8914bd8ce166 Jul 31 10:46:23 devstack sudo[96425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:23 devstack sudo[96424]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-50e85ad5-c813-4dba-8344-3e0ceeae7755 tempest-SnapshotMetadataTestJSON-1577768266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439" returned: 0 in 0.603s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-50e85ad5-c813-4dba-8344-3e0ceeae7755 tempest-SnapshotMetadataTestJSON-1577768266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439.1806aed6-525e-470d-89e2-05479fe6f1b9 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:23 devstack sudo[96433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439.1806aed6-525e-470d-89e2-05479fe6f1b9 Jul 31 10:46:23 devstack sudo[96433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:23 devstack sudo[96425]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1c80304b-3d3e-4823-a182-4768ce815eba tempest-VolumesTestJSON-215539168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5bc711be-ac10-47c5-839e-8914bd8ce166" returned: 0 in 0.614s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1c80304b-3d3e-4823-a182-4768ce815eba tempest-VolumesTestJSON-215539168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5bc711be-ac10-47c5-839e-8914bd8ce166 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:23 devstack sudo[96436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5bc711be-ac10-47c5-839e-8914bd8ce166 Jul 31 10:46:23 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:23 devstack sudo[96433]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-50e85ad5-c813-4dba-8344-3e0ceeae7755 tempest-SnapshotMetadataTestJSON-1577768266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439.1806aed6-525e-470d-89e2-05479fe6f1b9" returned: 0 in 0.510s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-50e85ad5-c813-4dba-8344-3e0ceeae7755 tempest-SnapshotMetadataTestJSON-1577768266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439.1806aed6-525e-470d-89e2-05479fe6f1b9 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:24 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1c80304b-3d3e-4823-a182-4768ce815eba tempest-VolumesTestJSON-215539168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5bc711be-ac10-47c5-839e-8914bd8ce166" returned: 0 in 0.449s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:24 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1c80304b-3d3e-4823-a182-4768ce815eba tempest-VolumesTestJSON-215539168 None] Lock "cinder-quobyte-5bc711be-ac10-47c5-839e-8914bd8ce166" released by "delete_volume" :: held 1.156s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:46:24 devstack sudo[96443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439.1806aed6-525e-470d-89e2-05479fe6f1b9 Jul 31 10:46:24 devstack sudo[96443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:24 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-1c80304b-3d3e-4823-a182-4768ce815eba tempest-VolumesTestJSON-215539168 None] Created reservations ['4ef90b24-1e16-4c91-a56f-d6c58af27946', '8a977556-160b-4faa-b96c-68066f6b1f27', 'fc76a385-4b27-4a41-bd93-d188b04bfe7a', '8ee1ebe9-c6fa-4eab-963d-ef6b85c73637'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:46:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-1c80304b-3d3e-4823-a182-4768ce815eba tempest-VolumesTestJSON-215539168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:46:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-1c80304b-3d3e-4823-a182-4768ce815eba tempest-VolumesTestJSON-215539168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:46:24 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-1c80304b-3d3e-4823-a182-4768ce815eba tempest-VolumesTestJSON-215539168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:46:24 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-1c80304b-3d3e-4823-a182-4768ce815eba tempest-VolumesTestJSON-215539168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:46:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-1c80304b-3d3e-4823-a182-4768ce815eba tempest-VolumesTestJSON-215539168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:46:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1c80304b-3d3e-4823-a182-4768ce815eba tempest-VolumesTestJSON-215539168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:24 devstack sudo[96445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:46:24 devstack sudo[96445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:24 devstack sudo[96443]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-50e85ad5-c813-4dba-8344-3e0ceeae7755 tempest-SnapshotMetadataTestJSON-1577768266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439.1806aed6-525e-470d-89e2-05479fe6f1b9" returned: 0 in 0.403s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:24 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-50e85ad5-c813-4dba-8344-3e0ceeae7755 tempest-SnapshotMetadataTestJSON-1577768266 None] Lock "cinder-quobyte-1806aed6-525e-470d-89e2-05479fe6f1b9" released by "_delete_snapshot" :: held 2.529s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:46:24 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-50e85ad5-c813-4dba-8344-3e0ceeae7755 tempest-SnapshotMetadataTestJSON-1577768266 None] Lock "cinder-quobyte-314e6a53-c637-4969-aec9-b016780a9439" released by "delete_snapshot" :: held 2.589s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:46:24 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-50e85ad5-c813-4dba-8344-3e0ceeae7755 tempest-SnapshotMetadataTestJSON-1577768266 None] Created reservations ['6b1a7cc9-7347-44d2-897c-0c027d12be02', '9b8a8e4b-46fd-4dfb-8036-dbcd5042ec00', '6a721b68-2d32-4dce-ac68-502e6789b097', '95728cbb-2914-4697-941b-1f144786a2d5'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:46:24 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-50e85ad5-c813-4dba-8344-3e0ceeae7755 tempest-SnapshotMetadataTestJSON-1577768266 None] Delete snapshot completed successfully. Jul 31 10:46:24 devstack sudo[96445]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1c80304b-3d3e-4823-a182-4768ce815eba tempest-VolumesTestJSON-215539168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.417s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:24 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-1c80304b-3d3e-4823-a182-4768ce815eba tempest-VolumesTestJSON-215539168 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:46:24 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-50e85ad5-c813-4dba-8344-3e0ceeae7755 tempest-SnapshotMetadataTestJSON-1577768266 None] Lock "cinder-1806aed6-525e-470d-89e2-05479fe6f1b9-delete_snapshot" released by "delete_snapshot" :: held 2.890s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:46:24 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-1c80304b-3d3e-4823-a182-4768ce815eba tempest-VolumesTestJSON-215539168 None] Deleted volume successfully. Jul 31 10:46:24 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1c80304b-3d3e-4823-a182-4768ce815eba tempest-VolumesTestJSON-215539168 None] Lock "cinder-5bc711be-ac10-47c5-839e-8914bd8ce166-delete_volume" released by "delete_volume" :: held 1.960s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:46:25 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f566cd49-561b-452b-9067-fd4c93beda8b tempest-SnapshotMetadataTestJSON-1577768266 None] Acquiring lock "cinder-314e6a53-c637-4969-aec9-b016780a9439-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:46:25 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f566cd49-561b-452b-9067-fd4c93beda8b tempest-SnapshotMetadataTestJSON-1577768266 None] Lock "cinder-314e6a53-c637-4969-aec9-b016780a9439-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:46:25 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f566cd49-561b-452b-9067-fd4c93beda8b tempest-SnapshotMetadataTestJSON-1577768266 None] Acquiring lock "cinder-quobyte-314e6a53-c637-4969-aec9-b016780a9439" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:46:25 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f566cd49-561b-452b-9067-fd4c93beda8b tempest-SnapshotMetadataTestJSON-1577768266 None] Lock "cinder-quobyte-314e6a53-c637-4969-aec9-b016780a9439" acquired by "delete_volume" :: waited 0.017s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:46:25 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e8b6d0-2013-434b-9f53-6eb19c4ba16e]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:46:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f566cd49-561b-452b-9067-fd4c93beda8b tempest-SnapshotMetadataTestJSON-1577768266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:25 devstack sudo[96451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439 Jul 31 10:46:25 devstack sudo[96451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:26 devstack sudo[96451]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f566cd49-561b-452b-9067-fd4c93beda8b tempest-SnapshotMetadataTestJSON-1577768266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439" returned: 0 in 0.699s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f566cd49-561b-452b-9067-fd4c93beda8b tempest-SnapshotMetadataTestJSON-1577768266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:26 devstack sudo[96456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439 Jul 31 10:46:26 devstack sudo[96456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:26 devstack sudo[96456]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f566cd49-561b-452b-9067-fd4c93beda8b tempest-SnapshotMetadataTestJSON-1577768266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-314e6a53-c637-4969-aec9-b016780a9439" returned: 0 in 0.395s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:26 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f566cd49-561b-452b-9067-fd4c93beda8b tempest-SnapshotMetadataTestJSON-1577768266 None] Lock "cinder-quobyte-314e6a53-c637-4969-aec9-b016780a9439" released by "delete_volume" :: held 1.203s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:46:26 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-f566cd49-561b-452b-9067-fd4c93beda8b tempest-SnapshotMetadataTestJSON-1577768266 None] Created reservations ['51ed48ab-8346-4d8c-9c7f-eb7605ce8eb1', 'ca8cedab-487e-444d-8fde-c887495a74f4', '76190452-7a16-4e02-a7ad-9bb1ddc70b3e', 'a9e4aa6e-9dca-41a0-ace3-ba441305723b'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:46:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f566cd49-561b-452b-9067-fd4c93beda8b tempest-SnapshotMetadataTestJSON-1577768266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:46:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f566cd49-561b-452b-9067-fd4c93beda8b tempest-SnapshotMetadataTestJSON-1577768266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:46:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f566cd49-561b-452b-9067-fd4c93beda8b tempest-SnapshotMetadataTestJSON-1577768266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:46:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f566cd49-561b-452b-9067-fd4c93beda8b tempest-SnapshotMetadataTestJSON-1577768266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:46:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f566cd49-561b-452b-9067-fd4c93beda8b tempest-SnapshotMetadataTestJSON-1577768266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:46:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f566cd49-561b-452b-9067-fd4c93beda8b tempest-SnapshotMetadataTestJSON-1577768266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:26 devstack sudo[96459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:46:26 devstack sudo[96459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:27 devstack sudo[96459]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f566cd49-561b-452b-9067-fd4c93beda8b tempest-SnapshotMetadataTestJSON-1577768266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.425s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:27 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-f566cd49-561b-452b-9067-fd4c93beda8b tempest-SnapshotMetadataTestJSON-1577768266 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:46:27 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-f566cd49-561b-452b-9067-fd4c93beda8b tempest-SnapshotMetadataTestJSON-1577768266 None] Deleted volume successfully. Jul 31 10:46:27 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f566cd49-561b-452b-9067-fd4c93beda8b tempest-SnapshotMetadataTestJSON-1577768266 None] Lock "cinder-314e6a53-c637-4969-aec9-b016780a9439-delete_volume" released by "delete_volume" :: held 2.035s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:46:29 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-0251ce6e-f7a9-4a48-b0d9-7e8b5012c47e tempest-VolumesListTestJSON-1195331447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:46:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0251ce6e-f7a9-4a48-b0d9-7e8b5012c47e tempest-VolumesListTestJSON-1195331447 None] Flow 'volume_create_manager' (e6a8f28d-d17a-414a-9952-8e0c6abb7e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:46:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0251ce6e-f7a9-4a48-b0d9-7e8b5012c47e tempest-VolumesListTestJSON-1195331447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bd17ecf-1376-481e-8bf4-b40264ec9154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0251ce6e-f7a9-4a48-b0d9-7e8b5012c47e tempest-VolumesListTestJSON-1195331447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bd17ecf-1376-481e-8bf4-b40264ec9154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1704226756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28e2ccde-0217-4487-bc3f-3faa7e9a4f14,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='718a4e38f52c43108191d325ecff6a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:46:29Z,use_quota=True,user_id='7d819f1963fe49808e5f2d364f9a8c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0251ce6e-f7a9-4a48-b0d9-7e8b5012c47e tempest-VolumesListTestJSON-1195331447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a74339aa-ba44-457f-9dc2-c3f2873b1192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0251ce6e-f7a9-4a48-b0d9-7e8b5012c47e tempest-VolumesListTestJSON-1195331447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a74339aa-ba44-457f-9dc2-c3f2873b1192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0251ce6e-f7a9-4a48-b0d9-7e8b5012c47e tempest-VolumesListTestJSON-1195331447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84a90c91-1e4b-443f-9036-976adfad10c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0251ce6e-f7a9-4a48-b0d9-7e8b5012c47e tempest-VolumesListTestJSON-1195331447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84a90c91-1e4b-443f-9036-976adfad10c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28e2ccde-0217-4487-bc3f-3faa7e9a4f14', 'volume_name': 'volume-28e2ccde-0217-4487-bc3f-3faa7e9a4f14', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0251ce6e-f7a9-4a48-b0d9-7e8b5012c47e tempest-VolumesListTestJSON-1195331447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e00a34d-9bc2-41ea-a76a-6ea8419453da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0251ce6e-f7a9-4a48-b0d9-7e8b5012c47e tempest-VolumesListTestJSON-1195331447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e00a34d-9bc2-41ea-a76a-6ea8419453da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0251ce6e-f7a9-4a48-b0d9-7e8b5012c47e tempest-VolumesListTestJSON-1195331447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce6f1b75-74be-45cf-aac1-be731f6a0172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:29 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-0251ce6e-f7a9-4a48-b0d9-7e8b5012c47e tempest-VolumesListTestJSON-1195331447 None] Volume 28e2ccde-0217-4487-bc3f-3faa7e9a4f14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28e2ccde-0217-4487-bc3f-3faa7e9a4f14', 'volume_size': 1} Jul 31 10:46:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0251ce6e-f7a9-4a48-b0d9-7e8b5012c47e tempest-VolumesListTestJSON-1195331447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:46:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0251ce6e-f7a9-4a48-b0d9-7e8b5012c47e tempest-VolumesListTestJSON-1195331447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:46:29 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0251ce6e-f7a9-4a48-b0d9-7e8b5012c47e tempest-VolumesListTestJSON-1195331447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1704226756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28e2ccde-0217-4487-bc3f-3faa7e9a4f14,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='718a4e38f52c43108191d325ecff6a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:46:29Z,use_quota=True,user_id='7d819f1963fe49808e5f2d364f9a8c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:46:29 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-0251ce6e-f7a9-4a48-b0d9-7e8b5012c47e tempest-VolumesListTestJSON-1195331447 None] Creating volume 28e2ccde-0217-4487-bc3f-3faa7e9a4f14 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:46:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0251ce6e-f7a9-4a48-b0d9-7e8b5012c47e tempest-VolumesListTestJSON-1195331447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:46:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0251ce6e-f7a9-4a48-b0d9-7e8b5012c47e tempest-VolumesListTestJSON-1195331447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:46:29 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0251ce6e-f7a9-4a48-b0d9-7e8b5012c47e tempest-VolumesListTestJSON-1195331447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:46:29 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0251ce6e-f7a9-4a48-b0d9-7e8b5012c47e tempest-VolumesListTestJSON-1195331447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:46:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0251ce6e-f7a9-4a48-b0d9-7e8b5012c47e tempest-VolumesListTestJSON-1195331447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:46:29 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0251ce6e-f7a9-4a48-b0d9-7e8b5012c47e tempest-VolumesListTestJSON-1195331447 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:46:29 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-0251ce6e-f7a9-4a48-b0d9-7e8b5012c47e tempest-VolumesListTestJSON-1195331447 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:46:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0251ce6e-f7a9-4a48-b0d9-7e8b5012c47e tempest-VolumesListTestJSON-1195331447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-28e2ccde-0217-4487-bc3f-3faa7e9a4f14 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:29 devstack sudo[96463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-28e2ccde-0217-4487-bc3f-3faa7e9a4f14 1073741824 Jul 31 10:46:29 devstack sudo[96463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:29 devstack sudo[96463]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0251ce6e-f7a9-4a48-b0d9-7e8b5012c47e tempest-VolumesListTestJSON-1195331447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-28e2ccde-0217-4487-bc3f-3faa7e9a4f14 1073741824" returned: 0 in 0.741s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0251ce6e-f7a9-4a48-b0d9-7e8b5012c47e tempest-VolumesListTestJSON-1195331447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-28e2ccde-0217-4487-bc3f-3faa7e9a4f14 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:29 devstack sudo[96469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-28e2ccde-0217-4487-bc3f-3faa7e9a4f14 Jul 31 10:46:29 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:30 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0251ce6e-f7a9-4a48-b0d9-7e8b5012c47e tempest-VolumesListTestJSON-1195331447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-28e2ccde-0217-4487-bc3f-3faa7e9a4f14" returned: 0 in 0.475s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:30 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0251ce6e-f7a9-4a48-b0d9-7e8b5012c47e tempest-VolumesListTestJSON-1195331447 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:46:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0251ce6e-f7a9-4a48-b0d9-7e8b5012c47e tempest-VolumesListTestJSON-1195331447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:46:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0251ce6e-f7a9-4a48-b0d9-7e8b5012c47e tempest-VolumesListTestJSON-1195331447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce6f1b75-74be-45cf-aac1-be731f6a0172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28e2ccde-0217-4487-bc3f-3faa7e9a4f14', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0251ce6e-f7a9-4a48-b0d9-7e8b5012c47e tempest-VolumesListTestJSON-1195331447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05664c7a-8184-4948-ab63-8a752c39e9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:30 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-0251ce6e-f7a9-4a48-b0d9-7e8b5012c47e tempest-VolumesListTestJSON-1195331447 None] Volume volume-28e2ccde-0217-4487-bc3f-3faa7e9a4f14 (28e2ccde-0217-4487-bc3f-3faa7e9a4f14): created successfully Jul 31 10:46:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0251ce6e-f7a9-4a48-b0d9-7e8b5012c47e tempest-VolumesListTestJSON-1195331447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05664c7a-8184-4948-ab63-8a752c39e9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0251ce6e-f7a9-4a48-b0d9-7e8b5012c47e tempest-VolumesListTestJSON-1195331447 None] Flow 'volume_create_manager' (e6a8f28d-d17a-414a-9952-8e0c6abb7e9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:46:30 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-0251ce6e-f7a9-4a48-b0d9-7e8b5012c47e tempest-VolumesListTestJSON-1195331447 None] Created volume successfully. Jul 31 10:46:31 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7ada3fb-7bec-4522-bb5a-9adc55b5e4a5 tempest-VolumesListTestJSON-1195331447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:46:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f7ada3fb-7bec-4522-bb5a-9adc55b5e4a5 tempest-VolumesListTestJSON-1195331447 None] Flow 'volume_create_manager' (9cad46d2-13f8-4bc7-ab7b-56ecccb02f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:46:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f7ada3fb-7bec-4522-bb5a-9adc55b5e4a5 tempest-VolumesListTestJSON-1195331447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a414a35-1afa-4061-9e7d-26ad0f00d079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f7ada3fb-7bec-4522-bb5a-9adc55b5e4a5 tempest-VolumesListTestJSON-1195331447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a414a35-1afa-4061-9e7d-26ad0f00d079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-148619763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1416edc2-3bbe-425f-a05e-67986243423e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='718a4e38f52c43108191d325ecff6a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:46:32Z,use_quota=True,user_id='7d819f1963fe49808e5f2d364f9a8c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f7ada3fb-7bec-4522-bb5a-9adc55b5e4a5 tempest-VolumesListTestJSON-1195331447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59640683-e0c9-4831-aea4-429a2ee1f46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f7ada3fb-7bec-4522-bb5a-9adc55b5e4a5 tempest-VolumesListTestJSON-1195331447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59640683-e0c9-4831-aea4-429a2ee1f46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f7ada3fb-7bec-4522-bb5a-9adc55b5e4a5 tempest-VolumesListTestJSON-1195331447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26ccd835-8472-4e01-b633-b958f2b8a59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f7ada3fb-7bec-4522-bb5a-9adc55b5e4a5 tempest-VolumesListTestJSON-1195331447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26ccd835-8472-4e01-b633-b958f2b8a59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1416edc2-3bbe-425f-a05e-67986243423e', 'volume_name': 'volume-1416edc2-3bbe-425f-a05e-67986243423e', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f7ada3fb-7bec-4522-bb5a-9adc55b5e4a5 tempest-VolumesListTestJSON-1195331447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee40627-aa77-48da-8b0c-5d56f13b31e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f7ada3fb-7bec-4522-bb5a-9adc55b5e4a5 tempest-VolumesListTestJSON-1195331447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee40627-aa77-48da-8b0c-5d56f13b31e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f7ada3fb-7bec-4522-bb5a-9adc55b5e4a5 tempest-VolumesListTestJSON-1195331447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea2d1318-18bb-4d2a-9083-d16cc6479102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:31 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-f7ada3fb-7bec-4522-bb5a-9adc55b5e4a5 tempest-VolumesListTestJSON-1195331447 None] Volume 1416edc2-3bbe-425f-a05e-67986243423e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1416edc2-3bbe-425f-a05e-67986243423e', 'volume_size': 1} Jul 31 10:46:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f7ada3fb-7bec-4522-bb5a-9adc55b5e4a5 tempest-VolumesListTestJSON-1195331447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:46:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f7ada3fb-7bec-4522-bb5a-9adc55b5e4a5 tempest-VolumesListTestJSON-1195331447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:46:31 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f7ada3fb-7bec-4522-bb5a-9adc55b5e4a5 tempest-VolumesListTestJSON-1195331447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-148619763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1416edc2-3bbe-425f-a05e-67986243423e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='718a4e38f52c43108191d325ecff6a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:46:32Z,use_quota=True,user_id='7d819f1963fe49808e5f2d364f9a8c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:46:31 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-f7ada3fb-7bec-4522-bb5a-9adc55b5e4a5 tempest-VolumesListTestJSON-1195331447 None] Creating volume 1416edc2-3bbe-425f-a05e-67986243423e {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:46:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f7ada3fb-7bec-4522-bb5a-9adc55b5e4a5 tempest-VolumesListTestJSON-1195331447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:46:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f7ada3fb-7bec-4522-bb5a-9adc55b5e4a5 tempest-VolumesListTestJSON-1195331447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:46:31 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f7ada3fb-7bec-4522-bb5a-9adc55b5e4a5 tempest-VolumesListTestJSON-1195331447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:46:31 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f7ada3fb-7bec-4522-bb5a-9adc55b5e4a5 tempest-VolumesListTestJSON-1195331447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:46:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f7ada3fb-7bec-4522-bb5a-9adc55b5e4a5 tempest-VolumesListTestJSON-1195331447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:46:31 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f7ada3fb-7bec-4522-bb5a-9adc55b5e4a5 tempest-VolumesListTestJSON-1195331447 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:46:31 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-f7ada3fb-7bec-4522-bb5a-9adc55b5e4a5 tempest-VolumesListTestJSON-1195331447 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:46:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f7ada3fb-7bec-4522-bb5a-9adc55b5e4a5 tempest-VolumesListTestJSON-1195331447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1416edc2-3bbe-425f-a05e-67986243423e 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6c6a72fc-005c-44a3-890f-91d57042d69d tempest-BackendsCapabilitiesAdminTestsJSON-772042690 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.752670288086, 'free_capacity_gb': 1775.752670288086, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89090) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 31 10:46:31 devstack sudo[96492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1416edc2-3bbe-425f-a05e-67986243423e 1073741824 Jul 31 10:46:31 devstack sudo[96492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b1d421ab-e479-4ec8-bc77-e4572d43e54e tempest-BackendsCapabilitiesAdminTestsJSON-772042690 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.752670288086, 'free_capacity_gb': 1775.752670288086, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89090) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 31 10:46:32 devstack sudo[96492]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f7ada3fb-7bec-4522-bb5a-9adc55b5e4a5 tempest-VolumesListTestJSON-1195331447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1416edc2-3bbe-425f-a05e-67986243423e 1073741824" returned: 0 in 0.587s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f7ada3fb-7bec-4522-bb5a-9adc55b5e4a5 tempest-VolumesListTestJSON-1195331447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1416edc2-3bbe-425f-a05e-67986243423e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:32 devstack sudo[96498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1416edc2-3bbe-425f-a05e-67986243423e Jul 31 10:46:32 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:32 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f7ada3fb-7bec-4522-bb5a-9adc55b5e4a5 tempest-VolumesListTestJSON-1195331447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1416edc2-3bbe-425f-a05e-67986243423e" returned: 0 in 0.331s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:32 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f7ada3fb-7bec-4522-bb5a-9adc55b5e4a5 tempest-VolumesListTestJSON-1195331447 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:46:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f7ada3fb-7bec-4522-bb5a-9adc55b5e4a5 tempest-VolumesListTestJSON-1195331447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:46:32 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f7ada3fb-7bec-4522-bb5a-9adc55b5e4a5 tempest-VolumesListTestJSON-1195331447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea2d1318-18bb-4d2a-9083-d16cc6479102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1416edc2-3bbe-425f-a05e-67986243423e', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:32 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f7ada3fb-7bec-4522-bb5a-9adc55b5e4a5 tempest-VolumesListTestJSON-1195331447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (168efc8a-4b76-4d6e-98fa-fffd2dc0df83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:32 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-f7ada3fb-7bec-4522-bb5a-9adc55b5e4a5 tempest-VolumesListTestJSON-1195331447 None] Volume volume-1416edc2-3bbe-425f-a05e-67986243423e (1416edc2-3bbe-425f-a05e-67986243423e): created successfully Jul 31 10:46:32 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f7ada3fb-7bec-4522-bb5a-9adc55b5e4a5 tempest-VolumesListTestJSON-1195331447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (168efc8a-4b76-4d6e-98fa-fffd2dc0df83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:32 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f7ada3fb-7bec-4522-bb5a-9adc55b5e4a5 tempest-VolumesListTestJSON-1195331447 None] Flow 'volume_create_manager' (9cad46d2-13f8-4bc7-ab7b-56ecccb02f8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:46:32 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-f7ada3fb-7bec-4522-bb5a-9adc55b5e4a5 tempest-VolumesListTestJSON-1195331447 None] Created volume successfully. Jul 31 10:46:34 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-182fe0fc-a9c0-467c-b1d2-c55fe1013611 tempest-AbsoluteLimitsTests-1230774549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:46:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-182fe0fc-a9c0-467c-b1d2-c55fe1013611 tempest-AbsoluteLimitsTests-1230774549 None] Flow 'volume_create_manager' (0987cfc8-ccc5-4a50-b341-b61c09e36ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:46:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-182fe0fc-a9c0-467c-b1d2-c55fe1013611 tempest-AbsoluteLimitsTests-1230774549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96cd48dc-97ea-4bd5-b45a-4cc7db6f1aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-182fe0fc-a9c0-467c-b1d2-c55fe1013611 tempest-AbsoluteLimitsTests-1230774549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96cd48dc-97ea-4bd5-b45a-4cc7db6f1aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1451868144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=503f6b8e-b478-478e-ac1b-c72fa87bd89c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f0ef3786824e86821cc535ca4bfddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:46:34Z,use_quota=True,user_id='6d4c1c2f6a1e46dabff4a9266210d127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-182fe0fc-a9c0-467c-b1d2-c55fe1013611 tempest-AbsoluteLimitsTests-1230774549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2eb1b0d-41a4-4a2a-bbea-fb4a4ffbd300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-182fe0fc-a9c0-467c-b1d2-c55fe1013611 tempest-AbsoluteLimitsTests-1230774549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2eb1b0d-41a4-4a2a-bbea-fb4a4ffbd300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-182fe0fc-a9c0-467c-b1d2-c55fe1013611 tempest-AbsoluteLimitsTests-1230774549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffe41e88-6315-4b90-8798-5eb319be2651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-182fe0fc-a9c0-467c-b1d2-c55fe1013611 tempest-AbsoluteLimitsTests-1230774549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffe41e88-6315-4b90-8798-5eb319be2651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '503f6b8e-b478-478e-ac1b-c72fa87bd89c', 'volume_name': 'volume-503f6b8e-b478-478e-ac1b-c72fa87bd89c', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-182fe0fc-a9c0-467c-b1d2-c55fe1013611 tempest-AbsoluteLimitsTests-1230774549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0369bcb-182f-4f2c-81ea-49016cc45d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-182fe0fc-a9c0-467c-b1d2-c55fe1013611 tempest-AbsoluteLimitsTests-1230774549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0369bcb-182f-4f2c-81ea-49016cc45d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-182fe0fc-a9c0-467c-b1d2-c55fe1013611 tempest-AbsoluteLimitsTests-1230774549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecb75d95-b278-4860-b1d5-7eefbf33e96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:34 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-182fe0fc-a9c0-467c-b1d2-c55fe1013611 tempest-AbsoluteLimitsTests-1230774549 None] Volume 503f6b8e-b478-478e-ac1b-c72fa87bd89c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-503f6b8e-b478-478e-ac1b-c72fa87bd89c', 'volume_size': 1} Jul 31 10:46:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-182fe0fc-a9c0-467c-b1d2-c55fe1013611 tempest-AbsoluteLimitsTests-1230774549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:46:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-182fe0fc-a9c0-467c-b1d2-c55fe1013611 tempest-AbsoluteLimitsTests-1230774549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:46:34 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-182fe0fc-a9c0-467c-b1d2-c55fe1013611 tempest-AbsoluteLimitsTests-1230774549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1451868144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=503f6b8e-b478-478e-ac1b-c72fa87bd89c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f0ef3786824e86821cc535ca4bfddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:46:34Z,use_quota=True,user_id='6d4c1c2f6a1e46dabff4a9266210d127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:46:34 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-182fe0fc-a9c0-467c-b1d2-c55fe1013611 tempest-AbsoluteLimitsTests-1230774549 None] Creating volume 503f6b8e-b478-478e-ac1b-c72fa87bd89c {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:46:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-182fe0fc-a9c0-467c-b1d2-c55fe1013611 tempest-AbsoluteLimitsTests-1230774549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:46:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-182fe0fc-a9c0-467c-b1d2-c55fe1013611 tempest-AbsoluteLimitsTests-1230774549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:46:34 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-182fe0fc-a9c0-467c-b1d2-c55fe1013611 tempest-AbsoluteLimitsTests-1230774549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:46:34 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-182fe0fc-a9c0-467c-b1d2-c55fe1013611 tempest-AbsoluteLimitsTests-1230774549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:46:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-182fe0fc-a9c0-467c-b1d2-c55fe1013611 tempest-AbsoluteLimitsTests-1230774549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:46:34 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-182fe0fc-a9c0-467c-b1d2-c55fe1013611 tempest-AbsoluteLimitsTests-1230774549 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:46:34 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-182fe0fc-a9c0-467c-b1d2-c55fe1013611 tempest-AbsoluteLimitsTests-1230774549 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:46:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-182fe0fc-a9c0-467c-b1d2-c55fe1013611 tempest-AbsoluteLimitsTests-1230774549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-503f6b8e-b478-478e-ac1b-c72fa87bd89c 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:34 devstack sudo[96502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-503f6b8e-b478-478e-ac1b-c72fa87bd89c 1073741824 Jul 31 10:46:34 devstack sudo[96502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:34 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcc220c1-9221-48e3-aaf7-6bf864cf1b18 tempest-VolumesListTestJSON-1195331447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:46:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dcc220c1-9221-48e3-aaf7-6bf864cf1b18 tempest-VolumesListTestJSON-1195331447 None] Flow 'volume_create_manager' (4d228ef0-e6f7-4dd1-a2af-3a1a1ba4dcdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:46:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dcc220c1-9221-48e3-aaf7-6bf864cf1b18 tempest-VolumesListTestJSON-1195331447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ad7dbe2-0a1b-46a1-8500-c66f3fb79eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dcc220c1-9221-48e3-aaf7-6bf864cf1b18 tempest-VolumesListTestJSON-1195331447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ad7dbe2-0a1b-46a1-8500-c66f3fb79eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-725968854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5994214-d913-417b-8c04-046f5f287c5c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='718a4e38f52c43108191d325ecff6a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:46:34Z,use_quota=True,user_id='7d819f1963fe49808e5f2d364f9a8c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dcc220c1-9221-48e3-aaf7-6bf864cf1b18 tempest-VolumesListTestJSON-1195331447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (726b5761-b6c8-4b53-b778-9c5d3601e2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dcc220c1-9221-48e3-aaf7-6bf864cf1b18 tempest-VolumesListTestJSON-1195331447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (726b5761-b6c8-4b53-b778-9c5d3601e2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dcc220c1-9221-48e3-aaf7-6bf864cf1b18 tempest-VolumesListTestJSON-1195331447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6967a0c1-56e5-4a65-911d-2636efd739f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dcc220c1-9221-48e3-aaf7-6bf864cf1b18 tempest-VolumesListTestJSON-1195331447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6967a0c1-56e5-4a65-911d-2636efd739f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5994214-d913-417b-8c04-046f5f287c5c', 'volume_name': 'volume-e5994214-d913-417b-8c04-046f5f287c5c', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dcc220c1-9221-48e3-aaf7-6bf864cf1b18 tempest-VolumesListTestJSON-1195331447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27522251-e535-4cbb-bb9f-3771e5bdd5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dcc220c1-9221-48e3-aaf7-6bf864cf1b18 tempest-VolumesListTestJSON-1195331447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27522251-e535-4cbb-bb9f-3771e5bdd5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dcc220c1-9221-48e3-aaf7-6bf864cf1b18 tempest-VolumesListTestJSON-1195331447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd7a3b91-4e87-48ac-82c6-cf144f81002d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:34 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-dcc220c1-9221-48e3-aaf7-6bf864cf1b18 tempest-VolumesListTestJSON-1195331447 None] Volume e5994214-d913-417b-8c04-046f5f287c5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5994214-d913-417b-8c04-046f5f287c5c', 'volume_size': 1} Jul 31 10:46:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-dcc220c1-9221-48e3-aaf7-6bf864cf1b18 tempest-VolumesListTestJSON-1195331447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:46:35 devstack sudo[96502]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-182fe0fc-a9c0-467c-b1d2-c55fe1013611 tempest-AbsoluteLimitsTests-1230774549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-503f6b8e-b478-478e-ac1b-c72fa87bd89c 1073741824" returned: 0 in 0.589s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-182fe0fc-a9c0-467c-b1d2-c55fe1013611 tempest-AbsoluteLimitsTests-1230774549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-503f6b8e-b478-478e-ac1b-c72fa87bd89c {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:35 devstack sudo[96508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-503f6b8e-b478-478e-ac1b-c72fa87bd89c Jul 31 10:46:35 devstack sudo[96508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:35 devstack sudo[96508]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-182fe0fc-a9c0-467c-b1d2-c55fe1013611 tempest-AbsoluteLimitsTests-1230774549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-503f6b8e-b478-478e-ac1b-c72fa87bd89c" returned: 0 in 0.301s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:35 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-182fe0fc-a9c0-467c-b1d2-c55fe1013611 tempest-AbsoluteLimitsTests-1230774549 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:46:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-182fe0fc-a9c0-467c-b1d2-c55fe1013611 tempest-AbsoluteLimitsTests-1230774549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:46:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-dcc220c1-9221-48e3-aaf7-6bf864cf1b18 tempest-VolumesListTestJSON-1195331447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.758s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:46:35 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-dcc220c1-9221-48e3-aaf7-6bf864cf1b18 tempest-VolumesListTestJSON-1195331447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-725968854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5994214-d913-417b-8c04-046f5f287c5c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='718a4e38f52c43108191d325ecff6a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:46:34Z,use_quota=True,user_id='7d819f1963fe49808e5f2d364f9a8c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:46:35 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-dcc220c1-9221-48e3-aaf7-6bf864cf1b18 tempest-VolumesListTestJSON-1195331447 None] Creating volume e5994214-d913-417b-8c04-046f5f287c5c {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:46:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-dcc220c1-9221-48e3-aaf7-6bf864cf1b18 tempest-VolumesListTestJSON-1195331447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:46:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-dcc220c1-9221-48e3-aaf7-6bf864cf1b18 tempest-VolumesListTestJSON-1195331447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:46:35 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-dcc220c1-9221-48e3-aaf7-6bf864cf1b18 tempest-VolumesListTestJSON-1195331447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:46:35 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-dcc220c1-9221-48e3-aaf7-6bf864cf1b18 tempest-VolumesListTestJSON-1195331447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:46:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-dcc220c1-9221-48e3-aaf7-6bf864cf1b18 tempest-VolumesListTestJSON-1195331447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:46:35 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-dcc220c1-9221-48e3-aaf7-6bf864cf1b18 tempest-VolumesListTestJSON-1195331447 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:46:35 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-dcc220c1-9221-48e3-aaf7-6bf864cf1b18 tempest-VolumesListTestJSON-1195331447 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:46:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dcc220c1-9221-48e3-aaf7-6bf864cf1b18 tempest-VolumesListTestJSON-1195331447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5994214-d913-417b-8c04-046f5f287c5c 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-182fe0fc-a9c0-467c-b1d2-c55fe1013611 tempest-AbsoluteLimitsTests-1230774549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecb75d95-b278-4860-b1d5-7eefbf33e96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-503f6b8e-b478-478e-ac1b-c72fa87bd89c', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-182fe0fc-a9c0-467c-b1d2-c55fe1013611 tempest-AbsoluteLimitsTests-1230774549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a6b768-45d9-45c1-9e32-a4b3a4f70a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:35 devstack sudo[96511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5994214-d913-417b-8c04-046f5f287c5c 1073741824 Jul 31 10:46:35 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:35 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-182fe0fc-a9c0-467c-b1d2-c55fe1013611 tempest-AbsoluteLimitsTests-1230774549 None] Volume volume-503f6b8e-b478-478e-ac1b-c72fa87bd89c (503f6b8e-b478-478e-ac1b-c72fa87bd89c): created successfully Jul 31 10:46:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-182fe0fc-a9c0-467c-b1d2-c55fe1013611 tempest-AbsoluteLimitsTests-1230774549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a6b768-45d9-45c1-9e32-a4b3a4f70a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-182fe0fc-a9c0-467c-b1d2-c55fe1013611 tempest-AbsoluteLimitsTests-1230774549 None] Flow 'volume_create_manager' (0987cfc8-ccc5-4a50-b341-b61c09e36ae8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:46:35 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-182fe0fc-a9c0-467c-b1d2-c55fe1013611 tempest-AbsoluteLimitsTests-1230774549 None] Created volume successfully. Jul 31 10:46:36 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dcc220c1-9221-48e3-aaf7-6bf864cf1b18 tempest-VolumesListTestJSON-1195331447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5994214-d913-417b-8c04-046f5f287c5c 1073741824" returned: 0 in 0.627s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dcc220c1-9221-48e3-aaf7-6bf864cf1b18 tempest-VolumesListTestJSON-1195331447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5994214-d913-417b-8c04-046f5f287c5c {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:36 devstack sudo[96517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5994214-d913-417b-8c04-046f5f287c5c Jul 31 10:46:36 devstack sudo[96517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:36 devstack sudo[96517]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dcc220c1-9221-48e3-aaf7-6bf864cf1b18 tempest-VolumesListTestJSON-1195331447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5994214-d913-417b-8c04-046f5f287c5c" returned: 0 in 0.284s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:36 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-dcc220c1-9221-48e3-aaf7-6bf864cf1b18 tempest-VolumesListTestJSON-1195331447 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:46:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-dcc220c1-9221-48e3-aaf7-6bf864cf1b18 tempest-VolumesListTestJSON-1195331447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:46:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dcc220c1-9221-48e3-aaf7-6bf864cf1b18 tempest-VolumesListTestJSON-1195331447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd7a3b91-4e87-48ac-82c6-cf144f81002d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5994214-d913-417b-8c04-046f5f287c5c', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dcc220c1-9221-48e3-aaf7-6bf864cf1b18 tempest-VolumesListTestJSON-1195331447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9d3e7ee-ca48-440f-9dd7-2230cb23d7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:36 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-dcc220c1-9221-48e3-aaf7-6bf864cf1b18 tempest-VolumesListTestJSON-1195331447 None] Volume volume-e5994214-d913-417b-8c04-046f5f287c5c (e5994214-d913-417b-8c04-046f5f287c5c): created successfully Jul 31 10:46:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dcc220c1-9221-48e3-aaf7-6bf864cf1b18 tempest-VolumesListTestJSON-1195331447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9d3e7ee-ca48-440f-9dd7-2230cb23d7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-dcc220c1-9221-48e3-aaf7-6bf864cf1b18 tempest-VolumesListTestJSON-1195331447 None] Flow 'volume_create_manager' (4d228ef0-e6f7-4dd1-a2af-3a1a1ba4dcdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:46:36 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-dcc220c1-9221-48e3-aaf7-6bf864cf1b18 tempest-VolumesListTestJSON-1195331447 None] Created volume successfully. Jul 31 10:46:36 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ef4ae42d-1540-4930-bfc4-8671baba75b3 tempest-AbsoluteLimitsTests-1230774549 None] Acquiring lock "cinder-503f6b8e-b478-478e-ac1b-c72fa87bd89c-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:46:36 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ef4ae42d-1540-4930-bfc4-8671baba75b3 tempest-AbsoluteLimitsTests-1230774549 None] Lock "cinder-503f6b8e-b478-478e-ac1b-c72fa87bd89c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:46:36 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ef4ae42d-1540-4930-bfc4-8671baba75b3 tempest-AbsoluteLimitsTests-1230774549 None] Acquiring lock "cinder-quobyte-503f6b8e-b478-478e-ac1b-c72fa87bd89c" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:46:36 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ef4ae42d-1540-4930-bfc4-8671baba75b3 tempest-AbsoluteLimitsTests-1230774549 None] Lock "cinder-quobyte-503f6b8e-b478-478e-ac1b-c72fa87bd89c" acquired by "delete_volume" :: waited 0.026s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:46:36 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a3098d-55f6-4fce-b3ef-b43d671b6b05]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:46:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ef4ae42d-1540-4930-bfc4-8671baba75b3 tempest-AbsoluteLimitsTests-1230774549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-503f6b8e-b478-478e-ac1b-c72fa87bd89c {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:36 devstack sudo[96522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-503f6b8e-b478-478e-ac1b-c72fa87bd89c Jul 31 10:46:36 devstack sudo[96522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:37 devstack sudo[96522]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ef4ae42d-1540-4930-bfc4-8671baba75b3 tempest-AbsoluteLimitsTests-1230774549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-503f6b8e-b478-478e-ac1b-c72fa87bd89c" returned: 0 in 0.594s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ef4ae42d-1540-4930-bfc4-8671baba75b3 tempest-AbsoluteLimitsTests-1230774549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-503f6b8e-b478-478e-ac1b-c72fa87bd89c {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:37 devstack sudo[96528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-503f6b8e-b478-478e-ac1b-c72fa87bd89c Jul 31 10:46:37 devstack sudo[96528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:37 devstack sudo[96528]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ef4ae42d-1540-4930-bfc4-8671baba75b3 tempest-AbsoluteLimitsTests-1230774549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-503f6b8e-b478-478e-ac1b-c72fa87bd89c" returned: 0 in 0.404s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ef4ae42d-1540-4930-bfc4-8671baba75b3 tempest-AbsoluteLimitsTests-1230774549 None] Lock "cinder-quobyte-503f6b8e-b478-478e-ac1b-c72fa87bd89c" released by "delete_volume" :: held 1.090s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:46:37 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-ef4ae42d-1540-4930-bfc4-8671baba75b3 tempest-AbsoluteLimitsTests-1230774549 None] Created reservations ['9036d7ee-b61c-494c-97ed-8c0f573b5025', '7c3a0236-2d10-408c-9250-6edbf0031dc0', '57cbb26f-79c3-49cf-a0e7-c092cc66d669', 'c5758748-1b20-4bcf-9e43-feed1b3ecc08'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:46:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ef4ae42d-1540-4930-bfc4-8671baba75b3 tempest-AbsoluteLimitsTests-1230774549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:46:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ef4ae42d-1540-4930-bfc4-8671baba75b3 tempest-AbsoluteLimitsTests-1230774549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:46:37 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ef4ae42d-1540-4930-bfc4-8671baba75b3 tempest-AbsoluteLimitsTests-1230774549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:46:37 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ef4ae42d-1540-4930-bfc4-8671baba75b3 tempest-AbsoluteLimitsTests-1230774549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:46:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ef4ae42d-1540-4930-bfc4-8671baba75b3 tempest-AbsoluteLimitsTests-1230774549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:46:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ef4ae42d-1540-4930-bfc4-8671baba75b3 tempest-AbsoluteLimitsTests-1230774549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:38 devstack sudo[96531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:46:38 devstack sudo[96531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:38 devstack sudo[96531]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ef4ae42d-1540-4930-bfc4-8671baba75b3 tempest-AbsoluteLimitsTests-1230774549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.319s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:38 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-ef4ae42d-1540-4930-bfc4-8671baba75b3 tempest-AbsoluteLimitsTests-1230774549 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:46:38 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-ef4ae42d-1540-4930-bfc4-8671baba75b3 tempest-AbsoluteLimitsTests-1230774549 None] Deleted volume successfully. Jul 31 10:46:38 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ef4ae42d-1540-4930-bfc4-8671baba75b3 tempest-AbsoluteLimitsTests-1230774549 None] Lock "cinder-503f6b8e-b478-478e-ac1b-c72fa87bd89c-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:46:39 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-84774b90-0353-47c1-a11d-987b6d0ec171 tempest-GroupSnapshotsTest-2131484768 None] Group tempest-GroupSnapshotsTest-Group-1820000424: creating Jul 31 10:46:39 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-84774b90-0353-47c1-a11d-987b6d0ec171 tempest-GroupSnapshotsTest-2131484768 None] Group tempest-GroupSnapshotsTest-Group-1820000424: created successfully Jul 31 10:46:39 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-84774b90-0353-47c1-a11d-987b6d0ec171 tempest-GroupSnapshotsTest-2131484768 None] Create group completed successfully. Jul 31 10:46:39 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-09f38ea9-691e-40d0-b392-0f3cc23abc99 tempest-VolumesListTestJSON-1195331447 None] Acquiring lock "cinder-e5994214-d913-417b-8c04-046f5f287c5c-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:46:39 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-09f38ea9-691e-40d0-b392-0f3cc23abc99 tempest-VolumesListTestJSON-1195331447 None] Lock "cinder-e5994214-d913-417b-8c04-046f5f287c5c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:46:39 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-09f38ea9-691e-40d0-b392-0f3cc23abc99 tempest-VolumesListTestJSON-1195331447 None] Acquiring lock "cinder-quobyte-e5994214-d913-417b-8c04-046f5f287c5c" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:46:39 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-09f38ea9-691e-40d0-b392-0f3cc23abc99 tempest-VolumesListTestJSON-1195331447 None] Lock "cinder-quobyte-e5994214-d913-417b-8c04-046f5f287c5c" acquired by "delete_volume" :: waited 0.018s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:46:39 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e6bad3-f27e-4be4-8869-7cb25c5f64ac]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:46:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-09f38ea9-691e-40d0-b392-0f3cc23abc99 tempest-VolumesListTestJSON-1195331447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5994214-d913-417b-8c04-046f5f287c5c {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:39 devstack sudo[96534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5994214-d913-417b-8c04-046f5f287c5c Jul 31 10:46:39 devstack sudo[96534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:39 devstack sudo[96534]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-09f38ea9-691e-40d0-b392-0f3cc23abc99 tempest-VolumesListTestJSON-1195331447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5994214-d913-417b-8c04-046f5f287c5c" returned: 0 in 0.447s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-09f38ea9-691e-40d0-b392-0f3cc23abc99 tempest-VolumesListTestJSON-1195331447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5994214-d913-417b-8c04-046f5f287c5c {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:39 devstack sudo[96539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5994214-d913-417b-8c04-046f5f287c5c Jul 31 10:46:39 devstack sudo[96539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:40 devstack sudo[96539]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-09f38ea9-691e-40d0-b392-0f3cc23abc99 tempest-VolumesListTestJSON-1195331447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5994214-d913-417b-8c04-046f5f287c5c" returned: 0 in 0.319s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:40 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-09f38ea9-691e-40d0-b392-0f3cc23abc99 tempest-VolumesListTestJSON-1195331447 None] Lock "cinder-quobyte-e5994214-d913-417b-8c04-046f5f287c5c" released by "delete_volume" :: held 0.817s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:46:40 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-09f38ea9-691e-40d0-b392-0f3cc23abc99 tempest-VolumesListTestJSON-1195331447 None] Created reservations ['83cf0557-4d2c-4458-b06c-1000e29b3d16', '1b5b2e5a-6f18-4d2d-a450-3e1d533d057a', '7b1f7b7a-28b4-480d-9b66-3caca28d99c9', 'c1595571-3179-494a-944f-c2d6245fc7f7'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:46:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-09f38ea9-691e-40d0-b392-0f3cc23abc99 tempest-VolumesListTestJSON-1195331447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:46:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-09f38ea9-691e-40d0-b392-0f3cc23abc99 tempest-VolumesListTestJSON-1195331447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:46:40 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-09f38ea9-691e-40d0-b392-0f3cc23abc99 tempest-VolumesListTestJSON-1195331447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:46:40 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-09f38ea9-691e-40d0-b392-0f3cc23abc99 tempest-VolumesListTestJSON-1195331447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:46:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-09f38ea9-691e-40d0-b392-0f3cc23abc99 tempest-VolumesListTestJSON-1195331447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:46:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-09f38ea9-691e-40d0-b392-0f3cc23abc99 tempest-VolumesListTestJSON-1195331447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:40 devstack sudo[96542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:46:40 devstack sudo[96542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:40 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-606b3847-ef2c-4ae9-b2ab-3d8cfc1ee740 tempest-VolumesListTestJSON-1195331447 None] Acquiring lock "cinder-1416edc2-3bbe-425f-a05e-67986243423e-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:46:40 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-606b3847-ef2c-4ae9-b2ab-3d8cfc1ee740 tempest-VolumesListTestJSON-1195331447 None] Lock "cinder-1416edc2-3bbe-425f-a05e-67986243423e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:46:40 devstack sudo[96542]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-09f38ea9-691e-40d0-b392-0f3cc23abc99 tempest-VolumesListTestJSON-1195331447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.450s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:40 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-09f38ea9-691e-40d0-b392-0f3cc23abc99 tempest-VolumesListTestJSON-1195331447 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:46:40 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-09f38ea9-691e-40d0-b392-0f3cc23abc99 tempest-VolumesListTestJSON-1195331447 None] Deleted volume successfully. Jul 31 10:46:40 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-606b3847-ef2c-4ae9-b2ab-3d8cfc1ee740 tempest-VolumesListTestJSON-1195331447 None] Acquiring lock "cinder-quobyte-1416edc2-3bbe-425f-a05e-67986243423e" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:46:40 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-09f38ea9-691e-40d0-b392-0f3cc23abc99 tempest-VolumesListTestJSON-1195331447 None] Lock "cinder-e5994214-d913-417b-8c04-046f5f287c5c-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:46:40 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-606b3847-ef2c-4ae9-b2ab-3d8cfc1ee740 tempest-VolumesListTestJSON-1195331447 None] Lock "cinder-quobyte-1416edc2-3bbe-425f-a05e-67986243423e" acquired by "delete_volume" :: waited 0.037s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:46:41 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f684d3-744c-4d27-9c1c-dfc45baa8ca5]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:46:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-606b3847-ef2c-4ae9-b2ab-3d8cfc1ee740 tempest-VolumesListTestJSON-1195331447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1416edc2-3bbe-425f-a05e-67986243423e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:41 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-0facf722-9b54-44ee-b087-064881d58baa tempest-GroupSnapshotsTest-2131484768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:46:41 devstack sudo[96545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1416edc2-3bbe-425f-a05e-67986243423e Jul 31 10:46:41 devstack sudo[96545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:41 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0facf722-9b54-44ee-b087-064881d58baa tempest-GroupSnapshotsTest-2131484768 None] Flow 'volume_create_manager' (f69af356-5b27-4bfe-9a1b-725bcd3a31a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:46:41 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0facf722-9b54-44ee-b087-064881d58baa tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b115fa4-004b-4596-b08a-4e28ab02fcb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:41 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0facf722-9b54-44ee-b087-064881d58baa tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b115fa4-004b-4596-b08a-4e28ab02fcb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1752433531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=954cc3d6-8984-4602-bc4b-8e196d342fdd,host='devstack@QuobyteHD#QuobyteHD',id=1c70d74b-42f8-4803-b939-f560ebe2ee3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a49b0bd02504a06938e9e136a84d940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:46:41Z,use_quota=True,user_id='35a7d721ee5042f08dd9bc7cf1f3a1cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c24b5abd-27ad-4623-b593-db583ac58dcd),volume_type_id=c24b5abd-27ad-4623-b593-db583ac58dcd)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:41 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0facf722-9b54-44ee-b087-064881d58baa tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a6eb2fa-ccf6-4129-8026-f980bc4e3ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:41 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0facf722-9b54-44ee-b087-064881d58baa tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a6eb2fa-ccf6-4129-8026-f980bc4e3ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:41 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0facf722-9b54-44ee-b087-064881d58baa tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af3556b1-6e5b-4c15-90cc-c501fb4c9b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:41 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0facf722-9b54-44ee-b087-064881d58baa tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af3556b1-6e5b-4c15-90cc-c501fb4c9b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c70d74b-42f8-4803-b939-f560ebe2ee3e', 'volume_name': 'volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:41 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0facf722-9b54-44ee-b087-064881d58baa tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81f0f76e-a2d3-4349-8b44-aa5a5c2bc192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:41 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0facf722-9b54-44ee-b087-064881d58baa tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81f0f76e-a2d3-4349-8b44-aa5a5c2bc192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:41 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0facf722-9b54-44ee-b087-064881d58baa tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (449861c7-908c-4781-bf28-4ec56a646c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:41 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-0facf722-9b54-44ee-b087-064881d58baa tempest-GroupSnapshotsTest-2131484768 None] Volume 1c70d74b-42f8-4803-b939-f560ebe2ee3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e', 'volume_size': 1} Jul 31 10:46:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0facf722-9b54-44ee-b087-064881d58baa tempest-GroupSnapshotsTest-2131484768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:46:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0facf722-9b54-44ee-b087-064881d58baa tempest-GroupSnapshotsTest-2131484768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:46:41 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0facf722-9b54-44ee-b087-064881d58baa tempest-GroupSnapshotsTest-2131484768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=954cc3d6-8984-4602-bc4b-8e196d342fdd,created_at=2026-07-31T08:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1752433531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=954cc3d6-8984-4602-bc4b-8e196d342fdd,host='devstack@QuobyteHD#QuobyteHD',id=1c70d74b-42f8-4803-b939-f560ebe2ee3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a49b0bd02504a06938e9e136a84d940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:46:41Z,use_quota=True,user_id='35a7d721ee5042f08dd9bc7cf1f3a1cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c24b5abd-27ad-4623-b593-db583ac58dcd),volume_type_id=c24b5abd-27ad-4623-b593-db583ac58dcd)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:46:41 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-0facf722-9b54-44ee-b087-064881d58baa tempest-GroupSnapshotsTest-2131484768 None] Creating volume 1c70d74b-42f8-4803-b939-f560ebe2ee3e {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:46:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0facf722-9b54-44ee-b087-064881d58baa tempest-GroupSnapshotsTest-2131484768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:46:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0facf722-9b54-44ee-b087-064881d58baa tempest-GroupSnapshotsTest-2131484768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:46:41 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0facf722-9b54-44ee-b087-064881d58baa tempest-GroupSnapshotsTest-2131484768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:46:41 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0facf722-9b54-44ee-b087-064881d58baa tempest-GroupSnapshotsTest-2131484768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:46:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0facf722-9b54-44ee-b087-064881d58baa tempest-GroupSnapshotsTest-2131484768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:46:41 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0facf722-9b54-44ee-b087-064881d58baa tempest-GroupSnapshotsTest-2131484768 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:46:41 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-0facf722-9b54-44ee-b087-064881d58baa tempest-GroupSnapshotsTest-2131484768 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:46:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0facf722-9b54-44ee-b087-064881d58baa tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:41 devstack sudo[96547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e 1073741824 Jul 31 10:46:41 devstack sudo[96547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:41 devstack sudo[96545]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-606b3847-ef2c-4ae9-b2ab-3d8cfc1ee740 tempest-VolumesListTestJSON-1195331447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1416edc2-3bbe-425f-a05e-67986243423e" returned: 0 in 0.497s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-606b3847-ef2c-4ae9-b2ab-3d8cfc1ee740 tempest-VolumesListTestJSON-1195331447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1416edc2-3bbe-425f-a05e-67986243423e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:41 devstack sudo[96552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1416edc2-3bbe-425f-a05e-67986243423e Jul 31 10:46:41 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:41 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-606b3847-ef2c-4ae9-b2ab-3d8cfc1ee740 tempest-VolumesListTestJSON-1195331447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1416edc2-3bbe-425f-a05e-67986243423e" returned: 0 in 0.358s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:41 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-606b3847-ef2c-4ae9-b2ab-3d8cfc1ee740 tempest-VolumesListTestJSON-1195331447 None] Lock "cinder-quobyte-1416edc2-3bbe-425f-a05e-67986243423e" released by "delete_volume" :: held 0.911s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:46:41 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-606b3847-ef2c-4ae9-b2ab-3d8cfc1ee740 tempest-VolumesListTestJSON-1195331447 None] Created reservations ['b369c875-6de0-4ee5-9961-8207df5a5130', 'a343d2fc-7752-4cb6-b503-e93e59572a35', '3e6c83ab-4ffc-44c2-a5c7-bcba09b4a7f9', '3c2aed08-218b-4414-a4b3-335e19060252'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:46:41 devstack sudo[96547]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0facf722-9b54-44ee-b087-064881d58baa tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e 1073741824" returned: 0 in 0.677s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0facf722-9b54-44ee-b087-064881d58baa tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:42 devstack sudo[96565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e Jul 31 10:46:42 devstack sudo[96565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-606b3847-ef2c-4ae9-b2ab-3d8cfc1ee740 tempest-VolumesListTestJSON-1195331447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:46:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-606b3847-ef2c-4ae9-b2ab-3d8cfc1ee740 tempest-VolumesListTestJSON-1195331447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:46:42 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-606b3847-ef2c-4ae9-b2ab-3d8cfc1ee740 tempest-VolumesListTestJSON-1195331447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:46:42 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-606b3847-ef2c-4ae9-b2ab-3d8cfc1ee740 tempest-VolumesListTestJSON-1195331447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:46:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-606b3847-ef2c-4ae9-b2ab-3d8cfc1ee740 tempest-VolumesListTestJSON-1195331447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:46:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-606b3847-ef2c-4ae9-b2ab-3d8cfc1ee740 tempest-VolumesListTestJSON-1195331447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:42 devstack sudo[96567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:46:42 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:42 devstack sudo[96565]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0facf722-9b54-44ee-b087-064881d58baa tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e" returned: 0 in 0.342s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:42 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0facf722-9b54-44ee-b087-064881d58baa tempest-GroupSnapshotsTest-2131484768 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:46:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0facf722-9b54-44ee-b087-064881d58baa tempest-GroupSnapshotsTest-2131484768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:46:42 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0facf722-9b54-44ee-b087-064881d58baa tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (449861c7-908c-4781-bf28-4ec56a646c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:42 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0facf722-9b54-44ee-b087-064881d58baa tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb905b60-60b6-4fe3-9936-00ccf82f03c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:42 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-0facf722-9b54-44ee-b087-064881d58baa tempest-GroupSnapshotsTest-2131484768 None] Volume volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e (1c70d74b-42f8-4803-b939-f560ebe2ee3e): created successfully Jul 31 10:46:42 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0facf722-9b54-44ee-b087-064881d58baa tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb905b60-60b6-4fe3-9936-00ccf82f03c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:42 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:42 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0facf722-9b54-44ee-b087-064881d58baa tempest-GroupSnapshotsTest-2131484768 None] Flow 'volume_create_manager' (f69af356-5b27-4bfe-9a1b-725bcd3a31a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:46:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-606b3847-ef2c-4ae9-b2ab-3d8cfc1ee740 tempest-VolumesListTestJSON-1195331447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.415s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:42 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-606b3847-ef2c-4ae9-b2ab-3d8cfc1ee740 tempest-VolumesListTestJSON-1195331447 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:46:42 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-606b3847-ef2c-4ae9-b2ab-3d8cfc1ee740 tempest-VolumesListTestJSON-1195331447 None] Deleted volume successfully. Jul 31 10:46:42 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-0facf722-9b54-44ee-b087-064881d58baa tempest-GroupSnapshotsTest-2131484768 None] Created volume successfully. Jul 31 10:46:42 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-606b3847-ef2c-4ae9-b2ab-3d8cfc1ee740 tempest-VolumesListTestJSON-1195331447 None] Lock "cinder-1416edc2-3bbe-425f-a05e-67986243423e-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:46:42 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-7681c04d-1667-434c-8d9b-1d72d6bf68bb tempest-AttachVolumeTestJSON-1723809781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:46:42 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7681c04d-1667-434c-8d9b-1d72d6bf68bb tempest-AttachVolumeTestJSON-1723809781 None] Flow 'volume_create_manager' (0d8056ae-a095-4c09-aba8-d1a0ab5fe326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:46:42 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7681c04d-1667-434c-8d9b-1d72d6bf68bb tempest-AttachVolumeTestJSON-1723809781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49772d54-850b-467f-8e49-5cac0230f7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:42 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7681c04d-1667-434c-8d9b-1d72d6bf68bb tempest-AttachVolumeTestJSON-1723809781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49772d54-850b-467f-8e49-5cac0230f7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1432097042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=856ea32b-d54b-4c4f-820b-f7fdd64059e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f5fa6e507f3474980070de0fe76917c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:46:43Z,use_quota=True,user_id='ef2cbbabbb8844929cc28d92e491639a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:42 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7681c04d-1667-434c-8d9b-1d72d6bf68bb tempest-AttachVolumeTestJSON-1723809781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe051107-43da-4ecf-ae54-1354ec573394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:42 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7681c04d-1667-434c-8d9b-1d72d6bf68bb tempest-AttachVolumeTestJSON-1723809781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe051107-43da-4ecf-ae54-1354ec573394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:42 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7681c04d-1667-434c-8d9b-1d72d6bf68bb tempest-AttachVolumeTestJSON-1723809781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c22bc4c0-abdf-41a0-a124-21f46dbee638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:42 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7681c04d-1667-434c-8d9b-1d72d6bf68bb tempest-AttachVolumeTestJSON-1723809781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c22bc4c0-abdf-41a0-a124-21f46dbee638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '856ea32b-d54b-4c4f-820b-f7fdd64059e2', 'volume_name': 'volume-856ea32b-d54b-4c4f-820b-f7fdd64059e2', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:42 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7681c04d-1667-434c-8d9b-1d72d6bf68bb tempest-AttachVolumeTestJSON-1723809781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63e85296-7c74-46f9-92bd-f6bb911784e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:42 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7681c04d-1667-434c-8d9b-1d72d6bf68bb tempest-AttachVolumeTestJSON-1723809781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63e85296-7c74-46f9-92bd-f6bb911784e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:42 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7681c04d-1667-434c-8d9b-1d72d6bf68bb tempest-AttachVolumeTestJSON-1723809781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7400c99-449a-4414-a8a0-d3b6e7d4a300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:42 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-7681c04d-1667-434c-8d9b-1d72d6bf68bb tempest-AttachVolumeTestJSON-1723809781 None] Volume 856ea32b-d54b-4c4f-820b-f7fdd64059e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-856ea32b-d54b-4c4f-820b-f7fdd64059e2', 'volume_size': 1} Jul 31 10:46:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7681c04d-1667-434c-8d9b-1d72d6bf68bb tempest-AttachVolumeTestJSON-1723809781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:46:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7681c04d-1667-434c-8d9b-1d72d6bf68bb tempest-AttachVolumeTestJSON-1723809781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:46:42 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-7681c04d-1667-434c-8d9b-1d72d6bf68bb tempest-AttachVolumeTestJSON-1723809781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1432097042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=856ea32b-d54b-4c4f-820b-f7fdd64059e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f5fa6e507f3474980070de0fe76917c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:46:43Z,use_quota=True,user_id='ef2cbbabbb8844929cc28d92e491639a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:46:42 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-7681c04d-1667-434c-8d9b-1d72d6bf68bb tempest-AttachVolumeTestJSON-1723809781 None] Creating volume 856ea32b-d54b-4c4f-820b-f7fdd64059e2 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:46:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7681c04d-1667-434c-8d9b-1d72d6bf68bb tempest-AttachVolumeTestJSON-1723809781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:46:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7681c04d-1667-434c-8d9b-1d72d6bf68bb tempest-AttachVolumeTestJSON-1723809781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:46:42 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-7681c04d-1667-434c-8d9b-1d72d6bf68bb tempest-AttachVolumeTestJSON-1723809781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:46:42 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-7681c04d-1667-434c-8d9b-1d72d6bf68bb tempest-AttachVolumeTestJSON-1723809781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:46:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7681c04d-1667-434c-8d9b-1d72d6bf68bb tempest-AttachVolumeTestJSON-1723809781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:46:42 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-7681c04d-1667-434c-8d9b-1d72d6bf68bb tempest-AttachVolumeTestJSON-1723809781 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:46:42 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-7681c04d-1667-434c-8d9b-1d72d6bf68bb tempest-AttachVolumeTestJSON-1723809781 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:46:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7681c04d-1667-434c-8d9b-1d72d6bf68bb tempest-AttachVolumeTestJSON-1723809781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-856ea32b-d54b-4c4f-820b-f7fdd64059e2 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:42 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-856ea32b-d54b-4c4f-820b-f7fdd64059e2 1073741824 Jul 31 10:46:42 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:43 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e79d41d5-f5b8-4960-a5fa-f37c07510198 tempest-VolumesListTestJSON-1195331447 None] Acquiring lock "cinder-28e2ccde-0217-4487-bc3f-3faa7e9a4f14-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:46:43 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e79d41d5-f5b8-4960-a5fa-f37c07510198 tempest-VolumesListTestJSON-1195331447 None] Lock "cinder-28e2ccde-0217-4487-bc3f-3faa7e9a4f14-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:46:43 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e79d41d5-f5b8-4960-a5fa-f37c07510198 tempest-VolumesListTestJSON-1195331447 None] Acquiring lock "cinder-quobyte-28e2ccde-0217-4487-bc3f-3faa7e9a4f14" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:46:43 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e79d41d5-f5b8-4960-a5fa-f37c07510198 tempest-VolumesListTestJSON-1195331447 None] Lock "cinder-quobyte-28e2ccde-0217-4487-bc3f-3faa7e9a4f14" acquired by "delete_volume" :: waited 0.018s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:46:43 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e534f0d-d48d-4141-a138-a37957ba5aea]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:46:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e79d41d5-f5b8-4960-a5fa-f37c07510198 tempest-VolumesListTestJSON-1195331447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-28e2ccde-0217-4487-bc3f-3faa7e9a4f14 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:43 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7681c04d-1667-434c-8d9b-1d72d6bf68bb tempest-AttachVolumeTestJSON-1723809781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-856ea32b-d54b-4c4f-820b-f7fdd64059e2 1073741824" returned: 0 in 0.566s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7681c04d-1667-434c-8d9b-1d72d6bf68bb tempest-AttachVolumeTestJSON-1723809781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-856ea32b-d54b-4c4f-820b-f7fdd64059e2 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:43 devstack sudo[96577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-28e2ccde-0217-4487-bc3f-3faa7e9a4f14 Jul 31 10:46:43 devstack sudo[96577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:43 devstack sudo[96579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-856ea32b-d54b-4c4f-820b-f7fdd64059e2 Jul 31 10:46:43 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:43 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7681c04d-1667-434c-8d9b-1d72d6bf68bb tempest-AttachVolumeTestJSON-1723809781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-856ea32b-d54b-4c4f-820b-f7fdd64059e2" returned: 0 in 0.374s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:43 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-7681c04d-1667-434c-8d9b-1d72d6bf68bb tempest-AttachVolumeTestJSON-1723809781 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:46:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7681c04d-1667-434c-8d9b-1d72d6bf68bb tempest-AttachVolumeTestJSON-1723809781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:46:43 devstack sudo[96577]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:43 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7681c04d-1667-434c-8d9b-1d72d6bf68bb tempest-AttachVolumeTestJSON-1723809781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7400c99-449a-4414-a8a0-d3b6e7d4a300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-856ea32b-d54b-4c4f-820b-f7fdd64059e2', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:43 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7681c04d-1667-434c-8d9b-1d72d6bf68bb tempest-AttachVolumeTestJSON-1723809781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67f972ce-93d8-4522-80d9-3c42cbd03253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e79d41d5-f5b8-4960-a5fa-f37c07510198 tempest-VolumesListTestJSON-1195331447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-28e2ccde-0217-4487-bc3f-3faa7e9a4f14" returned: 0 in 0.568s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e79d41d5-f5b8-4960-a5fa-f37c07510198 tempest-VolumesListTestJSON-1195331447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-28e2ccde-0217-4487-bc3f-3faa7e9a4f14 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:43 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-7681c04d-1667-434c-8d9b-1d72d6bf68bb tempest-AttachVolumeTestJSON-1723809781 None] Volume volume-856ea32b-d54b-4c4f-820b-f7fdd64059e2 (856ea32b-d54b-4c4f-820b-f7fdd64059e2): created successfully Jul 31 10:46:43 devstack sudo[96585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-28e2ccde-0217-4487-bc3f-3faa7e9a4f14 Jul 31 10:46:43 devstack sudo[96585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:43 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7681c04d-1667-434c-8d9b-1d72d6bf68bb tempest-AttachVolumeTestJSON-1723809781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67f972ce-93d8-4522-80d9-3c42cbd03253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:43 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7681c04d-1667-434c-8d9b-1d72d6bf68bb tempest-AttachVolumeTestJSON-1723809781 None] Flow 'volume_create_manager' (0d8056ae-a095-4c09-aba8-d1a0ab5fe326) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:46:44 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-7681c04d-1667-434c-8d9b-1d72d6bf68bb tempest-AttachVolumeTestJSON-1723809781 None] Created volume successfully. Jul 31 10:46:44 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-c8a46c99-c0d2-4700-b24e-1895c1148684 tempest-GroupSnapshotsTest-2131484768 None] GroupSnapshot d81940a4-ad4c-41c9-903a-d493c0bbf05f: creating. Jul 31 10:46:44 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c8a46c99-c0d2-4700-b24e-1895c1148684 tempest-GroupSnapshotsTest-2131484768 None] Group snapshot d81940a4-ad4c-41c9-903a-d493c0bbf05f: creating. {{(pid=89090) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 31 10:46:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c8a46c99-c0d2-4700-b24e-1895c1148684 tempest-GroupSnapshotsTest-2131484768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:46:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c8a46c99-c0d2-4700-b24e-1895c1148684 tempest-GroupSnapshotsTest-2131484768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:46:44 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-c8a46c99-c0d2-4700-b24e-1895c1148684 tempest-GroupSnapshotsTest-2131484768 None] Creating offline snapshot a8387036-ce45-4edb-a9e5-7b036b154c20 of volume 1c70d74b-42f8-4803-b939-f560ebe2ee3e {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:46:44 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47bd2b6-221d-4437-b6c0-93bb571e5e6c]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:46:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c8a46c99-c0d2-4700-b24e-1895c1148684 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:44 devstack sudo[96585]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e79d41d5-f5b8-4960-a5fa-f37c07510198 tempest-VolumesListTestJSON-1195331447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-28e2ccde-0217-4487-bc3f-3faa7e9a4f14" returned: 0 in 0.348s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:44 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e79d41d5-f5b8-4960-a5fa-f37c07510198 tempest-VolumesListTestJSON-1195331447 None] Lock "cinder-quobyte-28e2ccde-0217-4487-bc3f-3faa7e9a4f14" released by "delete_volume" :: held 0.980s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:46:44 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-e79d41d5-f5b8-4960-a5fa-f37c07510198 tempest-VolumesListTestJSON-1195331447 None] Created reservations ['ca1ff95f-569d-43d4-9c45-a3764426073f', '9ceca95a-e795-477e-9b7b-30a62ff79387', '34c4bc9d-3504-4fa8-bd28-c07b204e1588', '29dad2a1-2d8a-44a0-9868-7849c203bd11'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:46:44 devstack sudo[96588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e Jul 31 10:46:44 devstack sudo[96588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e79d41d5-f5b8-4960-a5fa-f37c07510198 tempest-VolumesListTestJSON-1195331447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:46:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e79d41d5-f5b8-4960-a5fa-f37c07510198 tempest-VolumesListTestJSON-1195331447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:46:44 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-e79d41d5-f5b8-4960-a5fa-f37c07510198 tempest-VolumesListTestJSON-1195331447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:46:44 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-e79d41d5-f5b8-4960-a5fa-f37c07510198 tempest-VolumesListTestJSON-1195331447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:46:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e79d41d5-f5b8-4960-a5fa-f37c07510198 tempest-VolumesListTestJSON-1195331447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:46:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e79d41d5-f5b8-4960-a5fa-f37c07510198 tempest-VolumesListTestJSON-1195331447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:44 devstack sudo[96590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:46:44 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:44 devstack sudo[96588]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c8a46c99-c0d2-4700-b24e-1895c1148684 tempest-GroupSnapshotsTest-2131484768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e" returned: 0 in 0.469s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c8a46c99-c0d2-4700-b24e-1895c1148684 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e.a8387036-ce45-4edb-a9e5-7b036b154c20 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:44 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e79d41d5-f5b8-4960-a5fa-f37c07510198 tempest-VolumesListTestJSON-1195331447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.280s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:44 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-e79d41d5-f5b8-4960-a5fa-f37c07510198 tempest-VolumesListTestJSON-1195331447 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:46:44 devstack sudo[96596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e.a8387036-ce45-4edb-a9e5-7b036b154c20 1G Jul 31 10:46:44 devstack sudo[96596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:44 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-e79d41d5-f5b8-4960-a5fa-f37c07510198 tempest-VolumesListTestJSON-1195331447 None] Deleted volume successfully. Jul 31 10:46:44 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e79d41d5-f5b8-4960-a5fa-f37c07510198 tempest-VolumesListTestJSON-1195331447 None] Lock "cinder-28e2ccde-0217-4487-bc3f-3faa7e9a4f14-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:46:45 devstack sudo[96596]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c8a46c99-c0d2-4700-b24e-1895c1148684 tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e.a8387036-ce45-4edb-a9e5-7b036b154c20 1G" returned: 0 in 0.591s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c8a46c99-c0d2-4700-b24e-1895c1148684 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e.a8387036-ce45-4edb-a9e5-7b036b154c20 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:45 devstack sudo[96606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e.a8387036-ce45-4edb-a9e5-7b036b154c20 Jul 31 10:46:45 devstack sudo[96606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:45 devstack sudo[96606]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-e85f995b-89b4-41ea-b80e-202baf943fbe req-f634af34-56f4-4109-9dbe-1c74921f0a06 tempest-AttachVolumeTestJSON-1723809781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:46:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c8a46c99-c0d2-4700-b24e-1895c1148684 tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e.a8387036-ce45-4edb-a9e5-7b036b154c20" returned: 0 in 0.534s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:45 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-c8a46c99-c0d2-4700-b24e-1895c1148684 tempest-GroupSnapshotsTest-2131484768 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e.a8387036-ce45-4edb-a9e5-7b036b154c20 is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:46:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c8a46c99-c0d2-4700-b24e-1895c1148684 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e.a8387036-ce45-4edb-a9e5-7b036b154c20 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:45 devstack sudo[96620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e.a8387036-ce45-4edb-a9e5-7b036b154c20 Jul 31 10:46:45 devstack sudo[96620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:45 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:46:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:46:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:46:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:46:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:46:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:46:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:45 devstack sudo[96622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:46:45 devstack sudo[96622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:46 devstack sudo[96620]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c8a46c99-c0d2-4700-b24e-1895c1148684 tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e.a8387036-ce45-4edb-a9e5-7b036b154c20" returned: 0 in 0.369s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c8a46c99-c0d2-4700-b24e-1895c1148684 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:46 devstack sudo[96622]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.424s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:46 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:46:46 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager._thread_info {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:46:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread count: 28 {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:46:46 devstack sudo[96626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e.info Jul 31 10:46:46 devstack sudo[96626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread info: [<_MainThread(MainThread, started 134005426110592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:46:46 devstack sudo[96626]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c8a46c99-c0d2-4700-b24e-1895c1148684 tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e.info" returned: 0 in 0.414s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:46 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-c8a46c99-c0d2-4700-b24e-1895c1148684 tempest-GroupSnapshotsTest-2131484768 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e.info is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:46:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c8a46c99-c0d2-4700-b24e-1895c1148684 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:46 devstack sudo[96629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e.info Jul 31 10:46:46 devstack sudo[96629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:47 devstack sudo[96629]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c8a46c99-c0d2-4700-b24e-1895c1148684 tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e.info" returned: 0 in 0.367s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c8a46c99-c0d2-4700-b24e-1895c1148684 tempest-GroupSnapshotsTest-2131484768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.905s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:46:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-e85f995b-89b4-41ea-b80e-202baf943fbe req-f634af34-56f4-4109-9dbe-1c74921f0a06 tempest-AttachVolumeTestJSON-1723809781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.276s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:46:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-e85f995b-89b4-41ea-b80e-202baf943fbe req-f634af34-56f4-4109-9dbe-1c74921f0a06 tempest-AttachVolumeTestJSON-1723809781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:46:47 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-e85f995b-89b4-41ea-b80e-202baf943fbe req-f634af34-56f4-4109-9dbe-1c74921f0a06 tempest-AttachVolumeTestJSON-1723809781 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c', 'name': 'volume-856ea32b-d54b-4c4f-820b-f7fdd64059e2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bef30985-b0ed-4e52-838b-e1a028a88902', 'enforce_multipath': True} {{(pid=89090) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:46:47 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-c8a46c99-c0d2-4700-b24e-1895c1148684 tempest-GroupSnapshotsTest-2131484768 None] group_snapshot d81940a4-ad4c-41c9-903a-d493c0bbf05f: created successfully Jul 31 10:46:47 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-e85f995b-89b4-41ea-b80e-202baf943fbe req-f634af34-56f4-4109-9dbe-1c74921f0a06 tempest-AttachVolumeTestJSON-1723809781 None] attachment_update completed successfully. Jul 31 10:46:47 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b8607b7-fa54-4a7c-aca4-5374f61949fb tempest-VolumesTransfersV355Test-1599633818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:46:47 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7b8607b7-fa54-4a7c-aca4-5374f61949fb tempest-VolumesTransfersV355Test-1599633818 None] Flow 'volume_create_manager' (abbc11c9-8719-4021-8e50-c88efd5a739d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:46:47 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7b8607b7-fa54-4a7c-aca4-5374f61949fb tempest-VolumesTransfersV355Test-1599633818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b86b4ec-7e61-43a8-b24e-ae331f3a8fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:47 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7b8607b7-fa54-4a7c-aca4-5374f61949fb tempest-VolumesTransfersV355Test-1599633818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b86b4ec-7e61-43a8-b24e-ae331f3a8fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1335726293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4c6df48-e5b0-4766-a35c-0838ffaa02d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0155924aa0604049a0a055cab978f7bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:46:48Z,use_quota=True,user_id='9d592c81a975432da7117263e8630579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:47 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7b8607b7-fa54-4a7c-aca4-5374f61949fb tempest-VolumesTransfersV355Test-1599633818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aa844b4-af96-4575-b319-dafc262089dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:47 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7b8607b7-fa54-4a7c-aca4-5374f61949fb tempest-VolumesTransfersV355Test-1599633818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aa844b4-af96-4575-b319-dafc262089dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:47 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7b8607b7-fa54-4a7c-aca4-5374f61949fb tempest-VolumesTransfersV355Test-1599633818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ba3d0de-b286-47f2-9588-6fafb4aad834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:47 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7b8607b7-fa54-4a7c-aca4-5374f61949fb tempest-VolumesTransfersV355Test-1599633818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ba3d0de-b286-47f2-9588-6fafb4aad834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4c6df48-e5b0-4766-a35c-0838ffaa02d3', 'volume_name': 'volume-b4c6df48-e5b0-4766-a35c-0838ffaa02d3', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:47 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7b8607b7-fa54-4a7c-aca4-5374f61949fb tempest-VolumesTransfersV355Test-1599633818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b60b223-f93f-42ce-aad7-3c6a190884d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:47 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7b8607b7-fa54-4a7c-aca4-5374f61949fb tempest-VolumesTransfersV355Test-1599633818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b60b223-f93f-42ce-aad7-3c6a190884d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7b8607b7-fa54-4a7c-aca4-5374f61949fb tempest-VolumesTransfersV355Test-1599633818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b5675c-06cb-48a5-9b8e-e0ea65b9b1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:48 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-7b8607b7-fa54-4a7c-aca4-5374f61949fb tempest-VolumesTransfersV355Test-1599633818 None] Volume b4c6df48-e5b0-4766-a35c-0838ffaa02d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4c6df48-e5b0-4766-a35c-0838ffaa02d3', 'volume_size': 1} Jul 31 10:46:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7b8607b7-fa54-4a7c-aca4-5374f61949fb tempest-VolumesTransfersV355Test-1599633818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:46:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7b8607b7-fa54-4a7c-aca4-5374f61949fb tempest-VolumesTransfersV355Test-1599633818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:46:48 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-7b8607b7-fa54-4a7c-aca4-5374f61949fb tempest-VolumesTransfersV355Test-1599633818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1335726293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4c6df48-e5b0-4766-a35c-0838ffaa02d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0155924aa0604049a0a055cab978f7bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:46:48Z,use_quota=True,user_id='9d592c81a975432da7117263e8630579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:46:48 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-7b8607b7-fa54-4a7c-aca4-5374f61949fb tempest-VolumesTransfersV355Test-1599633818 None] Creating volume b4c6df48-e5b0-4766-a35c-0838ffaa02d3 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:46:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7b8607b7-fa54-4a7c-aca4-5374f61949fb tempest-VolumesTransfersV355Test-1599633818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:46:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7b8607b7-fa54-4a7c-aca4-5374f61949fb tempest-VolumesTransfersV355Test-1599633818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:46:48 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-7b8607b7-fa54-4a7c-aca4-5374f61949fb tempest-VolumesTransfersV355Test-1599633818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:46:48 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-7b8607b7-fa54-4a7c-aca4-5374f61949fb tempest-VolumesTransfersV355Test-1599633818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:46:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7b8607b7-fa54-4a7c-aca4-5374f61949fb tempest-VolumesTransfersV355Test-1599633818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:46:48 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-7b8607b7-fa54-4a7c-aca4-5374f61949fb tempest-VolumesTransfersV355Test-1599633818 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:46:48 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-7b8607b7-fa54-4a7c-aca4-5374f61949fb tempest-VolumesTransfersV355Test-1599633818 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:46:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7b8607b7-fa54-4a7c-aca4-5374f61949fb tempest-VolumesTransfersV355Test-1599633818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b4c6df48-e5b0-4766-a35c-0838ffaa02d3 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:48 devstack sudo[97015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b4c6df48-e5b0-4766-a35c-0838ffaa02d3 1073741824 Jul 31 10:46:48 devstack sudo[97015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:48 devstack sudo[97015]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7b8607b7-fa54-4a7c-aca4-5374f61949fb tempest-VolumesTransfersV355Test-1599633818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b4c6df48-e5b0-4766-a35c-0838ffaa02d3 1073741824" returned: 0 in 0.921s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-98d57734-be25-4263-8ead-102d9d08e3ab tempest-GroupSnapshotsTest-2131484768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:46:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7b8607b7-fa54-4a7c-aca4-5374f61949fb tempest-VolumesTransfersV355Test-1599633818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b4c6df48-e5b0-4766-a35c-0838ffaa02d3 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:49 devstack sudo[97023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b4c6df48-e5b0-4766-a35c-0838ffaa02d3 Jul 31 10:46:49 devstack sudo[97023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:49 devstack sudo[97023]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7b8607b7-fa54-4a7c-aca4-5374f61949fb tempest-VolumesTransfersV355Test-1599633818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b4c6df48-e5b0-4766-a35c-0838ffaa02d3" returned: 0 in 0.407s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-7b8607b7-fa54-4a7c-aca4-5374f61949fb tempest-VolumesTransfersV355Test-1599633818 None] <== create_volume: return (1421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:46:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7b8607b7-fa54-4a7c-aca4-5374f61949fb tempest-VolumesTransfersV355Test-1599633818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.425s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:46:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-98d57734-be25-4263-8ead-102d9d08e3ab tempest-GroupSnapshotsTest-2131484768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.439s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:46:49 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-98d57734-be25-4263-8ead-102d9d08e3ab tempest-GroupSnapshotsTest-2131484768 None] Acquiring lock "cinder-quobyte-a8387036-ce45-4edb-a9e5-7b036b154c20-9704789a-3c68-471f-87e5-40c465b3d6ed" by "_create_volume_from_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:46:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7b8607b7-fa54-4a7c-aca4-5374f61949fb tempest-VolumesTransfersV355Test-1599633818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b5675c-06cb-48a5-9b8e-e0ea65b9b1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4c6df48-e5b0-4766-a35c-0838ffaa02d3', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7b8607b7-fa54-4a7c-aca4-5374f61949fb tempest-VolumesTransfersV355Test-1599633818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8db6c456-b8c4-4c66-a0b7-708323d4a203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:49 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-98d57734-be25-4263-8ead-102d9d08e3ab tempest-GroupSnapshotsTest-2131484768 None] Lock "cinder-quobyte-a8387036-ce45-4edb-a9e5-7b036b154c20-9704789a-3c68-471f-87e5-40c465b3d6ed" acquired by "_create_volume_from_snapshot" :: waited 0.052s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:46:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-98d57734-be25-4263-8ead-102d9d08e3ab tempest-GroupSnapshotsTest-2131484768 None] Creating volume 9704789a-3c68-471f-87e5-40c465b3d6ed from snapshot a8387036-ce45-4edb-a9e5-7b036b154c20 {{(pid=89090) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 10:46:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-98d57734-be25-4263-8ead-102d9d08e3ab tempest-GroupSnapshotsTest-2131484768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:46:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-98d57734-be25-4263-8ead-102d9d08e3ab tempest-GroupSnapshotsTest-2131484768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:46:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-98d57734-be25-4263-8ead-102d9d08e3ab tempest-GroupSnapshotsTest-2131484768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:46:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-98d57734-be25-4263-8ead-102d9d08e3ab tempest-GroupSnapshotsTest-2131484768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:46:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-98d57734-be25-4263-8ead-102d9d08e3ab tempest-GroupSnapshotsTest-2131484768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:46:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-98d57734-be25-4263-8ead-102d9d08e3ab tempest-GroupSnapshotsTest-2131484768 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:46:49 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-98d57734-be25-4263-8ead-102d9d08e3ab tempest-GroupSnapshotsTest-2131484768 None] Acquiring lock "cinder-quobyte-9704789a-3c68-471f-87e5-40c465b3d6ed" by "_copy_volume_from_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:46:49 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-7b8607b7-fa54-4a7c-aca4-5374f61949fb tempest-VolumesTransfersV355Test-1599633818 None] Volume volume-b4c6df48-e5b0-4766-a35c-0838ffaa02d3 (b4c6df48-e5b0-4766-a35c-0838ffaa02d3): created successfully Jul 31 10:46:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7b8607b7-fa54-4a7c-aca4-5374f61949fb tempest-VolumesTransfersV355Test-1599633818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8db6c456-b8c4-4c66-a0b7-708323d4a203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7b8607b7-fa54-4a7c-aca4-5374f61949fb tempest-VolumesTransfersV355Test-1599633818 None] Flow 'volume_create_manager' (abbc11c9-8719-4021-8e50-c88efd5a739d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:46:49 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-98d57734-be25-4263-8ead-102d9d08e3ab tempest-GroupSnapshotsTest-2131484768 None] Lock "cinder-quobyte-9704789a-3c68-471f-87e5-40c465b3d6ed" acquired by "_copy_volume_from_snapshot" :: waited 0.062s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:46:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-98d57734-be25-4263-8ead-102d9d08e3ab tempest-GroupSnapshotsTest-2131484768 None] snapshot: a8387036-ce45-4edb-a9e5-7b036b154c20, volume: 9704789a-3c68-471f-87e5-40c465b3d6ed, {{(pid=89090) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 10:46:49 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-7b8607b7-fa54-4a7c-aca4-5374f61949fb tempest-VolumesTransfersV355Test-1599633818 None] Created volume successfully. Jul 31 10:46:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-98d57734-be25-4263-8ead-102d9d08e3ab tempest-GroupSnapshotsTest-2131484768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:46:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-98d57734-be25-4263-8ead-102d9d08e3ab tempest-GroupSnapshotsTest-2131484768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:46:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-98d57734-be25-4263-8ead-102d9d08e3ab tempest-GroupSnapshotsTest-2131484768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:46:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-98d57734-be25-4263-8ead-102d9d08e3ab tempest-GroupSnapshotsTest-2131484768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:46:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-98d57734-be25-4263-8ead-102d9d08e3ab tempest-GroupSnapshotsTest-2131484768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:46:49 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[0775e1b7-d990-4edc-8507-1a7df649a067]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:46:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-98d57734-be25-4263-8ead-102d9d08e3ab tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e.a8387036-ce45-4edb-a9e5-7b036b154c20 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:49 devstack sudo[97027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e.a8387036-ce45-4edb-a9e5-7b036b154c20 Jul 31 10:46:49 devstack sudo[97027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:50 devstack sudo[97027]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-98d57734-be25-4263-8ead-102d9d08e3ab tempest-GroupSnapshotsTest-2131484768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e.a8387036-ce45-4edb-a9e5-7b036b154c20" returned: 0 in 0.576s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:50 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-98d57734-be25-4263-8ead-102d9d08e3ab tempest-GroupSnapshotsTest-2131484768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:46:50 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e03d763-3051-44c5-acd2-86c7ced67b53]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:46:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-98d57734-be25-4263-8ead-102d9d08e3ab tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:50 devstack sudo[97040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e Jul 31 10:46:50 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:50 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-98d57734-be25-4263-8ead-102d9d08e3ab tempest-GroupSnapshotsTest-2131484768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e" returned: 0 in 0.547s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:50 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-98d57734-be25-4263-8ead-102d9d08e3ab tempest-GroupSnapshotsTest-2131484768 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e {{(pid=89090) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 10:46:50 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-98d57734-be25-4263-8ead-102d9d08e3ab tempest-GroupSnapshotsTest-2131484768 None] Creating direct copy from snapshot {{(pid=89090) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 10:46:50 devstack cinder-volume[89090]: DEBUG cinder.utils [None req-98d57734-be25-4263-8ead-102d9d08e3ab tempest-GroupSnapshotsTest-2131484768 None] Path /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9704789a-3c68-471f-87e5-40c465b3d6ed not found in is_blk_device check {{(pid=89090) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 10:46:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-98d57734-be25-4263-8ead-102d9d08e3ab tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9704789a-3c68-471f-87e5-40c465b3d6ed {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:50 devstack sudo[97045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9704789a-3c68-471f-87e5-40c465b3d6ed Jul 31 10:46:50 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:51 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-0d328e1f-6f3b-4c23-a776-2f73cc997dc0 tempest-VolumesTransfersV355Test-903893991 None] Transfer volume completed successfully. Jul 31 10:46:52 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-884d97f2-6cd7-4018-a62e-a6b6832bf9f9 tempest-VolumesTransfersV355Test-1088567826 None] Acquiring lock "cinder-b4c6df48-e5b0-4766-a35c-0838ffaa02d3-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:46:53 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-884d97f2-6cd7-4018-a62e-a6b6832bf9f9 tempest-VolumesTransfersV355Test-1088567826 None] Lock "cinder-b4c6df48-e5b0-4766-a35c-0838ffaa02d3-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:46:53 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=99,cinder:UPDATE=117,cinder:DELETE=11,cinder:INSERT=23 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:46:53 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-884d97f2-6cd7-4018-a62e-a6b6832bf9f9 tempest-VolumesTransfersV355Test-1088567826 None] Acquiring lock "cinder-quobyte-b4c6df48-e5b0-4766-a35c-0838ffaa02d3" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:46:53 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-884d97f2-6cd7-4018-a62e-a6b6832bf9f9 tempest-VolumesTransfersV355Test-1088567826 None] Lock "cinder-quobyte-b4c6df48-e5b0-4766-a35c-0838ffaa02d3" acquired by "delete_volume" :: waited 0.055s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:46:53 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c4fdfc-79a7-4865-9b4e-b6d7f543c230]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:46:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-884d97f2-6cd7-4018-a62e-a6b6832bf9f9 tempest-VolumesTransfersV355Test-1088567826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b4c6df48-e5b0-4766-a35c-0838ffaa02d3 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:53 devstack sudo[97059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b4c6df48-e5b0-4766-a35c-0838ffaa02d3 Jul 31 10:46:53 devstack sudo[97059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:54 devstack sudo[97059]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-884d97f2-6cd7-4018-a62e-a6b6832bf9f9 tempest-VolumesTransfersV355Test-1088567826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b4c6df48-e5b0-4766-a35c-0838ffaa02d3" returned: 0 in 1.346s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-884d97f2-6cd7-4018-a62e-a6b6832bf9f9 tempest-VolumesTransfersV355Test-1088567826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b4c6df48-e5b0-4766-a35c-0838ffaa02d3 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:54 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b4c6df48-e5b0-4766-a35c-0838ffaa02d3 Jul 31 10:46:54 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-884d97f2-6cd7-4018-a62e-a6b6832bf9f9 tempest-VolumesTransfersV355Test-1088567826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b4c6df48-e5b0-4766-a35c-0838ffaa02d3" returned: 0 in 1.366s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:56 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:56 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-884d97f2-6cd7-4018-a62e-a6b6832bf9f9 tempest-VolumesTransfersV355Test-1088567826 None] Lock "cinder-quobyte-b4c6df48-e5b0-4766-a35c-0838ffaa02d3" released by "delete_volume" :: held 2.853s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:46:56 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-884d97f2-6cd7-4018-a62e-a6b6832bf9f9 tempest-VolumesTransfersV355Test-1088567826 None] Created reservations ['cb6c17d0-264d-4b53-8523-51e31bd85096', '24c819cb-1b9e-4ff7-949e-800233c41dac', '8d3382aa-6e05-4abc-9ed9-f94252f0e0c8', '89c72935-340e-4ea9-9802-1d83d9420f57'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:46:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-884d97f2-6cd7-4018-a62e-a6b6832bf9f9 tempest-VolumesTransfersV355Test-1088567826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:46:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-884d97f2-6cd7-4018-a62e-a6b6832bf9f9 tempest-VolumesTransfersV355Test-1088567826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:46:56 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-884d97f2-6cd7-4018-a62e-a6b6832bf9f9 tempest-VolumesTransfersV355Test-1088567826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:46:56 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-884d97f2-6cd7-4018-a62e-a6b6832bf9f9 tempest-VolumesTransfersV355Test-1088567826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:46:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-884d97f2-6cd7-4018-a62e-a6b6832bf9f9 tempest-VolumesTransfersV355Test-1088567826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:46:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-884d97f2-6cd7-4018-a62e-a6b6832bf9f9 tempest-VolumesTransfersV355Test-1088567826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:56 devstack sudo[97178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:46:56 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:56 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-884d97f2-6cd7-4018-a62e-a6b6832bf9f9 tempest-VolumesTransfersV355Test-1088567826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.437s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:56 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-884d97f2-6cd7-4018-a62e-a6b6832bf9f9 tempest-VolumesTransfersV355Test-1088567826 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:46:56 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-884d97f2-6cd7-4018-a62e-a6b6832bf9f9 tempest-VolumesTransfersV355Test-1088567826 None] Deleted volume successfully. Jul 31 10:46:56 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-884d97f2-6cd7-4018-a62e-a6b6832bf9f9 tempest-VolumesTransfersV355Test-1088567826 None] Lock "cinder-b4c6df48-e5b0-4766-a35c-0838ffaa02d3-delete_volume" released by "delete_volume" :: held 3.901s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:46:58 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-98d57734-be25-4263-8ead-102d9d08e3ab tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9704789a-3c68-471f-87e5-40c465b3d6ed" returned: 0 in 7.732s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:58 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-98d57734-be25-4263-8ead-102d9d08e3ab tempest-GroupSnapshotsTest-2131484768 None] Image conversion details: src /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e, size 1024.00 MB, duration 7.74 sec, destination /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9704789a-3c68-471f-87e5-40c465b3d6ed {{(pid=89090) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 10:46:58 devstack cinder-volume[89090]: INFO cinder.image.image_utils [None req-98d57734-be25-4263-8ead-102d9d08e3ab tempest-GroupSnapshotsTest-2131484768 None] Converted 1024.00 MB image at 132.35 MB/s Jul 31 10:46:58 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-98d57734-be25-4263-8ead-102d9d08e3ab tempest-GroupSnapshotsTest-2131484768 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9704789a-3c68-471f-87e5-40c465b3d6ed is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:46:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-98d57734-be25-4263-8ead-102d9d08e3ab tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9704789a-3c68-471f-87e5-40c465b3d6ed {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:58 devstack sudo[97243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9704789a-3c68-471f-87e5-40c465b3d6ed Jul 31 10:46:58 devstack sudo[97243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:59 devstack sudo[97243]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-98d57734-be25-4263-8ead-102d9d08e3ab tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9704789a-3c68-471f-87e5-40c465b3d6ed" returned: 0 in 0.578s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:59 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-98d57734-be25-4263-8ead-102d9d08e3ab tempest-GroupSnapshotsTest-2131484768 None] Lock "cinder-quobyte-9704789a-3c68-471f-87e5-40c465b3d6ed" released by "_copy_volume_from_snapshot" :: held 9.597s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:46:59 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:UPDATE=121,cinder:SELECT=93,cinder:INSERT=30,cinder:DELETE=9 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:46:59 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6cbf542-090f-4b80-a6d5-6afca24ad371 tempest-VolumesTransfersV355Test-1599633818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:46:59 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a6cbf542-090f-4b80-a6d5-6afca24ad371 tempest-VolumesTransfersV355Test-1599633818 None] Flow 'volume_create_manager' (85b16790-b472-4646-ab52-da30bf4688c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:46:59 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a6cbf542-090f-4b80-a6d5-6afca24ad371 tempest-VolumesTransfersV355Test-1599633818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2107751-5a3f-45eb-b28b-ad2851d1c9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:59 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-98d57734-be25-4263-8ead-102d9d08e3ab tempest-GroupSnapshotsTest-2131484768 None] Lock "cinder-quobyte-a8387036-ce45-4edb-a9e5-7b036b154c20-9704789a-3c68-471f-87e5-40c465b3d6ed" released by "_create_volume_from_snapshot" :: held 9.861s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:46:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-98d57734-be25-4263-8ead-102d9d08e3ab tempest-GroupSnapshotsTest-2131484768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.915s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:46:59 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a6cbf542-090f-4b80-a6d5-6afca24ad371 tempest-VolumesTransfersV355Test-1599633818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2107751-5a3f-45eb-b28b-ad2851d1c9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2033411497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8735c72b-e48b-48fe-affe-290bf2d7e0b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0155924aa0604049a0a055cab978f7bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:46:59Z,use_quota=True,user_id='9d592c81a975432da7117263e8630579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:59 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a6cbf542-090f-4b80-a6d5-6afca24ad371 tempest-VolumesTransfersV355Test-1599633818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2025671-0ffd-4788-bec9-3226675870b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:59 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a6cbf542-090f-4b80-a6d5-6afca24ad371 tempest-VolumesTransfersV355Test-1599633818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2025671-0ffd-4788-bec9-3226675870b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:59 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a6cbf542-090f-4b80-a6d5-6afca24ad371 tempest-VolumesTransfersV355Test-1599633818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43fabf2c-9038-4d90-a933-bbba8a2bf205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:59 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a6cbf542-090f-4b80-a6d5-6afca24ad371 tempest-VolumesTransfersV355Test-1599633818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43fabf2c-9038-4d90-a933-bbba8a2bf205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8735c72b-e48b-48fe-affe-290bf2d7e0b8', 'volume_name': 'volume-8735c72b-e48b-48fe-affe-290bf2d7e0b8', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:59 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a6cbf542-090f-4b80-a6d5-6afca24ad371 tempest-VolumesTransfersV355Test-1599633818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beab4cac-9e9d-4714-bab4-e4069e233685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:59 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a6cbf542-090f-4b80-a6d5-6afca24ad371 tempest-VolumesTransfersV355Test-1599633818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beab4cac-9e9d-4714-bab4-e4069e233685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:46:59 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a6cbf542-090f-4b80-a6d5-6afca24ad371 tempest-VolumesTransfersV355Test-1599633818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ad8c13-1cc9-47cb-b535-ba885c4354a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:46:59 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-a6cbf542-090f-4b80-a6d5-6afca24ad371 tempest-VolumesTransfersV355Test-1599633818 None] Volume 8735c72b-e48b-48fe-affe-290bf2d7e0b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8735c72b-e48b-48fe-affe-290bf2d7e0b8', 'volume_size': 1} Jul 31 10:46:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a6cbf542-090f-4b80-a6d5-6afca24ad371 tempest-VolumesTransfersV355Test-1599633818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:46:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a6cbf542-090f-4b80-a6d5-6afca24ad371 tempest-VolumesTransfersV355Test-1599633818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:46:59 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a6cbf542-090f-4b80-a6d5-6afca24ad371 tempest-VolumesTransfersV355Test-1599633818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2033411497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8735c72b-e48b-48fe-affe-290bf2d7e0b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0155924aa0604049a0a055cab978f7bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:46:59Z,use_quota=True,user_id='9d592c81a975432da7117263e8630579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:46:59 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-a6cbf542-090f-4b80-a6d5-6afca24ad371 tempest-VolumesTransfersV355Test-1599633818 None] Creating volume 8735c72b-e48b-48fe-affe-290bf2d7e0b8 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:46:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a6cbf542-090f-4b80-a6d5-6afca24ad371 tempest-VolumesTransfersV355Test-1599633818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:46:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a6cbf542-090f-4b80-a6d5-6afca24ad371 tempest-VolumesTransfersV355Test-1599633818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:46:59 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a6cbf542-090f-4b80-a6d5-6afca24ad371 tempest-VolumesTransfersV355Test-1599633818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:46:59 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a6cbf542-090f-4b80-a6d5-6afca24ad371 tempest-VolumesTransfersV355Test-1599633818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:46:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a6cbf542-090f-4b80-a6d5-6afca24ad371 tempest-VolumesTransfersV355Test-1599633818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:46:59 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a6cbf542-090f-4b80-a6d5-6afca24ad371 tempest-VolumesTransfersV355Test-1599633818 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:46:59 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-a6cbf542-090f-4b80-a6d5-6afca24ad371 tempest-VolumesTransfersV355Test-1599633818 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:46:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a6cbf542-090f-4b80-a6d5-6afca24ad371 tempest-VolumesTransfersV355Test-1599633818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8735c72b-e48b-48fe-affe-290bf2d7e0b8 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:59 devstack sudo[97595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8735c72b-e48b-48fe-affe-290bf2d7e0b8 1073741824 Jul 31 10:46:59 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:59 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-98d57734-be25-4263-8ead-102d9d08e3ab tempest-GroupSnapshotsTest-2131484768 None] Create group from source-snapshot-d81940a4-ad4c-41c9-903a-d493c0bbf05f completed successfully. Jul 31 10:47:00 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a6cbf542-090f-4b80-a6d5-6afca24ad371 tempest-VolumesTransfersV355Test-1599633818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8735c72b-e48b-48fe-affe-290bf2d7e0b8 1073741824" returned: 0 in 0.781s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a6cbf542-090f-4b80-a6d5-6afca24ad371 tempest-VolumesTransfersV355Test-1599633818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8735c72b-e48b-48fe-affe-290bf2d7e0b8 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:00 devstack sudo[97626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8735c72b-e48b-48fe-affe-290bf2d7e0b8 Jul 31 10:47:00 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:00 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-c0e54fff-0217-4827-bf79-01a49057294e tempest-GroupSnapshotsTest-2131484768 None] Acquiring lock "cinder-quobyte-9704789a-3c68-471f-87e5-40c465b3d6ed" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:47:00 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-c0e54fff-0217-4827-bf79-01a49057294e tempest-GroupSnapshotsTest-2131484768 None] Lock "cinder-quobyte-9704789a-3c68-471f-87e5-40c465b3d6ed" acquired by "delete_volume" :: waited 0.045s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:47:00 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e3d865-d091-4415-86c5-c15a83298666]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:47:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c0e54fff-0217-4827-bf79-01a49057294e tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9704789a-3c68-471f-87e5-40c465b3d6ed {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:00 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a6cbf542-090f-4b80-a6d5-6afca24ad371 tempest-VolumesTransfersV355Test-1599633818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8735c72b-e48b-48fe-affe-290bf2d7e0b8" returned: 0 in 0.547s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:00 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a6cbf542-090f-4b80-a6d5-6afca24ad371 tempest-VolumesTransfersV355Test-1599633818 None] <== create_volume: return (1397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:47:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a6cbf542-090f-4b80-a6d5-6afca24ad371 tempest-VolumesTransfersV355Test-1599633818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:47:00 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a6cbf542-090f-4b80-a6d5-6afca24ad371 tempest-VolumesTransfersV355Test-1599633818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ad8c13-1cc9-47cb-b535-ba885c4354a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8735c72b-e48b-48fe-affe-290bf2d7e0b8', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:00 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a6cbf542-090f-4b80-a6d5-6afca24ad371 tempest-VolumesTransfersV355Test-1599633818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7bd10ee-bf26-4e53-88de-19b22c9c9446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:00 devstack sudo[97639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9704789a-3c68-471f-87e5-40c465b3d6ed Jul 31 10:47:00 devstack sudo[97639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:00 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-a6cbf542-090f-4b80-a6d5-6afca24ad371 tempest-VolumesTransfersV355Test-1599633818 None] Volume volume-8735c72b-e48b-48fe-affe-290bf2d7e0b8 (8735c72b-e48b-48fe-affe-290bf2d7e0b8): created successfully Jul 31 10:47:01 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a6cbf542-090f-4b80-a6d5-6afca24ad371 tempest-VolumesTransfersV355Test-1599633818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7bd10ee-bf26-4e53-88de-19b22c9c9446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:01 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a6cbf542-090f-4b80-a6d5-6afca24ad371 tempest-VolumesTransfersV355Test-1599633818 None] Flow 'volume_create_manager' (85b16790-b472-4646-ab52-da30bf4688c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:47:01 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-a6cbf542-090f-4b80-a6d5-6afca24ad371 tempest-VolumesTransfersV355Test-1599633818 None] Created volume successfully. Jul 31 10:47:01 devstack sudo[97639]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c0e54fff-0217-4827-bf79-01a49057294e tempest-GroupSnapshotsTest-2131484768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9704789a-3c68-471f-87e5-40c465b3d6ed" returned: 0 in 0.606s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c0e54fff-0217-4827-bf79-01a49057294e tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9704789a-3c68-471f-87e5-40c465b3d6ed {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:01 devstack sudo[97653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9704789a-3c68-471f-87e5-40c465b3d6ed Jul 31 10:47:01 devstack sudo[97653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:01 devstack sudo[97653]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c0e54fff-0217-4827-bf79-01a49057294e tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9704789a-3c68-471f-87e5-40c465b3d6ed" returned: 0 in 0.379s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:01 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-c0e54fff-0217-4827-bf79-01a49057294e tempest-GroupSnapshotsTest-2131484768 None] Lock "cinder-quobyte-9704789a-3c68-471f-87e5-40c465b3d6ed" released by "delete_volume" :: held 1.083s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:47:01 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-c0e54fff-0217-4827-bf79-01a49057294e tempest-GroupSnapshotsTest-2131484768 None] Created reservations ['03967609-e8ab-4ce8-a47f-b459873b98f1'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:47:01 devstack cinder-volume[89090]: WARNING cinder.quota [None req-c0e54fff-0217-4827-bf79-01a49057294e tempest-GroupSnapshotsTest-2131484768 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-709601897 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-709601897, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:47:01 devstack cinder-volume[89090]: WARNING cinder.quota [None req-c0e54fff-0217-4827-bf79-01a49057294e tempest-GroupSnapshotsTest-2131484768 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-709601897 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-709601897, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:47:01 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-c0e54fff-0217-4827-bf79-01a49057294e tempest-GroupSnapshotsTest-2131484768 None] Created reservations ['72938f7f-6562-42ef-8243-71543d1ccf1c', 'f73547b1-9827-4f8b-a96c-337f1eb4f140', 'f0b980b2-b89d-46db-b5ef-3ddb28cbfd9a', '2a4921fd-1bf3-4dcc-bc66-8d7cf0a1650d'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:47:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c0e54fff-0217-4827-bf79-01a49057294e tempest-GroupSnapshotsTest-2131484768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:47:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c0e54fff-0217-4827-bf79-01a49057294e tempest-GroupSnapshotsTest-2131484768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:47:02 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c0e54fff-0217-4827-bf79-01a49057294e tempest-GroupSnapshotsTest-2131484768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:47:02 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c0e54fff-0217-4827-bf79-01a49057294e tempest-GroupSnapshotsTest-2131484768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:47:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c0e54fff-0217-4827-bf79-01a49057294e tempest-GroupSnapshotsTest-2131484768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:47:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c0e54fff-0217-4827-bf79-01a49057294e tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:02 devstack sudo[97658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:47:02 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:02 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-df1a92e1-aa52-4413-ae10-0a490bac609f tempest-GroupSnapshotsTest-2131484768 None] group_snapshot d81940a4-ad4c-41c9-903a-d493c0bbf05f: deleting Jul 31 10:47:02 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c0e54fff-0217-4827-bf79-01a49057294e tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.523s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:02 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-c0e54fff-0217-4827-bf79-01a49057294e tempest-GroupSnapshotsTest-2131484768 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:47:02 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-c0e54fff-0217-4827-bf79-01a49057294e tempest-GroupSnapshotsTest-2131484768 None] Delete group completed successfully. Jul 31 10:47:02 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-80139429-7dd7-4dd6-aad6-282025df78c7 tempest-VolumesTransfersV355Test-1088567826 None] Acquiring lock "cinder-8735c72b-e48b-48fe-affe-290bf2d7e0b8-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:47:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-df1a92e1-aa52-4413-ae10-0a490bac609f tempest-GroupSnapshotsTest-2131484768 None] group_snapshot d81940a4-ad4c-41c9-903a-d493c0bbf05f: deleting {{(pid=89090) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 31 10:47:02 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-80139429-7dd7-4dd6-aad6-282025df78c7 tempest-VolumesTransfersV355Test-1088567826 None] Lock "cinder-8735c72b-e48b-48fe-affe-290bf2d7e0b8-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:47:02 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-df1a92e1-aa52-4413-ae10-0a490bac609f tempest-GroupSnapshotsTest-2131484768 None] Acquiring lock "cinder-quobyte-1c70d74b-42f8-4803-b939-f560ebe2ee3e" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:47:03 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-df1a92e1-aa52-4413-ae10-0a490bac609f tempest-GroupSnapshotsTest-2131484768 None] Lock "cinder-quobyte-1c70d74b-42f8-4803-b939-f560ebe2ee3e" acquired by "delete_snapshot" :: waited 0.031s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:47:03 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-df1a92e1-aa52-4413-ae10-0a490bac609f tempest-GroupSnapshotsTest-2131484768 None] Acquiring lock "cinder-quobyte-a8387036-ce45-4edb-a9e5-7b036b154c20" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:47:03 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-80139429-7dd7-4dd6-aad6-282025df78c7 tempest-VolumesTransfersV355Test-1088567826 None] Acquiring lock "cinder-quobyte-8735c72b-e48b-48fe-affe-290bf2d7e0b8" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:47:03 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-df1a92e1-aa52-4413-ae10-0a490bac609f tempest-GroupSnapshotsTest-2131484768 None] Lock "cinder-quobyte-a8387036-ce45-4edb-a9e5-7b036b154c20" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:47:03 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-df1a92e1-aa52-4413-ae10-0a490bac609f tempest-GroupSnapshotsTest-2131484768 None] Deleting offline snapshot a8387036-ce45-4edb-a9e5-7b036b154c20 of volume 1c70d74b-42f8-4803-b939-f560ebe2ee3e {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:47:03 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-df1a92e1-aa52-4413-ae10-0a490bac609f tempest-GroupSnapshotsTest-2131484768 None] snapshot_file for this snap is: volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e.a8387036-ce45-4edb-a9e5-7b036b154c20 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:47:03 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-80139429-7dd7-4dd6-aad6-282025df78c7 tempest-VolumesTransfersV355Test-1088567826 None] Lock "cinder-quobyte-8735c72b-e48b-48fe-affe-290bf2d7e0b8" acquired by "delete_volume" :: waited 0.053s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:47:03 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a12c861-a390-4646-9b3b-bea0b0f3c990]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:47:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-df1a92e1-aa52-4413-ae10-0a490bac609f tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e.a8387036-ce45-4edb-a9e5-7b036b154c20 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:03 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cb6306-fb39-40a0-affb-1d1e9eddbe2c]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:47:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-80139429-7dd7-4dd6-aad6-282025df78c7 tempest-VolumesTransfersV355Test-1088567826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8735c72b-e48b-48fe-affe-290bf2d7e0b8 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:03 devstack sudo[97661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e.a8387036-ce45-4edb-a9e5-7b036b154c20 Jul 31 10:47:03 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:03 devstack sudo[97662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8735c72b-e48b-48fe-affe-290bf2d7e0b8 Jul 31 10:47:03 devstack sudo[97662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:03 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-df1a92e1-aa52-4413-ae10-0a490bac609f tempest-GroupSnapshotsTest-2131484768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e.a8387036-ce45-4edb-a9e5-7b036b154c20" returned: 0 in 0.698s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:03 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-df1a92e1-aa52-4413-ae10-0a490bac609f tempest-GroupSnapshotsTest-2131484768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:47:03 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44f4e70-cd55-4ea2-a36a-4643b40dd0d9]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:47:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-df1a92e1-aa52-4413-ae10-0a490bac609f tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:03 devstack sudo[97662]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-80139429-7dd7-4dd6-aad6-282025df78c7 tempest-VolumesTransfersV355Test-1088567826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8735c72b-e48b-48fe-affe-290bf2d7e0b8" returned: 0 in 0.741s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-80139429-7dd7-4dd6-aad6-282025df78c7 tempest-VolumesTransfersV355Test-1088567826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8735c72b-e48b-48fe-affe-290bf2d7e0b8 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:03 devstack sudo[97674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8735c72b-e48b-48fe-affe-290bf2d7e0b8 Jul 31 10:47:03 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:04 devstack sudo[97673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e Jul 31 10:47:04 devstack sudo[97673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:04 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-80139429-7dd7-4dd6-aad6-282025df78c7 tempest-VolumesTransfersV355Test-1088567826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8735c72b-e48b-48fe-affe-290bf2d7e0b8" returned: 0 in 0.471s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:04 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-80139429-7dd7-4dd6-aad6-282025df78c7 tempest-VolumesTransfersV355Test-1088567826 None] Lock "cinder-quobyte-8735c72b-e48b-48fe-affe-290bf2d7e0b8" released by "delete_volume" :: held 1.371s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:47:04 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-80139429-7dd7-4dd6-aad6-282025df78c7 tempest-VolumesTransfersV355Test-1088567826 None] Created reservations ['ca59d9cb-7ea4-4299-9395-c12903d12150', '0053d4f7-96ba-4be1-90fa-9d9141f6b10c', '9442cbb3-0609-448c-8d26-e886eb3d9a28', '550a0f28-f3ed-4e03-b9db-44d7d899d71c'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:47:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-80139429-7dd7-4dd6-aad6-282025df78c7 tempest-VolumesTransfersV355Test-1088567826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:47:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-80139429-7dd7-4dd6-aad6-282025df78c7 tempest-VolumesTransfersV355Test-1088567826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:47:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-80139429-7dd7-4dd6-aad6-282025df78c7 tempest-VolumesTransfersV355Test-1088567826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:47:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-80139429-7dd7-4dd6-aad6-282025df78c7 tempest-VolumesTransfersV355Test-1088567826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:47:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-80139429-7dd7-4dd6-aad6-282025df78c7 tempest-VolumesTransfersV355Test-1088567826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:47:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-80139429-7dd7-4dd6-aad6-282025df78c7 tempest-VolumesTransfersV355Test-1088567826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:04 devstack sudo[97681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:47:04 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:04 devstack sudo[97673]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-df1a92e1-aa52-4413-ae10-0a490bac609f tempest-GroupSnapshotsTest-2131484768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e" returned: 0 in 1.009s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-df1a92e1-aa52-4413-ae10-0a490bac609f tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e.a8387036-ce45-4edb-a9e5-7b036b154c20 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:04 devstack sudo[97684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e.a8387036-ce45-4edb-a9e5-7b036b154c20 Jul 31 10:47:04 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:05 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-80139429-7dd7-4dd6-aad6-282025df78c7 tempest-VolumesTransfersV355Test-1088567826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.448s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:05 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-80139429-7dd7-4dd6-aad6-282025df78c7 tempest-VolumesTransfersV355Test-1088567826 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:47:05 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-80139429-7dd7-4dd6-aad6-282025df78c7 tempest-VolumesTransfersV355Test-1088567826 None] Deleted volume successfully. Jul 31 10:47:05 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-80139429-7dd7-4dd6-aad6-282025df78c7 tempest-VolumesTransfersV355Test-1088567826 None] Lock "cinder-8735c72b-e48b-48fe-affe-290bf2d7e0b8-delete_volume" released by "delete_volume" :: held 2.305s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:47:05 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-df1a92e1-aa52-4413-ae10-0a490bac609f tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e.a8387036-ce45-4edb-a9e5-7b036b154c20" returned: 0 in 0.593s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-df1a92e1-aa52-4413-ae10-0a490bac609f tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e.a8387036-ce45-4edb-a9e5-7b036b154c20 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:05 devstack sudo[97691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e.a8387036-ce45-4edb-a9e5-7b036b154c20 Jul 31 10:47:05 devstack sudo[97691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:05 devstack sudo[97691]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-df1a92e1-aa52-4413-ae10-0a490bac609f tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e.a8387036-ce45-4edb-a9e5-7b036b154c20" returned: 0 in 0.359s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:05 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-df1a92e1-aa52-4413-ae10-0a490bac609f tempest-GroupSnapshotsTest-2131484768 None] Lock "cinder-quobyte-a8387036-ce45-4edb-a9e5-7b036b154c20" released by "_delete_snapshot" :: held 2.861s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:47:05 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-df1a92e1-aa52-4413-ae10-0a490bac609f tempest-GroupSnapshotsTest-2131484768 None] Lock "cinder-quobyte-1c70d74b-42f8-4803-b939-f560ebe2ee3e" released by "delete_snapshot" :: held 2.913s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:47:06 devstack cinder-volume[89090]: WARNING cinder.quota [None req-df1a92e1-aa52-4413-ae10-0a490bac609f tempest-GroupSnapshotsTest-2131484768 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-709601897 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-709601897, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:47:06 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-df1a92e1-aa52-4413-ae10-0a490bac609f tempest-GroupSnapshotsTest-2131484768 None] Created reservations ['4bf581dd-bf5b-4ce8-925c-6b4e4062b67e', '286b6537-c101-41d4-af7e-bcaba60fd995', '49658125-f669-4b4f-ac2a-4e28d57afd2d', '27eb637c-d253-4fcb-9a92-d97275098280'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:47:06 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-df1a92e1-aa52-4413-ae10-0a490bac609f tempest-GroupSnapshotsTest-2131484768 None] group_snapshot d81940a4-ad4c-41c9-903a-d493c0bbf05f: deleted successfully Jul 31 10:47:06 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-35f3b9f6-570c-4936-bf3d-59c0a0dcf7e4 tempest-GroupSnapshotsTest-2131484768 None] Acquiring lock "cinder-quobyte-1c70d74b-42f8-4803-b939-f560ebe2ee3e" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:47:06 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-35f3b9f6-570c-4936-bf3d-59c0a0dcf7e4 tempest-GroupSnapshotsTest-2131484768 None] Lock "cinder-quobyte-1c70d74b-42f8-4803-b939-f560ebe2ee3e" acquired by "delete_volume" :: waited 0.044s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:47:07 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa2294e-dffe-457b-a234-2d00f279ccb9]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:47:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-35f3b9f6-570c-4936-bf3d-59c0a0dcf7e4 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:07 devstack sudo[97694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e Jul 31 10:47:07 devstack sudo[97694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:07 devstack sudo[97694]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-35f3b9f6-570c-4936-bf3d-59c0a0dcf7e4 tempest-GroupSnapshotsTest-2131484768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e" returned: 0 in 0.703s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-35f3b9f6-570c-4936-bf3d-59c0a0dcf7e4 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:07 devstack sudo[97700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e Jul 31 10:47:07 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:08 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-35f3b9f6-570c-4936-bf3d-59c0a0dcf7e4 tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c70d74b-42f8-4803-b939-f560ebe2ee3e" returned: 0 in 0.593s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:08 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-35f3b9f6-570c-4936-bf3d-59c0a0dcf7e4 tempest-GroupSnapshotsTest-2131484768 None] Lock "cinder-quobyte-1c70d74b-42f8-4803-b939-f560ebe2ee3e" released by "delete_volume" :: held 1.420s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:47:08 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-35f3b9f6-570c-4936-bf3d-59c0a0dcf7e4 tempest-GroupSnapshotsTest-2131484768 None] Created reservations ['43ad1ccb-b143-4bb5-8318-c8ad1f7e1bd6'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:47:08 devstack cinder-volume[89090]: WARNING cinder.db.api [None req-35f3b9f6-570c-4936-bf3d-59c0a0dcf7e4 tempest-GroupSnapshotsTest-2131484768 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-709601897'] Jul 31 10:47:08 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-35f3b9f6-570c-4936-bf3d-59c0a0dcf7e4 tempest-GroupSnapshotsTest-2131484768 None] Created reservations ['bab04a61-b199-45a9-a717-1d1adb04d56b', 'bf2670b8-80e4-40ce-9e69-aa4b81660ff1', '8670c69a-ac47-4c5e-a9be-e4afea10390e', '7ec19510-3682-40f0-b9cd-c09043e4ef4a'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:47:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-35f3b9f6-570c-4936-bf3d-59c0a0dcf7e4 tempest-GroupSnapshotsTest-2131484768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:47:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-35f3b9f6-570c-4936-bf3d-59c0a0dcf7e4 tempest-GroupSnapshotsTest-2131484768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:47:08 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-35f3b9f6-570c-4936-bf3d-59c0a0dcf7e4 tempest-GroupSnapshotsTest-2131484768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:47:08 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-35f3b9f6-570c-4936-bf3d-59c0a0dcf7e4 tempest-GroupSnapshotsTest-2131484768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:47:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-35f3b9f6-570c-4936-bf3d-59c0a0dcf7e4 tempest-GroupSnapshotsTest-2131484768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:47:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-35f3b9f6-570c-4936-bf3d-59c0a0dcf7e4 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:08 devstack sudo[97703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:47:08 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:09 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-35f3b9f6-570c-4936-bf3d-59c0a0dcf7e4 tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.387s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:09 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-35f3b9f6-570c-4936-bf3d-59c0a0dcf7e4 tempest-GroupSnapshotsTest-2131484768 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:47:09 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-35f3b9f6-570c-4936-bf3d-59c0a0dcf7e4 tempest-GroupSnapshotsTest-2131484768 None] Delete group completed successfully. Jul 31 10:47:10 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-f9e4d9cb-2552-49c0-a6e6-17a2dc6ee28b tempest-GroupSnapshotsTest-2131484768 None] Group tempest-GroupSnapshotsTest-Group-671378016: creating Jul 31 10:47:10 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-f9e4d9cb-2552-49c0-a6e6-17a2dc6ee28b tempest-GroupSnapshotsTest-2131484768 None] Group tempest-GroupSnapshotsTest-Group-671378016: created successfully Jul 31 10:47:10 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-f9e4d9cb-2552-49c0-a6e6-17a2dc6ee28b tempest-GroupSnapshotsTest-2131484768 None] Create group completed successfully. Jul 31 10:47:12 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ae8b7a7-09cd-4439-8336-777856d9e0b4 tempest-GroupSnapshotsTest-2131484768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:47:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-5ae8b7a7-09cd-4439-8336-777856d9e0b4 tempest-GroupSnapshotsTest-2131484768 None] Flow 'volume_create_manager' (38794ed9-0852-4251-a2f9-bc5b623cd1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:47:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-5ae8b7a7-09cd-4439-8336-777856d9e0b4 tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c845f03c-e1c0-4a3b-a059-fe22688b21c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-5ae8b7a7-09cd-4439-8336-777856d9e0b4 tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c845f03c-e1c0-4a3b-a059-fe22688b21c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1833151680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bb22f714-bf99-4010-a08a-bce7ebf480c4,host='devstack@QuobyteHD#QuobyteHD',id=a64e86bb-714d-437e-b810-8179e67cf330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a49b0bd02504a06938e9e136a84d940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:47:12Z,use_quota=True,user_id='35a7d721ee5042f08dd9bc7cf1f3a1cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34651041-012d-4cbc-be16-288c533a6d15),volume_type_id=34651041-012d-4cbc-be16-288c533a6d15)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-5ae8b7a7-09cd-4439-8336-777856d9e0b4 tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23852a96-417f-4287-a836-abe6ff67c9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-5ae8b7a7-09cd-4439-8336-777856d9e0b4 tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23852a96-417f-4287-a836-abe6ff67c9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-5ae8b7a7-09cd-4439-8336-777856d9e0b4 tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f6cfe88-3853-48a9-96c0-2c93c84ef58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-5ae8b7a7-09cd-4439-8336-777856d9e0b4 tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f6cfe88-3853-48a9-96c0-2c93c84ef58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a64e86bb-714d-437e-b810-8179e67cf330', 'volume_name': 'volume-a64e86bb-714d-437e-b810-8179e67cf330', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-5ae8b7a7-09cd-4439-8336-777856d9e0b4 tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bad8b55-6544-4569-9953-228475710725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-5ae8b7a7-09cd-4439-8336-777856d9e0b4 tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bad8b55-6544-4569-9953-228475710725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-5ae8b7a7-09cd-4439-8336-777856d9e0b4 tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c52234f-eb9b-4c9a-b305-eee90799ec54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:12 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-5ae8b7a7-09cd-4439-8336-777856d9e0b4 tempest-GroupSnapshotsTest-2131484768 None] Volume a64e86bb-714d-437e-b810-8179e67cf330: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a64e86bb-714d-437e-b810-8179e67cf330', 'volume_size': 1} Jul 31 10:47:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-5ae8b7a7-09cd-4439-8336-777856d9e0b4 tempest-GroupSnapshotsTest-2131484768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:47:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-5ae8b7a7-09cd-4439-8336-777856d9e0b4 tempest-GroupSnapshotsTest-2131484768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:47:12 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-5ae8b7a7-09cd-4439-8336-777856d9e0b4 tempest-GroupSnapshotsTest-2131484768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bb22f714-bf99-4010-a08a-bce7ebf480c4,created_at=2026-07-31T08:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1833151680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bb22f714-bf99-4010-a08a-bce7ebf480c4,host='devstack@QuobyteHD#QuobyteHD',id=a64e86bb-714d-437e-b810-8179e67cf330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a49b0bd02504a06938e9e136a84d940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:47:12Z,use_quota=True,user_id='35a7d721ee5042f08dd9bc7cf1f3a1cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34651041-012d-4cbc-be16-288c533a6d15),volume_type_id=34651041-012d-4cbc-be16-288c533a6d15)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:47:12 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-5ae8b7a7-09cd-4439-8336-777856d9e0b4 tempest-GroupSnapshotsTest-2131484768 None] Creating volume a64e86bb-714d-437e-b810-8179e67cf330 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:47:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-5ae8b7a7-09cd-4439-8336-777856d9e0b4 tempest-GroupSnapshotsTest-2131484768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:47:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-5ae8b7a7-09cd-4439-8336-777856d9e0b4 tempest-GroupSnapshotsTest-2131484768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:47:12 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-5ae8b7a7-09cd-4439-8336-777856d9e0b4 tempest-GroupSnapshotsTest-2131484768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:47:12 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-5ae8b7a7-09cd-4439-8336-777856d9e0b4 tempest-GroupSnapshotsTest-2131484768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:47:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-5ae8b7a7-09cd-4439-8336-777856d9e0b4 tempest-GroupSnapshotsTest-2131484768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:47:12 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-5ae8b7a7-09cd-4439-8336-777856d9e0b4 tempest-GroupSnapshotsTest-2131484768 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:47:12 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-5ae8b7a7-09cd-4439-8336-777856d9e0b4 tempest-GroupSnapshotsTest-2131484768 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:47:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5ae8b7a7-09cd-4439-8336-777856d9e0b4 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:12 devstack sudo[97712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330 1073741824 Jul 31 10:47:12 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:13 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5ae8b7a7-09cd-4439-8336-777856d9e0b4 tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330 1073741824" returned: 0 in 0.782s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5ae8b7a7-09cd-4439-8336-777856d9e0b4 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:13 devstack sudo[97718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330 Jul 31 10:47:13 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:14 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5ae8b7a7-09cd-4439-8336-777856d9e0b4 tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330" returned: 0 in 0.623s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:14 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-5ae8b7a7-09cd-4439-8336-777856d9e0b4 tempest-GroupSnapshotsTest-2131484768 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:47:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-5ae8b7a7-09cd-4439-8336-777856d9e0b4 tempest-GroupSnapshotsTest-2131484768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:47:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-5ae8b7a7-09cd-4439-8336-777856d9e0b4 tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c52234f-eb9b-4c9a-b305-eee90799ec54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a64e86bb-714d-437e-b810-8179e67cf330', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-5ae8b7a7-09cd-4439-8336-777856d9e0b4 tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a960fb20-f179-488e-b2e8-12ca810b10c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:14 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-5ae8b7a7-09cd-4439-8336-777856d9e0b4 tempest-GroupSnapshotsTest-2131484768 None] Volume volume-a64e86bb-714d-437e-b810-8179e67cf330 (a64e86bb-714d-437e-b810-8179e67cf330): created successfully Jul 31 10:47:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-5ae8b7a7-09cd-4439-8336-777856d9e0b4 tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a960fb20-f179-488e-b2e8-12ca810b10c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-5ae8b7a7-09cd-4439-8336-777856d9e0b4 tempest-GroupSnapshotsTest-2131484768 None] Flow 'volume_create_manager' (38794ed9-0852-4251-a2f9-bc5b623cd1fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:47:14 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-5ae8b7a7-09cd-4439-8336-777856d9e0b4 tempest-GroupSnapshotsTest-2131484768 None] Created volume successfully. Jul 31 10:47:16 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef6ffd68-3350-44fa-a047-4170b7dc1009 tempest-GroupSnapshotsTest-2131484768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:47:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ef6ffd68-3350-44fa-a047-4170b7dc1009 tempest-GroupSnapshotsTest-2131484768 None] Flow 'volume_create_manager' (443c2f1b-dc84-4f89-a859-62f3b0c07965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:47:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ef6ffd68-3350-44fa-a047-4170b7dc1009 tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e378a839-21a9-4669-8643-aa9ed87b2182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ef6ffd68-3350-44fa-a047-4170b7dc1009 tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e378a839-21a9-4669-8643-aa9ed87b2182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-594195917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bb22f714-bf99-4010-a08a-bce7ebf480c4,host='devstack@QuobyteHD#QuobyteHD',id=81b4fc81-1c42-4d7d-ab63-225fd3d379d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a49b0bd02504a06938e9e136a84d940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:47:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:47:16Z,use_quota=True,user_id='35a7d721ee5042f08dd9bc7cf1f3a1cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34651041-012d-4cbc-be16-288c533a6d15),volume_type_id=34651041-012d-4cbc-be16-288c533a6d15)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ef6ffd68-3350-44fa-a047-4170b7dc1009 tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7548595b-2ae6-44c7-bf38-ef4398649195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ef6ffd68-3350-44fa-a047-4170b7dc1009 tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7548595b-2ae6-44c7-bf38-ef4398649195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ef6ffd68-3350-44fa-a047-4170b7dc1009 tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231120cb-e24f-4394-8791-9a8581df9c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ef6ffd68-3350-44fa-a047-4170b7dc1009 tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231120cb-e24f-4394-8791-9a8581df9c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81b4fc81-1c42-4d7d-ab63-225fd3d379d7', 'volume_name': 'volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ef6ffd68-3350-44fa-a047-4170b7dc1009 tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cf1f8a6-7df7-44d9-90f2-cb7658998926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ef6ffd68-3350-44fa-a047-4170b7dc1009 tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cf1f8a6-7df7-44d9-90f2-cb7658998926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ef6ffd68-3350-44fa-a047-4170b7dc1009 tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aafa294-1d6e-4407-8bfe-7e25337d6cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:16 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-ef6ffd68-3350-44fa-a047-4170b7dc1009 tempest-GroupSnapshotsTest-2131484768 None] Volume 81b4fc81-1c42-4d7d-ab63-225fd3d379d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7', 'volume_size': 1} Jul 31 10:47:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ef6ffd68-3350-44fa-a047-4170b7dc1009 tempest-GroupSnapshotsTest-2131484768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:47:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ef6ffd68-3350-44fa-a047-4170b7dc1009 tempest-GroupSnapshotsTest-2131484768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:47:16 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ef6ffd68-3350-44fa-a047-4170b7dc1009 tempest-GroupSnapshotsTest-2131484768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bb22f714-bf99-4010-a08a-bce7ebf480c4,created_at=2026-07-31T08:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-594195917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bb22f714-bf99-4010-a08a-bce7ebf480c4,host='devstack@QuobyteHD#QuobyteHD',id=81b4fc81-1c42-4d7d-ab63-225fd3d379d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a49b0bd02504a06938e9e136a84d940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:47:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:47:16Z,use_quota=True,user_id='35a7d721ee5042f08dd9bc7cf1f3a1cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34651041-012d-4cbc-be16-288c533a6d15),volume_type_id=34651041-012d-4cbc-be16-288c533a6d15)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:47:16 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-ef6ffd68-3350-44fa-a047-4170b7dc1009 tempest-GroupSnapshotsTest-2131484768 None] Creating volume 81b4fc81-1c42-4d7d-ab63-225fd3d379d7 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:47:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ef6ffd68-3350-44fa-a047-4170b7dc1009 tempest-GroupSnapshotsTest-2131484768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:47:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ef6ffd68-3350-44fa-a047-4170b7dc1009 tempest-GroupSnapshotsTest-2131484768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:47:16 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ef6ffd68-3350-44fa-a047-4170b7dc1009 tempest-GroupSnapshotsTest-2131484768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:47:16 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ef6ffd68-3350-44fa-a047-4170b7dc1009 tempest-GroupSnapshotsTest-2131484768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:47:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ef6ffd68-3350-44fa-a047-4170b7dc1009 tempest-GroupSnapshotsTest-2131484768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:47:16 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ef6ffd68-3350-44fa-a047-4170b7dc1009 tempest-GroupSnapshotsTest-2131484768 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:47:16 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-ef6ffd68-3350-44fa-a047-4170b7dc1009 tempest-GroupSnapshotsTest-2131484768 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:47:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ef6ffd68-3350-44fa-a047-4170b7dc1009 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:16 devstack sudo[97765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7 1073741824 Jul 31 10:47:16 devstack sudo[97765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:17 devstack sudo[97765]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ef6ffd68-3350-44fa-a047-4170b7dc1009 tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7 1073741824" returned: 0 in 0.671s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ef6ffd68-3350-44fa-a047-4170b7dc1009 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:17 devstack sudo[97770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7 Jul 31 10:47:17 devstack sudo[97770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:17 devstack sudo[97770]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ef6ffd68-3350-44fa-a047-4170b7dc1009 tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7" returned: 0 in 0.362s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:17 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ef6ffd68-3350-44fa-a047-4170b7dc1009 tempest-GroupSnapshotsTest-2131484768 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:47:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ef6ffd68-3350-44fa-a047-4170b7dc1009 tempest-GroupSnapshotsTest-2131484768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:47:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ef6ffd68-3350-44fa-a047-4170b7dc1009 tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aafa294-1d6e-4407-8bfe-7e25337d6cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ef6ffd68-3350-44fa-a047-4170b7dc1009 tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6da84beb-b65e-4783-83a4-8779c1c2f355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:17 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-ef6ffd68-3350-44fa-a047-4170b7dc1009 tempest-GroupSnapshotsTest-2131484768 None] Volume volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7 (81b4fc81-1c42-4d7d-ab63-225fd3d379d7): created successfully Jul 31 10:47:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ef6ffd68-3350-44fa-a047-4170b7dc1009 tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6da84beb-b65e-4783-83a4-8779c1c2f355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ef6ffd68-3350-44fa-a047-4170b7dc1009 tempest-GroupSnapshotsTest-2131484768 None] Flow 'volume_create_manager' (443c2f1b-dc84-4f89-a859-62f3b0c07965) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:47:17 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-ef6ffd68-3350-44fa-a047-4170b7dc1009 tempest-GroupSnapshotsTest-2131484768 None] Created volume successfully. Jul 31 10:47:18 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-10e61bc6-3049-4730-a9f5-e88c5a21e814 tempest-GroupSnapshotsTest-2131484768 None] Update group completed successfully. Jul 31 10:47:20 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-df9367e5-bf32-465a-97c4-a99a7230f29c tempest-GroupSnapshotsTest-2131484768 None] Update group completed successfully. Jul 31 10:47:20 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c5018c5-9c14-40e4-9107-8e94ef5f2680 tempest-VolumesTransfersV357Test-938518850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:47:20 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-5c5018c5-9c14-40e4-9107-8e94ef5f2680 tempest-VolumesTransfersV357Test-938518850 None] Flow 'volume_create_manager' (683ed4bd-f16e-41e1-a02e-322dc13f7306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:47:20 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-5c5018c5-9c14-40e4-9107-8e94ef5f2680 tempest-VolumesTransfersV357Test-938518850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2453d6a-1fb6-4c84-a427-667f368189d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:20 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-5c5018c5-9c14-40e4-9107-8e94ef5f2680 tempest-VolumesTransfersV357Test-938518850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2453d6a-1fb6-4c84-a427-667f368189d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1312382480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab10c0be-b9b7-4001-aa1a-7cafe651d5bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc509e7d5904476acf3550f4292a12a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:47:20Z,use_quota=True,user_id='bf323422cd39439cb79889bc3155d07f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:20 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-5c5018c5-9c14-40e4-9107-8e94ef5f2680 tempest-VolumesTransfersV357Test-938518850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01bcaeae-8a82-4e67-baf0-2fd405fdcc01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:20 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-5c5018c5-9c14-40e4-9107-8e94ef5f2680 tempest-VolumesTransfersV357Test-938518850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01bcaeae-8a82-4e67-baf0-2fd405fdcc01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:20 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-5c5018c5-9c14-40e4-9107-8e94ef5f2680 tempest-VolumesTransfersV357Test-938518850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5711662f-5654-4219-845c-48a7dffbd2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:20 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-5c5018c5-9c14-40e4-9107-8e94ef5f2680 tempest-VolumesTransfersV357Test-938518850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5711662f-5654-4219-845c-48a7dffbd2fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab10c0be-b9b7-4001-aa1a-7cafe651d5bf', 'volume_name': 'volume-ab10c0be-b9b7-4001-aa1a-7cafe651d5bf', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:20 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-5c5018c5-9c14-40e4-9107-8e94ef5f2680 tempest-VolumesTransfersV357Test-938518850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (333d9463-a019-4d12-bff5-7f87fcd93428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:20 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-5c5018c5-9c14-40e4-9107-8e94ef5f2680 tempest-VolumesTransfersV357Test-938518850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (333d9463-a019-4d12-bff5-7f87fcd93428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:20 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-5c5018c5-9c14-40e4-9107-8e94ef5f2680 tempest-VolumesTransfersV357Test-938518850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53d6739e-2355-4623-9517-92683776b8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:20 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-5c5018c5-9c14-40e4-9107-8e94ef5f2680 tempest-VolumesTransfersV357Test-938518850 None] Volume ab10c0be-b9b7-4001-aa1a-7cafe651d5bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab10c0be-b9b7-4001-aa1a-7cafe651d5bf', 'volume_size': 1} Jul 31 10:47:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-5c5018c5-9c14-40e4-9107-8e94ef5f2680 tempest-VolumesTransfersV357Test-938518850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:47:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-5c5018c5-9c14-40e4-9107-8e94ef5f2680 tempest-VolumesTransfersV357Test-938518850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:47:20 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-5c5018c5-9c14-40e4-9107-8e94ef5f2680 tempest-VolumesTransfersV357Test-938518850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1312382480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab10c0be-b9b7-4001-aa1a-7cafe651d5bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc509e7d5904476acf3550f4292a12a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:47:20Z,use_quota=True,user_id='bf323422cd39439cb79889bc3155d07f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:47:20 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-5c5018c5-9c14-40e4-9107-8e94ef5f2680 tempest-VolumesTransfersV357Test-938518850 None] Creating volume ab10c0be-b9b7-4001-aa1a-7cafe651d5bf {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:47:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-5c5018c5-9c14-40e4-9107-8e94ef5f2680 tempest-VolumesTransfersV357Test-938518850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:47:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-5c5018c5-9c14-40e4-9107-8e94ef5f2680 tempest-VolumesTransfersV357Test-938518850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:47:20 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-5c5018c5-9c14-40e4-9107-8e94ef5f2680 tempest-VolumesTransfersV357Test-938518850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:47:20 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-5c5018c5-9c14-40e4-9107-8e94ef5f2680 tempest-VolumesTransfersV357Test-938518850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:47:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-5c5018c5-9c14-40e4-9107-8e94ef5f2680 tempest-VolumesTransfersV357Test-938518850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:47:20 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-5c5018c5-9c14-40e4-9107-8e94ef5f2680 tempest-VolumesTransfersV357Test-938518850 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:47:20 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-5c5018c5-9c14-40e4-9107-8e94ef5f2680 tempest-VolumesTransfersV357Test-938518850 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:47:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5c5018c5-9c14-40e4-9107-8e94ef5f2680 tempest-VolumesTransfersV357Test-938518850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ab10c0be-b9b7-4001-aa1a-7cafe651d5bf 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:20 devstack sudo[97774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ab10c0be-b9b7-4001-aa1a-7cafe651d5bf 1073741824 Jul 31 10:47:20 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:21 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5c5018c5-9c14-40e4-9107-8e94ef5f2680 tempest-VolumesTransfersV357Test-938518850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ab10c0be-b9b7-4001-aa1a-7cafe651d5bf 1073741824" returned: 0 in 0.622s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5c5018c5-9c14-40e4-9107-8e94ef5f2680 tempest-VolumesTransfersV357Test-938518850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ab10c0be-b9b7-4001-aa1a-7cafe651d5bf {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:21 devstack sudo[97780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ab10c0be-b9b7-4001-aa1a-7cafe651d5bf Jul 31 10:47:21 devstack sudo[97780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:21 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-12390888-89de-4c2d-bca2-40a0bb12ad9a tempest-GroupSnapshotsTest-2131484768 None] Update group completed successfully. Jul 31 10:47:21 devstack sudo[97780]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5c5018c5-9c14-40e4-9107-8e94ef5f2680 tempest-VolumesTransfersV357Test-938518850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ab10c0be-b9b7-4001-aa1a-7cafe651d5bf" returned: 0 in 0.385s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:21 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-5c5018c5-9c14-40e4-9107-8e94ef5f2680 tempest-VolumesTransfersV357Test-938518850 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:47:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-5c5018c5-9c14-40e4-9107-8e94ef5f2680 tempest-VolumesTransfersV357Test-938518850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:47:21 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-5c5018c5-9c14-40e4-9107-8e94ef5f2680 tempest-VolumesTransfersV357Test-938518850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53d6739e-2355-4623-9517-92683776b8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab10c0be-b9b7-4001-aa1a-7cafe651d5bf', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:21 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-5c5018c5-9c14-40e4-9107-8e94ef5f2680 tempest-VolumesTransfersV357Test-938518850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f9119b1-9944-4bfd-b037-8ff14639a2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:21 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-5c5018c5-9c14-40e4-9107-8e94ef5f2680 tempest-VolumesTransfersV357Test-938518850 None] Volume volume-ab10c0be-b9b7-4001-aa1a-7cafe651d5bf (ab10c0be-b9b7-4001-aa1a-7cafe651d5bf): created successfully Jul 31 10:47:21 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-5c5018c5-9c14-40e4-9107-8e94ef5f2680 tempest-VolumesTransfersV357Test-938518850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f9119b1-9944-4bfd-b037-8ff14639a2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:21 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-5c5018c5-9c14-40e4-9107-8e94ef5f2680 tempest-VolumesTransfersV357Test-938518850 None] Flow 'volume_create_manager' (683ed4bd-f16e-41e1-a02e-322dc13f7306) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:47:21 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-5c5018c5-9c14-40e4-9107-8e94ef5f2680 tempest-VolumesTransfersV357Test-938518850 None] Created volume successfully. Jul 31 10:47:22 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-4892c3f9-55e0-4b0a-a488-167592f58502 tempest-GroupSnapshotsTest-2131484768 None] Update group completed successfully. Jul 31 10:47:23 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-6104a957-30b1-48b3-b1e5-4543987c65f7 tempest-VolumesTransfersV357Test-112905809 None] Transfer volume completed successfully. Jul 31 10:47:24 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-06f79f26-f65c-48e9-97d4-d473635e3bac tempest-VolumesTransfersV357Test-1033305055 None] Acquiring lock "cinder-ab10c0be-b9b7-4001-aa1a-7cafe651d5bf-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:47:24 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-06f79f26-f65c-48e9-97d4-d473635e3bac tempest-VolumesTransfersV357Test-1033305055 None] Lock "cinder-ab10c0be-b9b7-4001-aa1a-7cafe651d5bf-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:47:24 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-06f79f26-f65c-48e9-97d4-d473635e3bac tempest-VolumesTransfersV357Test-1033305055 None] Acquiring lock "cinder-quobyte-ab10c0be-b9b7-4001-aa1a-7cafe651d5bf" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:47:24 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-06f79f26-f65c-48e9-97d4-d473635e3bac tempest-VolumesTransfersV357Test-1033305055 None] Lock "cinder-quobyte-ab10c0be-b9b7-4001-aa1a-7cafe651d5bf" acquired by "delete_volume" :: waited 0.025s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:47:24 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3ec679-91ad-43f0-92a6-bd66d6d67230]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:47:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-06f79f26-f65c-48e9-97d4-d473635e3bac tempest-VolumesTransfersV357Test-1033305055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ab10c0be-b9b7-4001-aa1a-7cafe651d5bf {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:24 devstack sudo[97786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ab10c0be-b9b7-4001-aa1a-7cafe651d5bf Jul 31 10:47:24 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:25 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-f90b8151-5bf2-47ef-8b5a-8a9129f2fdc7 tempest-GroupSnapshotsTest-2131484768 None] GroupSnapshot a940a460-0e06-484c-b475-79d89a203e61: creating. Jul 31 10:47:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f90b8151-5bf2-47ef-8b5a-8a9129f2fdc7 tempest-GroupSnapshotsTest-2131484768 None] Group snapshot a940a460-0e06-484c-b475-79d89a203e61: creating. {{(pid=89090) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 31 10:47:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f90b8151-5bf2-47ef-8b5a-8a9129f2fdc7 tempest-GroupSnapshotsTest-2131484768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:47:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f90b8151-5bf2-47ef-8b5a-8a9129f2fdc7 tempest-GroupSnapshotsTest-2131484768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:47:25 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-f90b8151-5bf2-47ef-8b5a-8a9129f2fdc7 tempest-GroupSnapshotsTest-2131484768 None] Creating offline snapshot 271e29ff-f3f7-474c-b865-4746c9880423 of volume a64e86bb-714d-437e-b810-8179e67cf330 {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:47:25 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[8674ea7c-ea67-4976-b860-eeaa93ef76c1]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:47:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f90b8151-5bf2-47ef-8b5a-8a9129f2fdc7 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:25 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-06f79f26-f65c-48e9-97d4-d473635e3bac tempest-VolumesTransfersV357Test-1033305055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ab10c0be-b9b7-4001-aa1a-7cafe651d5bf" returned: 0 in 0.635s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-06f79f26-f65c-48e9-97d4-d473635e3bac tempest-VolumesTransfersV357Test-1033305055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ab10c0be-b9b7-4001-aa1a-7cafe651d5bf {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:25 devstack sudo[97798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ab10c0be-b9b7-4001-aa1a-7cafe651d5bf Jul 31 10:47:25 devstack sudo[97798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:25 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-c4384a41-8ffc-427c-abee-dff996418b09 req-d823682b-5d0b-452e-a034-01a3a2f7490f tempest-AttachVolumeTestJSON-1723809781 None] Terminate volume connection completed successfully. Jul 31 10:47:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-c4384a41-8ffc-427c-abee-dff996418b09 req-d823682b-5d0b-452e-a034-01a3a2f7490f tempest-AttachVolumeTestJSON-1723809781 None] Deleting attachment bef30985-b0ed-4e52-838b-e1a028a88902. {{(pid=89090) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:47:25 devstack sudo[97795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330 Jul 31 10:47:25 devstack sudo[97795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:25 devstack sudo[97798]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-06f79f26-f65c-48e9-97d4-d473635e3bac tempest-VolumesTransfersV357Test-1033305055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ab10c0be-b9b7-4001-aa1a-7cafe651d5bf" returned: 0 in 0.361s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:25 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-06f79f26-f65c-48e9-97d4-d473635e3bac tempest-VolumesTransfersV357Test-1033305055 None] Lock "cinder-quobyte-ab10c0be-b9b7-4001-aa1a-7cafe651d5bf" released by "delete_volume" :: held 1.096s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:47:25 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-06f79f26-f65c-48e9-97d4-d473635e3bac tempest-VolumesTransfersV357Test-1033305055 None] Created reservations ['282d3ee0-f53a-4ec0-8553-a6b1125302eb', '3df88a6b-1d9f-4c53-8021-0d7f04649410', '0c683585-bd67-49ea-9eaa-1ecc8d8c4735', '39478d68-f7f7-48f5-8e81-b39d0ace16f9'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:47:25 devstack sudo[97795]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f90b8151-5bf2-47ef-8b5a-8a9129f2fdc7 tempest-GroupSnapshotsTest-2131484768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330" returned: 0 in 0.590s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f90b8151-5bf2-47ef-8b5a-8a9129f2fdc7 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330.271e29ff-f3f7-474c-b865-4746c9880423 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:25 devstack sudo[97805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330.271e29ff-f3f7-474c-b865-4746c9880423 1G Jul 31 10:47:25 devstack sudo[97805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-06f79f26-f65c-48e9-97d4-d473635e3bac tempest-VolumesTransfersV357Test-1033305055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:47:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-06f79f26-f65c-48e9-97d4-d473635e3bac tempest-VolumesTransfersV357Test-1033305055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:47:25 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-06f79f26-f65c-48e9-97d4-d473635e3bac tempest-VolumesTransfersV357Test-1033305055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:47:25 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-06f79f26-f65c-48e9-97d4-d473635e3bac tempest-VolumesTransfersV357Test-1033305055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:47:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-06f79f26-f65c-48e9-97d4-d473635e3bac tempest-VolumesTransfersV357Test-1033305055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:47:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-06f79f26-f65c-48e9-97d4-d473635e3bac tempest-VolumesTransfersV357Test-1033305055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:25 devstack sudo[97807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:47:25 devstack sudo[97807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:26 devstack sudo[97807]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-06f79f26-f65c-48e9-97d4-d473635e3bac tempest-VolumesTransfersV357Test-1033305055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.462s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:26 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-06f79f26-f65c-48e9-97d4-d473635e3bac tempest-VolumesTransfersV357Test-1033305055 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:47:26 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-06f79f26-f65c-48e9-97d4-d473635e3bac tempest-VolumesTransfersV357Test-1033305055 None] Deleted volume successfully. Jul 31 10:47:26 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-06f79f26-f65c-48e9-97d4-d473635e3bac tempest-VolumesTransfersV357Test-1033305055 None] Lock "cinder-ab10c0be-b9b7-4001-aa1a-7cafe651d5bf-delete_volume" released by "delete_volume" :: held 1.956s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:47:26 devstack sudo[97805]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f90b8151-5bf2-47ef-8b5a-8a9129f2fdc7 tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330.271e29ff-f3f7-474c-b865-4746c9880423 1G" returned: 0 in 0.767s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f90b8151-5bf2-47ef-8b5a-8a9129f2fdc7 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a64e86bb-714d-437e-b810-8179e67cf330 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330.271e29ff-f3f7-474c-b865-4746c9880423 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:26 devstack sudo[97821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a64e86bb-714d-437e-b810-8179e67cf330 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330.271e29ff-f3f7-474c-b865-4746c9880423 Jul 31 10:47:26 devstack sudo[97821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:26 devstack sudo[97821]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f90b8151-5bf2-47ef-8b5a-8a9129f2fdc7 tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a64e86bb-714d-437e-b810-8179e67cf330 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330.271e29ff-f3f7-474c-b865-4746c9880423" returned: 0 in 0.388s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:26 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-f90b8151-5bf2-47ef-8b5a-8a9129f2fdc7 tempest-GroupSnapshotsTest-2131484768 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330.271e29ff-f3f7-474c-b865-4746c9880423 is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:47:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f90b8151-5bf2-47ef-8b5a-8a9129f2fdc7 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330.271e29ff-f3f7-474c-b865-4746c9880423 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:26 devstack sudo[97826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330.271e29ff-f3f7-474c-b865-4746c9880423 Jul 31 10:47:26 devstack sudo[97826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:27 devstack sudo[97826]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f90b8151-5bf2-47ef-8b5a-8a9129f2fdc7 tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330.271e29ff-f3f7-474c-b865-4746c9880423" returned: 0 in 0.303s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f90b8151-5bf2-47ef-8b5a-8a9129f2fdc7 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:27 devstack sudo[97830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330.info Jul 31 10:47:27 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:27 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-d95a8c0d-1f2d-478f-be2c-317e6a42a8de tempest-VolumesTransfersV357Test-938518850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:47:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d95a8c0d-1f2d-478f-be2c-317e6a42a8de tempest-VolumesTransfersV357Test-938518850 None] Flow 'volume_create_manager' (11f05338-3476-4bca-b6b6-10e2f77b4dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:47:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d95a8c0d-1f2d-478f-be2c-317e6a42a8de tempest-VolumesTransfersV357Test-938518850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f05ad0a0-9e27-4965-aeb7-b93223e77fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d95a8c0d-1f2d-478f-be2c-317e6a42a8de tempest-VolumesTransfersV357Test-938518850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f05ad0a0-9e27-4965-aeb7-b93223e77fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1863960816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cccfdb2-19dc-4f0b-a52f-ab6212238107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc509e7d5904476acf3550f4292a12a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:47:27Z,use_quota=True,user_id='bf323422cd39439cb79889bc3155d07f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d95a8c0d-1f2d-478f-be2c-317e6a42a8de tempest-VolumesTransfersV357Test-938518850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (917ca58a-68bd-42f4-ae84-67a1bb2e9895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d95a8c0d-1f2d-478f-be2c-317e6a42a8de tempest-VolumesTransfersV357Test-938518850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (917ca58a-68bd-42f4-ae84-67a1bb2e9895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d95a8c0d-1f2d-478f-be2c-317e6a42a8de tempest-VolumesTransfersV357Test-938518850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (465be92d-162a-4a4e-a6e4-af36eaada836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d95a8c0d-1f2d-478f-be2c-317e6a42a8de tempest-VolumesTransfersV357Test-938518850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (465be92d-162a-4a4e-a6e4-af36eaada836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cccfdb2-19dc-4f0b-a52f-ab6212238107', 'volume_name': 'volume-5cccfdb2-19dc-4f0b-a52f-ab6212238107', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d95a8c0d-1f2d-478f-be2c-317e6a42a8de tempest-VolumesTransfersV357Test-938518850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ebf47c9-9d55-4e54-a0dd-601b9fa2ba8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d95a8c0d-1f2d-478f-be2c-317e6a42a8de tempest-VolumesTransfersV357Test-938518850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ebf47c9-9d55-4e54-a0dd-601b9fa2ba8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d95a8c0d-1f2d-478f-be2c-317e6a42a8de tempest-VolumesTransfersV357Test-938518850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (820b5351-aa97-4372-b3d5-d77bb18375d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:27 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-d95a8c0d-1f2d-478f-be2c-317e6a42a8de tempest-VolumesTransfersV357Test-938518850 None] Volume 5cccfdb2-19dc-4f0b-a52f-ab6212238107: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cccfdb2-19dc-4f0b-a52f-ab6212238107', 'volume_size': 1} Jul 31 10:47:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d95a8c0d-1f2d-478f-be2c-317e6a42a8de tempest-VolumesTransfersV357Test-938518850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:47:27 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f90b8151-5bf2-47ef-8b5a-8a9129f2fdc7 tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330.info" returned: 0 in 0.350s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:27 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-f90b8151-5bf2-47ef-8b5a-8a9129f2fdc7 tempest-GroupSnapshotsTest-2131484768 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330.info is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:47:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f90b8151-5bf2-47ef-8b5a-8a9129f2fdc7 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:27 devstack sudo[97833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330.info Jul 31 10:47:27 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:27 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f90b8151-5bf2-47ef-8b5a-8a9129f2fdc7 tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330.info" returned: 0 in 0.332s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f90b8151-5bf2-47ef-8b5a-8a9129f2fdc7 tempest-GroupSnapshotsTest-2131484768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.892s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:47:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f90b8151-5bf2-47ef-8b5a-8a9129f2fdc7 tempest-GroupSnapshotsTest-2131484768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:47:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f90b8151-5bf2-47ef-8b5a-8a9129f2fdc7 tempest-GroupSnapshotsTest-2131484768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:47:27 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-f90b8151-5bf2-47ef-8b5a-8a9129f2fdc7 tempest-GroupSnapshotsTest-2131484768 None] Creating offline snapshot 3f2b1f6d-e618-4abd-8fc3-62efd078dfcd of volume 81b4fc81-1c42-4d7d-ab63-225fd3d379d7 {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:47:28 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a166202-3b57-4a3f-a231-e8525048680d]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:47:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f90b8151-5bf2-47ef-8b5a-8a9129f2fdc7 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:28 devstack sudo[97836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7 Jul 31 10:47:28 devstack sudo[97836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:28 devstack sudo[97836]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f90b8151-5bf2-47ef-8b5a-8a9129f2fdc7 tempest-GroupSnapshotsTest-2131484768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7" returned: 0 in 0.484s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f90b8151-5bf2-47ef-8b5a-8a9129f2fdc7 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7.3f2b1f6d-e618-4abd-8fc3-62efd078dfcd 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:28 devstack sudo[97841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7.3f2b1f6d-e618-4abd-8fc3-62efd078dfcd 1G Jul 31 10:47:28 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:29 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f90b8151-5bf2-47ef-8b5a-8a9129f2fdc7 tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7.3f2b1f6d-e618-4abd-8fc3-62efd078dfcd 1G" returned: 0 in 0.711s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f90b8151-5bf2-47ef-8b5a-8a9129f2fdc7 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7.3f2b1f6d-e618-4abd-8fc3-62efd078dfcd {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:29 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7.3f2b1f6d-e618-4abd-8fc3-62efd078dfcd Jul 31 10:47:29 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:29 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f90b8151-5bf2-47ef-8b5a-8a9129f2fdc7 tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7.3f2b1f6d-e618-4abd-8fc3-62efd078dfcd" returned: 0 in 0.484s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:29 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-f90b8151-5bf2-47ef-8b5a-8a9129f2fdc7 tempest-GroupSnapshotsTest-2131484768 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7.3f2b1f6d-e618-4abd-8fc3-62efd078dfcd is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:47:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f90b8151-5bf2-47ef-8b5a-8a9129f2fdc7 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7.3f2b1f6d-e618-4abd-8fc3-62efd078dfcd {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:29 devstack sudo[97875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7.3f2b1f6d-e618-4abd-8fc3-62efd078dfcd Jul 31 10:47:29 devstack sudo[97875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:30 devstack sudo[97875]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f90b8151-5bf2-47ef-8b5a-8a9129f2fdc7 tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7.3f2b1f6d-e618-4abd-8fc3-62efd078dfcd" returned: 0 in 0.445s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f90b8151-5bf2-47ef-8b5a-8a9129f2fdc7 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:30 devstack sudo[97897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7.info Jul 31 10:47:30 devstack sudo[97897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:30 devstack sudo[97897]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f90b8151-5bf2-47ef-8b5a-8a9129f2fdc7 tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7.info" returned: 0 in 0.546s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:30 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-f90b8151-5bf2-47ef-8b5a-8a9129f2fdc7 tempest-GroupSnapshotsTest-2131484768 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7.info is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:47:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f90b8151-5bf2-47ef-8b5a-8a9129f2fdc7 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:30 devstack sudo[97935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7.info Jul 31 10:47:30 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:31 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f90b8151-5bf2-47ef-8b5a-8a9129f2fdc7 tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7.info" returned: 0 in 0.498s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f90b8151-5bf2-47ef-8b5a-8a9129f2fdc7 tempest-GroupSnapshotsTest-2131484768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.374s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:47:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d95a8c0d-1f2d-478f-be2c-317e6a42a8de tempest-VolumesTransfersV357Test-938518850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.780s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:47:31 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d95a8c0d-1f2d-478f-be2c-317e6a42a8de tempest-VolumesTransfersV357Test-938518850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1863960816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cccfdb2-19dc-4f0b-a52f-ab6212238107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc509e7d5904476acf3550f4292a12a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:47:27Z,use_quota=True,user_id='bf323422cd39439cb79889bc3155d07f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:47:31 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-d95a8c0d-1f2d-478f-be2c-317e6a42a8de tempest-VolumesTransfersV357Test-938518850 None] Creating volume 5cccfdb2-19dc-4f0b-a52f-ab6212238107 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:47:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d95a8c0d-1f2d-478f-be2c-317e6a42a8de tempest-VolumesTransfersV357Test-938518850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:47:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d95a8c0d-1f2d-478f-be2c-317e6a42a8de tempest-VolumesTransfersV357Test-938518850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:47:31 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d95a8c0d-1f2d-478f-be2c-317e6a42a8de tempest-VolumesTransfersV357Test-938518850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:47:31 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d95a8c0d-1f2d-478f-be2c-317e6a42a8de tempest-VolumesTransfersV357Test-938518850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:47:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d95a8c0d-1f2d-478f-be2c-317e6a42a8de tempest-VolumesTransfersV357Test-938518850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:47:31 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d95a8c0d-1f2d-478f-be2c-317e6a42a8de tempest-VolumesTransfersV357Test-938518850 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:47:31 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-d95a8c0d-1f2d-478f-be2c-317e6a42a8de tempest-VolumesTransfersV357Test-938518850 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:47:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d95a8c0d-1f2d-478f-be2c-317e6a42a8de tempest-VolumesTransfersV357Test-938518850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5cccfdb2-19dc-4f0b-a52f-ab6212238107 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:31 devstack sudo[97957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5cccfdb2-19dc-4f0b-a52f-ab6212238107 1073741824 Jul 31 10:47:31 devstack sudo[97957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:31 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-f90b8151-5bf2-47ef-8b5a-8a9129f2fdc7 tempest-GroupSnapshotsTest-2131484768 None] group_snapshot a940a460-0e06-484c-b475-79d89a203e61: created successfully Jul 31 10:47:32 devstack sudo[97957]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d95a8c0d-1f2d-478f-be2c-317e6a42a8de tempest-VolumesTransfersV357Test-938518850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5cccfdb2-19dc-4f0b-a52f-ab6212238107 1073741824" returned: 0 in 0.670s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d95a8c0d-1f2d-478f-be2c-317e6a42a8de tempest-VolumesTransfersV357Test-938518850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5cccfdb2-19dc-4f0b-a52f-ab6212238107 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:32 devstack sudo[97979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5cccfdb2-19dc-4f0b-a52f-ab6212238107 Jul 31 10:47:32 devstack sudo[97979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:32 devstack sudo[97979]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d95a8c0d-1f2d-478f-be2c-317e6a42a8de tempest-VolumesTransfersV357Test-938518850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5cccfdb2-19dc-4f0b-a52f-ab6212238107" returned: 0 in 0.425s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:32 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d95a8c0d-1f2d-478f-be2c-317e6a42a8de tempest-VolumesTransfersV357Test-938518850 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:47:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d95a8c0d-1f2d-478f-be2c-317e6a42a8de tempest-VolumesTransfersV357Test-938518850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:47:32 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d95a8c0d-1f2d-478f-be2c-317e6a42a8de tempest-VolumesTransfersV357Test-938518850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (820b5351-aa97-4372-b3d5-d77bb18375d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cccfdb2-19dc-4f0b-a52f-ab6212238107', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:32 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d95a8c0d-1f2d-478f-be2c-317e6a42a8de tempest-VolumesTransfersV357Test-938518850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6878936-810e-47b4-aaa9-b802dd7ed95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:32 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-d95a8c0d-1f2d-478f-be2c-317e6a42a8de tempest-VolumesTransfersV357Test-938518850 None] Volume volume-5cccfdb2-19dc-4f0b-a52f-ab6212238107 (5cccfdb2-19dc-4f0b-a52f-ab6212238107): created successfully Jul 31 10:47:32 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d95a8c0d-1f2d-478f-be2c-317e6a42a8de tempest-VolumesTransfersV357Test-938518850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6878936-810e-47b4-aaa9-b802dd7ed95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:32 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d95a8c0d-1f2d-478f-be2c-317e6a42a8de tempest-VolumesTransfersV357Test-938518850 None] Flow 'volume_create_manager' (11f05338-3476-4bca-b6b6-10e2f77b4dc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:47:32 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-d95a8c0d-1f2d-478f-be2c-317e6a42a8de tempest-VolumesTransfersV357Test-938518850 None] Created volume successfully. Jul 31 10:47:32 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] group_snapshot a940a460-0e06-484c-b475-79d89a203e61: deleting Jul 31 10:47:32 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] group_snapshot a940a460-0e06-484c-b475-79d89a203e61: deleting {{(pid=89090) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 31 10:47:32 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] Acquiring lock "cinder-quobyte-a64e86bb-714d-437e-b810-8179e67cf330" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:47:33 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] Lock "cinder-quobyte-a64e86bb-714d-437e-b810-8179e67cf330" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:47:33 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] Acquiring lock "cinder-quobyte-271e29ff-f3f7-474c-b865-4746c9880423" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:47:33 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] Lock "cinder-quobyte-271e29ff-f3f7-474c-b865-4746c9880423" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:47:33 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] Deleting offline snapshot 271e29ff-f3f7-474c-b865-4746c9880423 of volume a64e86bb-714d-437e-b810-8179e67cf330 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:47:33 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] snapshot_file for this snap is: volume-a64e86bb-714d-437e-b810-8179e67cf330.271e29ff-f3f7-474c-b865-4746c9880423 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:47:33 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fefa3e-034c-40c7-bc56-0a19f3cb3ce8]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:47:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330.271e29ff-f3f7-474c-b865-4746c9880423 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:33 devstack sudo[97984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330.271e29ff-f3f7-474c-b865-4746c9880423 Jul 31 10:47:33 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:34 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7dba50ce-ed4d-410e-a8a4-8cafa4b7c6f4 tempest-VolumesTransfersV357Test-1033305055 None] Acquiring lock "cinder-5cccfdb2-19dc-4f0b-a52f-ab6212238107-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:47:34 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7dba50ce-ed4d-410e-a8a4-8cafa4b7c6f4 tempest-VolumesTransfersV357Test-1033305055 None] Lock "cinder-5cccfdb2-19dc-4f0b-a52f-ab6212238107-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:47:34 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330.271e29ff-f3f7-474c-b865-4746c9880423" returned: 0 in 1.158s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:34 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a64e86bb-714d-437e-b810-8179e67cf330(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:47:34 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce777e0e-e078-450b-a546-0d4b5bb01b61]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:47:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:34 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7dba50ce-ed4d-410e-a8a4-8cafa4b7c6f4 tempest-VolumesTransfersV357Test-1033305055 None] Acquiring lock "cinder-quobyte-5cccfdb2-19dc-4f0b-a52f-ab6212238107" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:47:34 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7dba50ce-ed4d-410e-a8a4-8cafa4b7c6f4 tempest-VolumesTransfersV357Test-1033305055 None] Lock "cinder-quobyte-5cccfdb2-19dc-4f0b-a52f-ab6212238107" acquired by "delete_volume" :: waited 0.054s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:47:34 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[687b6101-d831-40d0-926a-ed118cfde4e9]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:47:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7dba50ce-ed4d-410e-a8a4-8cafa4b7c6f4 tempest-VolumesTransfersV357Test-1033305055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5cccfdb2-19dc-4f0b-a52f-ab6212238107 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:34 devstack sudo[97990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330 Jul 31 10:47:34 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:34 devstack sudo[97991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5cccfdb2-19dc-4f0b-a52f-ab6212238107 Jul 31 10:47:34 devstack sudo[97991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:35 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330" returned: 0 in 0.925s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330.271e29ff-f3f7-474c-b865-4746c9880423 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:35 devstack sudo[97991]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7dba50ce-ed4d-410e-a8a4-8cafa4b7c6f4 tempest-VolumesTransfersV357Test-1033305055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5cccfdb2-19dc-4f0b-a52f-ab6212238107" returned: 0 in 0.804s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7dba50ce-ed4d-410e-a8a4-8cafa4b7c6f4 tempest-VolumesTransfersV357Test-1033305055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5cccfdb2-19dc-4f0b-a52f-ab6212238107 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:35 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330.271e29ff-f3f7-474c-b865-4746c9880423 Jul 31 10:47:35 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:35 devstack sudo[98008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5cccfdb2-19dc-4f0b-a52f-ab6212238107 Jul 31 10:47:35 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:36 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7dba50ce-ed4d-410e-a8a4-8cafa4b7c6f4 tempest-VolumesTransfersV357Test-1033305055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5cccfdb2-19dc-4f0b-a52f-ab6212238107" returned: 0 in 0.752s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:36 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7dba50ce-ed4d-410e-a8a4-8cafa4b7c6f4 tempest-VolumesTransfersV357Test-1033305055 None] Lock "cinder-quobyte-5cccfdb2-19dc-4f0b-a52f-ab6212238107" released by "delete_volume" :: held 1.692s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:47:36 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-7dba50ce-ed4d-410e-a8a4-8cafa4b7c6f4 tempest-VolumesTransfersV357Test-1033305055 None] Created reservations ['dbc75ca8-b1cf-46c3-b173-e0c022910939', '812bca1d-7d1d-46be-b927-e0ccb6cc5364', '8648ad43-474a-4bd1-a701-55f8a9fc7f3a', '8399f534-e9d0-4147-a338-9e7be189e5d8'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:47:36 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330.271e29ff-f3f7-474c-b865-4746c9880423" returned: 0 in 1.078s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330.271e29ff-f3f7-474c-b865-4746c9880423 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:36 devstack sudo[98028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330.271e29ff-f3f7-474c-b865-4746c9880423 Jul 31 10:47:36 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7dba50ce-ed4d-410e-a8a4-8cafa4b7c6f4 tempest-VolumesTransfersV357Test-1033305055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:47:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7dba50ce-ed4d-410e-a8a4-8cafa4b7c6f4 tempest-VolumesTransfersV357Test-1033305055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:47:36 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-7dba50ce-ed4d-410e-a8a4-8cafa4b7c6f4 tempest-VolumesTransfersV357Test-1033305055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:47:36 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-7dba50ce-ed4d-410e-a8a4-8cafa4b7c6f4 tempest-VolumesTransfersV357Test-1033305055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:47:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7dba50ce-ed4d-410e-a8a4-8cafa4b7c6f4 tempest-VolumesTransfersV357Test-1033305055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:47:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7dba50ce-ed4d-410e-a8a4-8cafa4b7c6f4 tempest-VolumesTransfersV357Test-1033305055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:36 devstack sudo[98032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:47:36 devstack sudo[98032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:37 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330.271e29ff-f3f7-474c-b865-4746c9880423" returned: 0 in 0.521s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] Lock "cinder-quobyte-271e29ff-f3f7-474c-b865-4746c9880423" released by "_delete_snapshot" :: held 4.108s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:47:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] Lock "cinder-quobyte-a64e86bb-714d-437e-b810-8179e67cf330" released by "delete_snapshot" :: held 4.168s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:47:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] Acquiring lock "cinder-quobyte-81b4fc81-1c42-4d7d-ab63-225fd3d379d7" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:47:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] Lock "cinder-quobyte-81b4fc81-1c42-4d7d-ab63-225fd3d379d7" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:47:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] Acquiring lock "cinder-quobyte-3f2b1f6d-e618-4abd-8fc3-62efd078dfcd" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:47:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] Lock "cinder-quobyte-3f2b1f6d-e618-4abd-8fc3-62efd078dfcd" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:47:37 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] Deleting offline snapshot 3f2b1f6d-e618-4abd-8fc3-62efd078dfcd of volume 81b4fc81-1c42-4d7d-ab63-225fd3d379d7 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:47:37 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] snapshot_file for this snap is: volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7.3f2b1f6d-e618-4abd-8fc3-62efd078dfcd {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:47:37 devstack sudo[98032]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7dba50ce-ed4d-410e-a8a4-8cafa4b7c6f4 tempest-VolumesTransfersV357Test-1033305055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.801s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:37 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-7dba50ce-ed4d-410e-a8a4-8cafa4b7c6f4 tempest-VolumesTransfersV357Test-1033305055 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:47:37 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde81812-f0ff-4a53-98e0-357ec87f88dd]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:47:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7.3f2b1f6d-e618-4abd-8fc3-62efd078dfcd {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:37 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-7dba50ce-ed4d-410e-a8a4-8cafa4b7c6f4 tempest-VolumesTransfersV357Test-1033305055 None] Deleted volume successfully. Jul 31 10:47:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7dba50ce-ed4d-410e-a8a4-8cafa4b7c6f4 tempest-VolumesTransfersV357Test-1033305055 None] Lock "cinder-5cccfdb2-19dc-4f0b-a52f-ab6212238107-delete_volume" released by "delete_volume" :: held 3.162s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:47:37 devstack sudo[98047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7.3f2b1f6d-e618-4abd-8fc3-62efd078dfcd Jul 31 10:47:37 devstack sudo[98047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:37 devstack sudo[98047]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7.3f2b1f6d-e618-4abd-8fc3-62efd078dfcd" returned: 0 in 0.595s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:37 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:47:38 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0325f5-7b25-4941-9df8-39f624f63671]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:47:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:38 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7 Jul 31 10:47:38 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:38 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7" returned: 0 in 0.732s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7.3f2b1f6d-e618-4abd-8fc3-62efd078dfcd {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:38 devstack sudo[98061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7.3f2b1f6d-e618-4abd-8fc3-62efd078dfcd Jul 31 10:47:38 devstack sudo[98061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:39 devstack sudo[98061]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7.3f2b1f6d-e618-4abd-8fc3-62efd078dfcd" returned: 0 in 0.849s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7.3f2b1f6d-e618-4abd-8fc3-62efd078dfcd {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:39 devstack sudo[98078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7.3f2b1f6d-e618-4abd-8fc3-62efd078dfcd Jul 31 10:47:39 devstack sudo[98078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:40 devstack sudo[98078]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7.3f2b1f6d-e618-4abd-8fc3-62efd078dfcd" returned: 0 in 0.715s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:40 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] Lock "cinder-quobyte-3f2b1f6d-e618-4abd-8fc3-62efd078dfcd" released by "_delete_snapshot" :: held 3.146s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:47:40 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] Lock "cinder-quobyte-81b4fc81-1c42-4d7d-ab63-225fd3d379d7" released by "delete_snapshot" :: held 3.192s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:47:40 devstack cinder-volume[89090]: WARNING cinder.quota [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1811962313 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1811962313, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:47:40 devstack cinder-volume[89090]: WARNING cinder.quota [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1811962313 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1811962313, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:47:40 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] Created reservations ['e3688af2-e517-4661-ac24-592080feb778', '6283f407-1834-48c2-a88c-c2ad6d52c5a0', '1ef6a362-5fd3-456f-9ddd-1cd7db943540', 'da7d870c-418d-4023-a5c6-41a9ea28ca18'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:47:41 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] Created reservations ['1f5a3ef1-9169-4b4a-8a3a-3c5024053d72', '040e055a-aea3-4b68-b94f-e57f40ed6225', '9724c0bc-2622-470c-aaf7-17002f62907d', 'df422454-05f3-4a5a-bf68-d141eb36cfb3'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:47:41 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-2f627444-f8a3-4ea3-b4e4-41e186cdfcb1 tempest-GroupSnapshotsTest-2131484768 None] group_snapshot a940a460-0e06-484c-b475-79d89a203e61: deleted successfully Jul 31 10:47:43 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2e4691a5-1cdf-4f9e-a4b9-e4b9395f0d89 tempest-GroupSnapshotsTest-2131484768 None] Acquiring lock "cinder-quobyte-81b4fc81-1c42-4d7d-ab63-225fd3d379d7" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:47:43 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2e4691a5-1cdf-4f9e-a4b9-e4b9395f0d89 tempest-GroupSnapshotsTest-2131484768 None] Lock "cinder-quobyte-81b4fc81-1c42-4d7d-ab63-225fd3d379d7" acquired by "delete_volume" :: waited 0.048s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:47:43 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba36ee67-dbed-412d-9040-f44e938cf976]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:47:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2e4691a5-1cdf-4f9e-a4b9-e4b9395f0d89 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:43 devstack sudo[98154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7 Jul 31 10:47:43 devstack sudo[98154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:44 devstack sudo[98154]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2e4691a5-1cdf-4f9e-a4b9-e4b9395f0d89 tempest-GroupSnapshotsTest-2131484768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7" returned: 0 in 1.059s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2e4691a5-1cdf-4f9e-a4b9-e4b9395f0d89 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:44 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7 Jul 31 10:47:44 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:44 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2e4691a5-1cdf-4f9e-a4b9-e4b9395f0d89 tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-81b4fc81-1c42-4d7d-ab63-225fd3d379d7" returned: 0 in 0.416s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:44 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2e4691a5-1cdf-4f9e-a4b9-e4b9395f0d89 tempest-GroupSnapshotsTest-2131484768 None] Lock "cinder-quobyte-81b4fc81-1c42-4d7d-ab63-225fd3d379d7" released by "delete_volume" :: held 1.672s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:47:44 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2e4691a5-1cdf-4f9e-a4b9-e4b9395f0d89 tempest-GroupSnapshotsTest-2131484768 None] Acquiring lock "cinder-quobyte-a64e86bb-714d-437e-b810-8179e67cf330" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:47:44 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2e4691a5-1cdf-4f9e-a4b9-e4b9395f0d89 tempest-GroupSnapshotsTest-2131484768 None] Lock "cinder-quobyte-a64e86bb-714d-437e-b810-8179e67cf330" acquired by "delete_volume" :: waited 0.033s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:47:45 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd67f8e3-3f2e-4f7c-ae49-8b7e667f2b00]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:47:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2e4691a5-1cdf-4f9e-a4b9-e4b9395f0d89 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:45 devstack sudo[98162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330 Jul 31 10:47:45 devstack sudo[98162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:45 devstack sudo[98162]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2e4691a5-1cdf-4f9e-a4b9-e4b9395f0d89 tempest-GroupSnapshotsTest-2131484768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330" returned: 0 in 0.701s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2e4691a5-1cdf-4f9e-a4b9-e4b9395f0d89 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:45 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330 Jul 31 10:47:45 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:45 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:47:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:47:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:47:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:47:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:47:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:47:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:46 devstack sudo[98169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:47:46 devstack sudo[98169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:46 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2e4691a5-1cdf-4f9e-a4b9-e4b9395f0d89 tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a64e86bb-714d-437e-b810-8179e67cf330" returned: 0 in 0.702s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:46 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2e4691a5-1cdf-4f9e-a4b9-e4b9395f0d89 tempest-GroupSnapshotsTest-2131484768 None] Lock "cinder-quobyte-a64e86bb-714d-437e-b810-8179e67cf330" released by "delete_volume" :: held 1.518s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:47:46 devstack sudo[98169]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.589s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:46 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:47:46 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager._thread_info {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:47:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread count: 28 {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:47:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread info: [<_MainThread(MainThread, started 134005426110592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:47:46 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-2e4691a5-1cdf-4f9e-a4b9-e4b9395f0d89 tempest-GroupSnapshotsTest-2131484768 None] Created reservations ['8092e070-a266-4e7a-bf96-e791c500f8c7'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:47:46 devstack cinder-volume[89090]: WARNING cinder.quota [None req-2e4691a5-1cdf-4f9e-a4b9-e4b9395f0d89 tempest-GroupSnapshotsTest-2131484768 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1811962313 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1811962313, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:47:46 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-2e4691a5-1cdf-4f9e-a4b9-e4b9395f0d89 tempest-GroupSnapshotsTest-2131484768 None] Created reservations ['0fada029-fb16-4a1c-8e03-e1855ea3a63f', 'd8a7b7af-4f10-407d-adcd-8eca9e7ff500', '6714c176-4cac-4fc1-a4bf-50de415744b9', 'e3a7bc2e-b117-4f41-bf07-d99a091f315b'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:47:46 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-2e4691a5-1cdf-4f9e-a4b9-e4b9395f0d89 tempest-GroupSnapshotsTest-2131484768 None] Created reservations ['b5201795-67fd-4320-80bc-f33bf8bc88b3', 'c12a99b6-3ee3-4aec-9884-31adbad6a6d3', '193a560d-e3a5-4a92-ab08-d8d09101a3fd', '2e65da92-2e2b-48c8-b1c3-b7d12061cb77'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:47:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2e4691a5-1cdf-4f9e-a4b9-e4b9395f0d89 tempest-GroupSnapshotsTest-2131484768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:47:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2e4691a5-1cdf-4f9e-a4b9-e4b9395f0d89 tempest-GroupSnapshotsTest-2131484768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:47:47 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2e4691a5-1cdf-4f9e-a4b9-e4b9395f0d89 tempest-GroupSnapshotsTest-2131484768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:47:47 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2e4691a5-1cdf-4f9e-a4b9-e4b9395f0d89 tempest-GroupSnapshotsTest-2131484768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:47:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2e4691a5-1cdf-4f9e-a4b9-e4b9395f0d89 tempest-GroupSnapshotsTest-2131484768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:47:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2e4691a5-1cdf-4f9e-a4b9-e4b9395f0d89 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:47 devstack sudo[98177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:47:47 devstack sudo[98177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:47 devstack sudo[98177]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2e4691a5-1cdf-4f9e-a4b9-e4b9395f0d89 tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.423s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:47 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-2e4691a5-1cdf-4f9e-a4b9-e4b9395f0d89 tempest-GroupSnapshotsTest-2131484768 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:47:47 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-2e4691a5-1cdf-4f9e-a4b9-e4b9395f0d89 tempest-GroupSnapshotsTest-2131484768 None] Delete group completed successfully. Jul 31 10:47:48 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-997fb29f-4adb-45b1-851e-6a7d3030ba4d tempest-TestMinimumBasicScenario-1561219327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:47:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-997fb29f-4adb-45b1-851e-6a7d3030ba4d tempest-TestMinimumBasicScenario-1561219327 None] Flow 'volume_create_manager' (82fa2d60-0e11-4695-8a11-fa31881a1227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:47:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-997fb29f-4adb-45b1-851e-6a7d3030ba4d tempest-TestMinimumBasicScenario-1561219327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e10e077-68fd-4dcf-9817-add85424f71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-997fb29f-4adb-45b1-851e-6a7d3030ba4d tempest-TestMinimumBasicScenario-1561219327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e10e077-68fd-4dcf-9817-add85424f71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-933197808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54ffca6-cfc5-438d-b46b-0748164c18c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f69846d96794aaca1502a38bdf3c271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:47:48Z,use_quota=True,user_id='b92ebf8dc99a4aca8ee3fc3b9f3a0c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-997fb29f-4adb-45b1-851e-6a7d3030ba4d tempest-TestMinimumBasicScenario-1561219327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7271d323-f00e-4b76-aa0c-ace178540d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-997fb29f-4adb-45b1-851e-6a7d3030ba4d tempest-TestMinimumBasicScenario-1561219327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7271d323-f00e-4b76-aa0c-ace178540d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-997fb29f-4adb-45b1-851e-6a7d3030ba4d tempest-TestMinimumBasicScenario-1561219327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef59a03e-5950-4e00-bfac-214349ed3865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-997fb29f-4adb-45b1-851e-6a7d3030ba4d tempest-TestMinimumBasicScenario-1561219327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef59a03e-5950-4e00-bfac-214349ed3865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b54ffca6-cfc5-438d-b46b-0748164c18c7', 'volume_name': 'volume-b54ffca6-cfc5-438d-b46b-0748164c18c7', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-997fb29f-4adb-45b1-851e-6a7d3030ba4d tempest-TestMinimumBasicScenario-1561219327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ddc2cd1-61e8-4d15-b21d-cbd51b890b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-997fb29f-4adb-45b1-851e-6a7d3030ba4d tempest-TestMinimumBasicScenario-1561219327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ddc2cd1-61e8-4d15-b21d-cbd51b890b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-997fb29f-4adb-45b1-851e-6a7d3030ba4d tempest-TestMinimumBasicScenario-1561219327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8857169-78a2-4eb6-b893-f83fd60270cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:48 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-997fb29f-4adb-45b1-851e-6a7d3030ba4d tempest-TestMinimumBasicScenario-1561219327 None] Volume b54ffca6-cfc5-438d-b46b-0748164c18c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b54ffca6-cfc5-438d-b46b-0748164c18c7', 'volume_size': 1} Jul 31 10:47:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-997fb29f-4adb-45b1-851e-6a7d3030ba4d tempest-TestMinimumBasicScenario-1561219327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:47:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-997fb29f-4adb-45b1-851e-6a7d3030ba4d tempest-TestMinimumBasicScenario-1561219327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:47:48 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-997fb29f-4adb-45b1-851e-6a7d3030ba4d tempest-TestMinimumBasicScenario-1561219327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-933197808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54ffca6-cfc5-438d-b46b-0748164c18c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f69846d96794aaca1502a38bdf3c271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:47:48Z,use_quota=True,user_id='b92ebf8dc99a4aca8ee3fc3b9f3a0c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:47:48 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-997fb29f-4adb-45b1-851e-6a7d3030ba4d tempest-TestMinimumBasicScenario-1561219327 None] Creating volume b54ffca6-cfc5-438d-b46b-0748164c18c7 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:47:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-997fb29f-4adb-45b1-851e-6a7d3030ba4d tempest-TestMinimumBasicScenario-1561219327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:47:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-997fb29f-4adb-45b1-851e-6a7d3030ba4d tempest-TestMinimumBasicScenario-1561219327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:47:48 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-997fb29f-4adb-45b1-851e-6a7d3030ba4d tempest-TestMinimumBasicScenario-1561219327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:47:48 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-997fb29f-4adb-45b1-851e-6a7d3030ba4d tempest-TestMinimumBasicScenario-1561219327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:47:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-997fb29f-4adb-45b1-851e-6a7d3030ba4d tempest-TestMinimumBasicScenario-1561219327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:47:48 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-997fb29f-4adb-45b1-851e-6a7d3030ba4d tempest-TestMinimumBasicScenario-1561219327 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:47:48 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-997fb29f-4adb-45b1-851e-6a7d3030ba4d tempest-TestMinimumBasicScenario-1561219327 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:47:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-997fb29f-4adb-45b1-851e-6a7d3030ba4d tempest-TestMinimumBasicScenario-1561219327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b54ffca6-cfc5-438d-b46b-0748164c18c7 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:48 devstack sudo[98180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b54ffca6-cfc5-438d-b46b-0748164c18c7 1073741824 Jul 31 10:47:48 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-923ac1e4-f291-414e-ac24-e8f826956fc0 tempest-GroupSnapshotsTest-2131484768 None] Group tempest-GroupSnapshotsTest-Group-1535096140: creating Jul 31 10:47:48 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:48 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-923ac1e4-f291-414e-ac24-e8f826956fc0 tempest-GroupSnapshotsTest-2131484768 None] Group tempest-GroupSnapshotsTest-Group-1535096140: created successfully Jul 31 10:47:48 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-923ac1e4-f291-414e-ac24-e8f826956fc0 tempest-GroupSnapshotsTest-2131484768 None] Create group completed successfully. Jul 31 10:47:48 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b876a51-413e-4f75-84ac-4f1c4425d781 tempest-VolumesCloneTest-21172858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:47:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3b876a51-413e-4f75-84ac-4f1c4425d781 tempest-VolumesCloneTest-21172858 None] Flow 'volume_create_manager' (6da53494-037f-4f0d-8d91-dc49134a6d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:47:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3b876a51-413e-4f75-84ac-4f1c4425d781 tempest-VolumesCloneTest-21172858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fac0acc-841a-4c57-935c-22727303847f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3b876a51-413e-4f75-84ac-4f1c4425d781 tempest-VolumesCloneTest-21172858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fac0acc-841a-4c57-935c-22727303847f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-846416736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b75b457-d5bb-47b6-b85a-1f1f894f71a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de82d61d599e40bd9a394b1b9a9f4df9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:47:49Z,use_quota=True,user_id='20a89cbc74fd4fb8bb9f04cfbc6e9007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3b876a51-413e-4f75-84ac-4f1c4425d781 tempest-VolumesCloneTest-21172858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b656eec1-32df-411b-8fd1-deee2fe79f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3b876a51-413e-4f75-84ac-4f1c4425d781 tempest-VolumesCloneTest-21172858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b656eec1-32df-411b-8fd1-deee2fe79f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3b876a51-413e-4f75-84ac-4f1c4425d781 tempest-VolumesCloneTest-21172858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e656b97d-98dd-4d2e-9356-fcd0d0c0efc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3b876a51-413e-4f75-84ac-4f1c4425d781 tempest-VolumesCloneTest-21172858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e656b97d-98dd-4d2e-9356-fcd0d0c0efc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b75b457-d5bb-47b6-b85a-1f1f894f71a2', 'volume_name': 'volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3b876a51-413e-4f75-84ac-4f1c4425d781 tempest-VolumesCloneTest-21172858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a85b22a-861c-4b1b-85dc-a83b8aafb19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3b876a51-413e-4f75-84ac-4f1c4425d781 tempest-VolumesCloneTest-21172858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a85b22a-861c-4b1b-85dc-a83b8aafb19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3b876a51-413e-4f75-84ac-4f1c4425d781 tempest-VolumesCloneTest-21172858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3372484c-bc6b-4ae5-9fc4-110fa1f49ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:48 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-3b876a51-413e-4f75-84ac-4f1c4425d781 tempest-VolumesCloneTest-21172858 None] Volume 4b75b457-d5bb-47b6-b85a-1f1f894f71a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2', 'volume_size': 1} Jul 31 10:47:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3b876a51-413e-4f75-84ac-4f1c4425d781 tempest-VolumesCloneTest-21172858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:47:48 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-997fb29f-4adb-45b1-851e-6a7d3030ba4d tempest-TestMinimumBasicScenario-1561219327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b54ffca6-cfc5-438d-b46b-0748164c18c7 1073741824" returned: 0 in 0.592s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-997fb29f-4adb-45b1-851e-6a7d3030ba4d tempest-TestMinimumBasicScenario-1561219327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b54ffca6-cfc5-438d-b46b-0748164c18c7 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:49 devstack sudo[98186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b54ffca6-cfc5-438d-b46b-0748164c18c7 Jul 31 10:47:49 devstack sudo[98186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:49 devstack sudo[98186]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-997fb29f-4adb-45b1-851e-6a7d3030ba4d tempest-TestMinimumBasicScenario-1561219327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b54ffca6-cfc5-438d-b46b-0748164c18c7" returned: 0 in 0.280s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-997fb29f-4adb-45b1-851e-6a7d3030ba4d tempest-TestMinimumBasicScenario-1561219327 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:47:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-997fb29f-4adb-45b1-851e-6a7d3030ba4d tempest-TestMinimumBasicScenario-1561219327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:47:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3b876a51-413e-4f75-84ac-4f1c4425d781 tempest-VolumesCloneTest-21172858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.348s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:47:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-3b876a51-413e-4f75-84ac-4f1c4425d781 tempest-VolumesCloneTest-21172858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-846416736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b75b457-d5bb-47b6-b85a-1f1f894f71a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de82d61d599e40bd9a394b1b9a9f4df9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:47:49Z,use_quota=True,user_id='20a89cbc74fd4fb8bb9f04cfbc6e9007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:47:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-3b876a51-413e-4f75-84ac-4f1c4425d781 tempest-VolumesCloneTest-21172858 None] Creating volume 4b75b457-d5bb-47b6-b85a-1f1f894f71a2 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:47:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3b876a51-413e-4f75-84ac-4f1c4425d781 tempest-VolumesCloneTest-21172858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:47:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3b876a51-413e-4f75-84ac-4f1c4425d781 tempest-VolumesCloneTest-21172858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:47:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-3b876a51-413e-4f75-84ac-4f1c4425d781 tempest-VolumesCloneTest-21172858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:47:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-3b876a51-413e-4f75-84ac-4f1c4425d781 tempest-VolumesCloneTest-21172858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:47:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3b876a51-413e-4f75-84ac-4f1c4425d781 tempest-VolumesCloneTest-21172858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:47:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-3b876a51-413e-4f75-84ac-4f1c4425d781 tempest-VolumesCloneTest-21172858 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:47:49 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-3b876a51-413e-4f75-84ac-4f1c4425d781 tempest-VolumesCloneTest-21172858 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:47:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3b876a51-413e-4f75-84ac-4f1c4425d781 tempest-VolumesCloneTest-21172858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-997fb29f-4adb-45b1-851e-6a7d3030ba4d tempest-TestMinimumBasicScenario-1561219327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8857169-78a2-4eb6-b893-f83fd60270cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b54ffca6-cfc5-438d-b46b-0748164c18c7', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-997fb29f-4adb-45b1-851e-6a7d3030ba4d tempest-TestMinimumBasicScenario-1561219327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7095946c-824b-40a1-8693-102f84834c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:49 devstack sudo[98189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2 1073741824 Jul 31 10:47:49 devstack sudo[98189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:49 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-997fb29f-4adb-45b1-851e-6a7d3030ba4d tempest-TestMinimumBasicScenario-1561219327 None] Volume volume-b54ffca6-cfc5-438d-b46b-0748164c18c7 (b54ffca6-cfc5-438d-b46b-0748164c18c7): created successfully Jul 31 10:47:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-997fb29f-4adb-45b1-851e-6a7d3030ba4d tempest-TestMinimumBasicScenario-1561219327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7095946c-824b-40a1-8693-102f84834c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-997fb29f-4adb-45b1-851e-6a7d3030ba4d tempest-TestMinimumBasicScenario-1561219327 None] Flow 'volume_create_manager' (82fa2d60-0e11-4695-8a11-fa31881a1227) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:47:49 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-997fb29f-4adb-45b1-851e-6a7d3030ba4d tempest-TestMinimumBasicScenario-1561219327 None] Created volume successfully. Jul 31 10:47:49 devstack sudo[98189]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3b876a51-413e-4f75-84ac-4f1c4425d781 tempest-VolumesCloneTest-21172858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2 1073741824" returned: 0 in 0.649s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3b876a51-413e-4f75-84ac-4f1c4425d781 tempest-VolumesCloneTest-21172858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:50 devstack sudo[98195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2 Jul 31 10:47:50 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:50 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fe8343d-9f24-44cf-9f5b-0238aa681378 tempest-GroupSnapshotsTest-2131484768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:47:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9fe8343d-9f24-44cf-9f5b-0238aa681378 tempest-GroupSnapshotsTest-2131484768 None] Flow 'volume_create_manager' (de970bce-b198-437f-82f0-60b1118dc932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:47:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9fe8343d-9f24-44cf-9f5b-0238aa681378 tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c864efb2-1d1c-4e36-9152-e5f4ca4ccbc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9fe8343d-9f24-44cf-9f5b-0238aa681378 tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c864efb2-1d1c-4e36-9152-e5f4ca4ccbc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-455354716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=720b58a8-024c-4195-85e2-87d990ce0fe0,host='devstack@QuobyteHD#QuobyteHD',id=13331246-0194-415f-8fe7-340a41d0e2c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a49b0bd02504a06938e9e136a84d940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:47:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:47:50Z,use_quota=True,user_id='35a7d721ee5042f08dd9bc7cf1f3a1cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fbb48b3c-cae6-45f8-8a7d-45f8e7c8c6e9),volume_type_id=fbb48b3c-cae6-45f8-8a7d-45f8e7c8c6e9)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9fe8343d-9f24-44cf-9f5b-0238aa681378 tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf13965f-498b-4f67-bccf-4495cfa7b8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9fe8343d-9f24-44cf-9f5b-0238aa681378 tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf13965f-498b-4f67-bccf-4495cfa7b8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9fe8343d-9f24-44cf-9f5b-0238aa681378 tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (784e7c97-4e34-4541-bfd8-61187c95bc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:50 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9fe8343d-9f24-44cf-9f5b-0238aa681378 tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (784e7c97-4e34-4541-bfd8-61187c95bc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13331246-0194-415f-8fe7-340a41d0e2c8', 'volume_name': 'volume-13331246-0194-415f-8fe7-340a41d0e2c8', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9fe8343d-9f24-44cf-9f5b-0238aa681378 tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf6bc3b6-fab8-4c8c-a2fb-e5c8bdf6280c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9fe8343d-9f24-44cf-9f5b-0238aa681378 tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf6bc3b6-fab8-4c8c-a2fb-e5c8bdf6280c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9fe8343d-9f24-44cf-9f5b-0238aa681378 tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c00354c2-a613-4498-9db4-8e8ac65302d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:50 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-9fe8343d-9f24-44cf-9f5b-0238aa681378 tempest-GroupSnapshotsTest-2131484768 None] Volume 13331246-0194-415f-8fe7-340a41d0e2c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13331246-0194-415f-8fe7-340a41d0e2c8', 'volume_size': 1} Jul 31 10:47:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9fe8343d-9f24-44cf-9f5b-0238aa681378 tempest-GroupSnapshotsTest-2131484768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:47:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3b876a51-413e-4f75-84ac-4f1c4425d781 tempest-VolumesCloneTest-21172858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2" returned: 0 in 0.487s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:50 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-3b876a51-413e-4f75-84ac-4f1c4425d781 tempest-VolumesCloneTest-21172858 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:47:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3b876a51-413e-4f75-84ac-4f1c4425d781 tempest-VolumesCloneTest-21172858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:47:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9fe8343d-9f24-44cf-9f5b-0238aa681378 tempest-GroupSnapshotsTest-2131484768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:47:50 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-9fe8343d-9f24-44cf-9f5b-0238aa681378 tempest-GroupSnapshotsTest-2131484768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=720b58a8-024c-4195-85e2-87d990ce0fe0,created_at=2026-07-31T08:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-455354716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=720b58a8-024c-4195-85e2-87d990ce0fe0,host='devstack@QuobyteHD#QuobyteHD',id=13331246-0194-415f-8fe7-340a41d0e2c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a49b0bd02504a06938e9e136a84d940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:47:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:47:50Z,use_quota=True,user_id='35a7d721ee5042f08dd9bc7cf1f3a1cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fbb48b3c-cae6-45f8-8a7d-45f8e7c8c6e9),volume_type_id=fbb48b3c-cae6-45f8-8a7d-45f8e7c8c6e9)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:47:50 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-9fe8343d-9f24-44cf-9f5b-0238aa681378 tempest-GroupSnapshotsTest-2131484768 None] Creating volume 13331246-0194-415f-8fe7-340a41d0e2c8 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:47:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9fe8343d-9f24-44cf-9f5b-0238aa681378 tempest-GroupSnapshotsTest-2131484768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:47:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9fe8343d-9f24-44cf-9f5b-0238aa681378 tempest-GroupSnapshotsTest-2131484768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:47:50 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-9fe8343d-9f24-44cf-9f5b-0238aa681378 tempest-GroupSnapshotsTest-2131484768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:47:50 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-9fe8343d-9f24-44cf-9f5b-0238aa681378 tempest-GroupSnapshotsTest-2131484768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:47:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9fe8343d-9f24-44cf-9f5b-0238aa681378 tempest-GroupSnapshotsTest-2131484768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:47:50 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-9fe8343d-9f24-44cf-9f5b-0238aa681378 tempest-GroupSnapshotsTest-2131484768 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:47:50 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-9fe8343d-9f24-44cf-9f5b-0238aa681378 tempest-GroupSnapshotsTest-2131484768 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:47:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9fe8343d-9f24-44cf-9f5b-0238aa681378 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3b876a51-413e-4f75-84ac-4f1c4425d781 tempest-VolumesCloneTest-21172858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3372484c-bc6b-4ae5-9fc4-110fa1f49ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3b876a51-413e-4f75-84ac-4f1c4425d781 tempest-VolumesCloneTest-21172858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eaca57d-69fb-49ee-8cc7-2b951ba3cd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:50 devstack sudo[98198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8 1073741824 Jul 31 10:47:50 devstack sudo[98198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:50 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-3b876a51-413e-4f75-84ac-4f1c4425d781 tempest-VolumesCloneTest-21172858 None] Volume volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2 (4b75b457-d5bb-47b6-b85a-1f1f894f71a2): created successfully Jul 31 10:47:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3b876a51-413e-4f75-84ac-4f1c4425d781 tempest-VolumesCloneTest-21172858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eaca57d-69fb-49ee-8cc7-2b951ba3cd63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3b876a51-413e-4f75-84ac-4f1c4425d781 tempest-VolumesCloneTest-21172858 None] Flow 'volume_create_manager' (6da53494-037f-4f0d-8d91-dc49134a6d7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:47:50 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-3b876a51-413e-4f75-84ac-4f1c4425d781 tempest-VolumesCloneTest-21172858 None] Created volume successfully. Jul 31 10:47:51 devstack sudo[98198]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9fe8343d-9f24-44cf-9f5b-0238aa681378 tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8 1073741824" returned: 0 in 0.634s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9fe8343d-9f24-44cf-9f5b-0238aa681378 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:51 devstack sudo[98207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8 Jul 31 10:47:51 devstack sudo[98207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:51 devstack sudo[98207]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9fe8343d-9f24-44cf-9f5b-0238aa681378 tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8" returned: 0 in 0.501s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:51 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-9fe8343d-9f24-44cf-9f5b-0238aa681378 tempest-GroupSnapshotsTest-2131484768 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:47:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9fe8343d-9f24-44cf-9f5b-0238aa681378 tempest-GroupSnapshotsTest-2131484768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:47:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9fe8343d-9f24-44cf-9f5b-0238aa681378 tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c00354c2-a613-4498-9db4-8e8ac65302d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13331246-0194-415f-8fe7-340a41d0e2c8', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9fe8343d-9f24-44cf-9f5b-0238aa681378 tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2af77f7c-cb33-4cdf-86de-89c0483e0345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:51 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-9fe8343d-9f24-44cf-9f5b-0238aa681378 tempest-GroupSnapshotsTest-2131484768 None] Volume volume-13331246-0194-415f-8fe7-340a41d0e2c8 (13331246-0194-415f-8fe7-340a41d0e2c8): created successfully Jul 31 10:47:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9fe8343d-9f24-44cf-9f5b-0238aa681378 tempest-GroupSnapshotsTest-2131484768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2af77f7c-cb33-4cdf-86de-89c0483e0345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9fe8343d-9f24-44cf-9f5b-0238aa681378 tempest-GroupSnapshotsTest-2131484768 None] Flow 'volume_create_manager' (de970bce-b198-437f-82f0-60b1118dc932) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:47:51 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-9fe8343d-9f24-44cf-9f5b-0238aa681378 tempest-GroupSnapshotsTest-2131484768 None] Created volume successfully. Jul 31 10:47:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-a45505ff-f135-4cf9-9953-38f847207061 req-2076449e-3796-4b4e-9bb7-28c4a8eaaac9 tempest-TestMinimumBasicScenario-1561219327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:47:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-a45505ff-f135-4cf9-9953-38f847207061 req-2076449e-3796-4b4e-9bb7-28c4a8eaaac9 tempest-TestMinimumBasicScenario-1561219327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:47:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-a45505ff-f135-4cf9-9953-38f847207061 req-2076449e-3796-4b4e-9bb7-28c4a8eaaac9 tempest-TestMinimumBasicScenario-1561219327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:47:51 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:47:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-a45505ff-f135-4cf9-9953-38f847207061 req-2076449e-3796-4b4e-9bb7-28c4a8eaaac9 tempest-TestMinimumBasicScenario-1561219327 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c', 'name': 'volume-b54ffca6-cfc5-438d-b46b-0748164c18c7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9c5c1d94-99c2-45b3-902e-90661c831ff0', 'enforce_multipath': True} {{(pid=89090) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:47:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Flow 'volume_create_manager' (48d9edf3-6be5-4358-88b6-3c80548fe770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:47:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1ea45c6-e669-44e5-b24b-afbeb3211077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1ea45c6-e669-44e5-b24b-afbeb3211077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:47:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1449617651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd4f946-0231-42a6-8e23-ee59b6f885a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de82d61d599e40bd9a394b1b9a9f4df9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:47:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=4b75b457-d5bb-47b6-b85a-1f1f894f71a2,status='creating',terminated_at=None,updated_at=2026-07-31T08:47:52Z,use_quota=True,user_id='20a89cbc74fd4fb8bb9f04cfbc6e9007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c853113-6164-43c3-9a8a-a9a1f215325b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c853113-6164-43c3-9a8a-a9a1f215325b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b503a001-1e95-48f5-88f5-70a6795a8046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b503a001-1e95-48f5-88f5-70a6795a8046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2cd4f946-0231-42a6-8e23-ee59b6f885a5', 'volume_name': 'volume-2cd4f946-0231-42a6-8e23-ee59b6f885a5', 'volume_size': 2, 'source_volid': '4b75b457-d5bb-47b6-b85a-1f1f894f71a2', 'source_volstatus': 'available'}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d8386b6-f49b-4a81-ac5e-35e2289fa21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d8386b6-f49b-4a81-ac5e-35e2289fa21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:47:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f77752a6-3140-4d21-8ab0-6054601d7512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:47:52 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Volume 2cd4f946-0231-42a6-8e23-ee59b6f885a5: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2cd4f946-0231-42a6-8e23-ee59b6f885a5', 'volume_size': 2, 'source_volid': '4b75b457-d5bb-47b6-b85a-1f1f894f71a2', 'source_volstatus': 'available'} Jul 31 10:47:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:47:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:47:52 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Cloning volume 4b75b457-d5bb-47b6-b85a-1f1f894f71a2 to volume 2cd4f946-0231-42a6-8e23-ee59b6f885a5 Jul 31 10:47:52 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-a45505ff-f135-4cf9-9953-38f847207061 req-2076449e-3796-4b4e-9bb7-28c4a8eaaac9 tempest-TestMinimumBasicScenario-1561219327 None] attachment_update completed successfully. Jul 31 10:47:52 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Creating offline snapshot 0a62663d-c6b8-4357-b039-3dce43a098fc of volume 4b75b457-d5bb-47b6-b85a-1f1f894f71a2 {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:47:52 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72d4281-53e3-46bd-841a-d1309a619f26]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:47:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:52 devstack sudo[98218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2 Jul 31 10:47:52 devstack sudo[98218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:52 devstack sudo[98218]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2" returned: 0 in 0.516s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2.0a62663d-c6b8-4357-b039-3dce43a098fc 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:52 devstack sudo[98607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2.0a62663d-c6b8-4357-b039-3dce43a098fc 1G Jul 31 10:47:52 devstack sudo[98607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:53 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-39824b08-99d9-4245-b155-06e810f7f87a tempest-GroupSnapshotsTest-2131484768 None] GroupSnapshot 27e79b58-1462-4eec-91a2-c5d92df0befb: creating. Jul 31 10:47:53 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=120,cinder:INSERT=30,cinder:UPDATE=132,cinder:DELETE=6 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:47:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-39824b08-99d9-4245-b155-06e810f7f87a tempest-GroupSnapshotsTest-2131484768 None] Group snapshot 27e79b58-1462-4eec-91a2-c5d92df0befb: creating. {{(pid=89090) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 31 10:47:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-39824b08-99d9-4245-b155-06e810f7f87a tempest-GroupSnapshotsTest-2131484768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:47:53 devstack sudo[98607]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2.0a62663d-c6b8-4357-b039-3dce43a098fc 1G" returned: 0 in 0.728s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2.0a62663d-c6b8-4357-b039-3dce43a098fc {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:53 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2.0a62663d-c6b8-4357-b039-3dce43a098fc Jul 31 10:47:53 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:53 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2.0a62663d-c6b8-4357-b039-3dce43a098fc" returned: 0 in 0.566s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:53 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2.0a62663d-c6b8-4357-b039-3dce43a098fc is being set with open permissions: ugo+rw Jul 31 10:47:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2.0a62663d-c6b8-4357-b039-3dce43a098fc {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:53 devstack sudo[98619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2.0a62663d-c6b8-4357-b039-3dce43a098fc Jul 31 10:47:53 devstack sudo[98619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:54 devstack sudo[98619]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2.0a62663d-c6b8-4357-b039-3dce43a098fc" returned: 0 in 0.404s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:54 devstack sudo[98622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2.info Jul 31 10:47:54 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:54 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2.info" returned: 0 in 0.362s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:54 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2.info is being set with open permissions: ugo+rw Jul 31 10:47:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:54 devstack sudo[98625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2.info Jul 31 10:47:54 devstack sudo[98625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:55 devstack sudo[98625]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2.info" returned: 0 in 0.340s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:55 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Acquiring lock "cinder-quobyte-2cd4f946-0231-42a6-8e23-ee59b6f885a5" by "_copy_volume_from_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:47:55 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Lock "cinder-quobyte-2cd4f946-0231-42a6-8e23-ee59b6f885a5" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:47:55 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] snapshot: 0a62663d-c6b8-4357-b039-3dce43a098fc, volume: 2cd4f946-0231-42a6-8e23-ee59b6f885a5, {{(pid=89090) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 10:47:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:47:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:47:55 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:47:55 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:47:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:47:55 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[77acac2c-7eb3-4e6e-af7b-07f486e8d6b7]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:47:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2.0a62663d-c6b8-4357-b039-3dce43a098fc {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:55 devstack sudo[98628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2.0a62663d-c6b8-4357-b039-3dce43a098fc Jul 31 10:47:55 devstack sudo[98628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:55 devstack sudo[98628]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2.0a62663d-c6b8-4357-b039-3dce43a098fc" returned: 0 in 0.504s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:55 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:47:55 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[1263716d-f747-4be7-85f3-d0a36437e999]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:47:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:55 devstack sudo[98633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2 Jul 31 10:47:55 devstack sudo[98633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:56 devstack sudo[98633]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2" returned: 0 in 0.598s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:56 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2 {{(pid=89090) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 10:47:56 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Creating direct copy from snapshot {{(pid=89090) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 10:47:56 devstack cinder-volume[89090]: DEBUG cinder.utils [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Path /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-2cd4f946-0231-42a6-8e23-ee59b6f885a5 not found in is_blk_device check {{(pid=89090) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 10:47:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-2cd4f946-0231-42a6-8e23-ee59b6f885a5 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:56 devstack sudo[98640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-2cd4f946-0231-42a6-8e23-ee59b6f885a5 Jul 31 10:47:56 devstack sudo[98640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:59 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:UPDATE=115,cinder:SELECT=111,cinder:INSERT=28,cinder:DELETE=6 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:48:04 devstack sudo[98640]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-2cd4f946-0231-42a6-8e23-ee59b6f885a5" returned: 0 in 7.869s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:04 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Image conversion details: src /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2, size 1024.00 MB, duration 7.87 sec, destination /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-2cd4f946-0231-42a6-8e23-ee59b6f885a5 {{(pid=89090) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 10:48:04 devstack cinder-volume[89090]: INFO cinder.image.image_utils [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Converted 1024.00 MB image at 130.11 MB/s Jul 31 10:48:04 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-2cd4f946-0231-42a6-8e23-ee59b6f885a5 is being set with open permissions: ugo+rw Jul 31 10:48:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-2cd4f946-0231-42a6-8e23-ee59b6f885a5 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:04 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-2cd4f946-0231-42a6-8e23-ee59b6f885a5 Jul 31 10:48:04 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:04 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-2cd4f946-0231-42a6-8e23-ee59b6f885a5" returned: 0 in 0.335s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:04 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Lock "cinder-quobyte-2cd4f946-0231-42a6-8e23-ee59b6f885a5" released by "_copy_volume_from_snapshot" :: held 9.420s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:48:04 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Acquiring lock "cinder-quobyte-0a62663d-c6b8-4357-b039-3dce43a098fc" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:48:04 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Lock "cinder-quobyte-0a62663d-c6b8-4357-b039-3dce43a098fc" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:48:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Deleting offline snapshot 0a62663d-c6b8-4357-b039-3dce43a098fc of volume 4b75b457-d5bb-47b6-b85a-1f1f894f71a2 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:48:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] snapshot_file for this snap is: volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2.0a62663d-c6b8-4357-b039-3dce43a098fc {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:48:04 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[565165ff-c794-480e-9a9d-5189aa6b5f67]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:48:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2.0a62663d-c6b8-4357-b039-3dce43a098fc {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:04 devstack sudo[98759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2.0a62663d-c6b8-4357-b039-3dce43a098fc Jul 31 10:48:04 devstack sudo[98759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:05 devstack sudo[98759]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2.0a62663d-c6b8-4357-b039-3dce43a098fc" returned: 0 in 0.479s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:05 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:48:05 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e95105-53ab-4a36-bee1-4c6b6b5a51ef]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:48:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:05 devstack sudo[98765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2 Jul 31 10:48:05 devstack sudo[98765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:06 devstack sudo[98765]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2" returned: 0 in 0.825s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2.0a62663d-c6b8-4357-b039-3dce43a098fc {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:06 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2.0a62663d-c6b8-4357-b039-3dce43a098fc Jul 31 10:48:06 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:06 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2.0a62663d-c6b8-4357-b039-3dce43a098fc" returned: 0 in 0.568s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2.0a62663d-c6b8-4357-b039-3dce43a098fc {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:06 devstack sudo[98775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2.0a62663d-c6b8-4357-b039-3dce43a098fc Jul 31 10:48:06 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:07 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2.0a62663d-c6b8-4357-b039-3dce43a098fc" returned: 0 in 0.438s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:07 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Lock "cinder-quobyte-0a62663d-c6b8-4357-b039-3dce43a098fc" released by "_delete_snapshot" :: held 2.453s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:48:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.112s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:48:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-39824b08-99d9-4245-b155-06e810f7f87a tempest-GroupSnapshotsTest-2131484768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.830s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:48:07 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f77752a6-3140-4d21-8ab0-6054601d7512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cd4f946-0231-42a6-8e23-ee59b6f885a5', 'volume_size': 2, 'source_volid': '4b75b457-d5bb-47b6-b85a-1f1f894f71a2', 'source_volstatus': 'available'}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:48:07 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5617a70-b329-4d1a-b342-77a496e4073f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:48:07 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-39824b08-99d9-4245-b155-06e810f7f87a tempest-GroupSnapshotsTest-2131484768 None] Creating offline snapshot c7327382-715e-42dd-a98d-e25b4eb183a1 of volume 13331246-0194-415f-8fe7-340a41d0e2c8 {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:48:07 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Volume volume-2cd4f946-0231-42a6-8e23-ee59b6f885a5 (2cd4f946-0231-42a6-8e23-ee59b6f885a5): created successfully Jul 31 10:48:07 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5617a70-b329-4d1a-b342-77a496e4073f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:48:07 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Flow 'volume_create_manager' (48d9edf3-6be5-4358-88b6-3c80548fe770) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:48:07 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebe3df7-1402-4b51-9e1b-cef1bec3502c]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:48:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-39824b08-99d9-4245-b155-06e810f7f87a tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:07 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-7042af39-6535-42ad-bc1b-1e3a5fcda611 tempest-VolumesCloneTest-21172858 None] Created volume successfully. Jul 31 10:48:07 devstack sudo[98779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8 Jul 31 10:48:07 devstack sudo[98779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:07 devstack sudo[98779]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-39824b08-99d9-4245-b155-06e810f7f87a tempest-GroupSnapshotsTest-2131484768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8" returned: 0 in 0.677s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-39824b08-99d9-4245-b155-06e810f7f87a tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8.c7327382-715e-42dd-a98d-e25b4eb183a1 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:08 devstack sudo[98785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8.c7327382-715e-42dd-a98d-e25b4eb183a1 1G Jul 31 10:48:08 devstack sudo[98785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:08 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-89ff7d34-0997-437a-b832-3c20b2d64c37 tempest-VolumesCloneTest-21172858 None] Acquiring lock "cinder-2cd4f946-0231-42a6-8e23-ee59b6f885a5-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:48:08 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-89ff7d34-0997-437a-b832-3c20b2d64c37 tempest-VolumesCloneTest-21172858 None] Lock "cinder-2cd4f946-0231-42a6-8e23-ee59b6f885a5-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:48:08 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-89ff7d34-0997-437a-b832-3c20b2d64c37 tempest-VolumesCloneTest-21172858 None] Acquiring lock "cinder-quobyte-2cd4f946-0231-42a6-8e23-ee59b6f885a5" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:48:08 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-89ff7d34-0997-437a-b832-3c20b2d64c37 tempest-VolumesCloneTest-21172858 None] Lock "cinder-quobyte-2cd4f946-0231-42a6-8e23-ee59b6f885a5" acquired by "delete_volume" :: waited 0.027s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:48:08 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[02696c6c-1e70-446e-8e5a-a0ead184227f]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:48:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-89ff7d34-0997-437a-b832-3c20b2d64c37 tempest-VolumesCloneTest-21172858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-2cd4f946-0231-42a6-8e23-ee59b6f885a5 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:08 devstack sudo[98785]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-39824b08-99d9-4245-b155-06e810f7f87a tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8.c7327382-715e-42dd-a98d-e25b4eb183a1 1G" returned: 0 in 0.770s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-39824b08-99d9-4245-b155-06e810f7f87a tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13331246-0194-415f-8fe7-340a41d0e2c8 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8.c7327382-715e-42dd-a98d-e25b4eb183a1 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:08 devstack sudo[98793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-2cd4f946-0231-42a6-8e23-ee59b6f885a5 Jul 31 10:48:08 devstack sudo[98793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:08 devstack sudo[98794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13331246-0194-415f-8fe7-340a41d0e2c8 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8.c7327382-715e-42dd-a98d-e25b4eb183a1 Jul 31 10:48:08 devstack sudo[98794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:09 devstack sudo[98793]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:09 devstack sudo[98794]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-89ff7d34-0997-437a-b832-3c20b2d64c37 tempest-VolumesCloneTest-21172858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-2cd4f946-0231-42a6-8e23-ee59b6f885a5" returned: 0 in 0.640s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-89ff7d34-0997-437a-b832-3c20b2d64c37 tempest-VolumesCloneTest-21172858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-2cd4f946-0231-42a6-8e23-ee59b6f885a5 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-39824b08-99d9-4245-b155-06e810f7f87a tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13331246-0194-415f-8fe7-340a41d0e2c8 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8.c7327382-715e-42dd-a98d-e25b4eb183a1" returned: 0 in 0.524s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:09 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-39824b08-99d9-4245-b155-06e810f7f87a tempest-GroupSnapshotsTest-2131484768 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8.c7327382-715e-42dd-a98d-e25b4eb183a1 is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:48:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-39824b08-99d9-4245-b155-06e810f7f87a tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8.c7327382-715e-42dd-a98d-e25b4eb183a1 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:09 devstack sudo[98804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-2cd4f946-0231-42a6-8e23-ee59b6f885a5 Jul 31 10:48:09 devstack sudo[98804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:09 devstack sudo[98805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8.c7327382-715e-42dd-a98d-e25b4eb183a1 Jul 31 10:48:09 devstack sudo[98805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:09 devstack sudo[98804]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-89ff7d34-0997-437a-b832-3c20b2d64c37 tempest-VolumesCloneTest-21172858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-2cd4f946-0231-42a6-8e23-ee59b6f885a5" returned: 0 in 0.329s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:09 devstack sudo[98805]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-39824b08-99d9-4245-b155-06e810f7f87a tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8.c7327382-715e-42dd-a98d-e25b4eb183a1" returned: 0 in 0.334s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:09 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-89ff7d34-0997-437a-b832-3c20b2d64c37 tempest-VolumesCloneTest-21172858 None] Lock "cinder-quobyte-2cd4f946-0231-42a6-8e23-ee59b6f885a5" released by "delete_volume" :: held 1.039s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:48:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-39824b08-99d9-4245-b155-06e810f7f87a tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:09 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-89ff7d34-0997-437a-b832-3c20b2d64c37 tempest-VolumesCloneTest-21172858 None] Created reservations ['ee3cbea4-02c5-4480-bf62-5c7379e22f07', '7cbe1b93-9002-4efc-b494-6e90bdf079da', 'a2a8d7cb-14c1-4dd5-8b61-e25567ac129c', '41d1c6a0-2c0c-47cb-9b80-dd472afb0d51'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:48:09 devstack sudo[98810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8.info Jul 31 10:48:09 devstack sudo[98810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-89ff7d34-0997-437a-b832-3c20b2d64c37 tempest-VolumesCloneTest-21172858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:48:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-89ff7d34-0997-437a-b832-3c20b2d64c37 tempest-VolumesCloneTest-21172858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:48:09 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-89ff7d34-0997-437a-b832-3c20b2d64c37 tempest-VolumesCloneTest-21172858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:48:09 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-89ff7d34-0997-437a-b832-3c20b2d64c37 tempest-VolumesCloneTest-21172858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:48:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-89ff7d34-0997-437a-b832-3c20b2d64c37 tempest-VolumesCloneTest-21172858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:48:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-89ff7d34-0997-437a-b832-3c20b2d64c37 tempest-VolumesCloneTest-21172858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:09 devstack sudo[98812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:48:09 devstack sudo[98812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:10 devstack sudo[98810]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-39824b08-99d9-4245-b155-06e810f7f87a tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8.info" returned: 0 in 0.473s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:10 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-39824b08-99d9-4245-b155-06e810f7f87a tempest-GroupSnapshotsTest-2131484768 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8.info is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:48:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-39824b08-99d9-4245-b155-06e810f7f87a tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:10 devstack sudo[98822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8.info Jul 31 10:48:10 devstack sudo[98822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:10 devstack sudo[98812]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-89ff7d34-0997-437a-b832-3c20b2d64c37 tempest-VolumesCloneTest-21172858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.356s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:10 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-89ff7d34-0997-437a-b832-3c20b2d64c37 tempest-VolumesCloneTest-21172858 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:48:10 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-89ff7d34-0997-437a-b832-3c20b2d64c37 tempest-VolumesCloneTest-21172858 None] Deleted volume successfully. Jul 31 10:48:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-89ff7d34-0997-437a-b832-3c20b2d64c37 tempest-VolumesCloneTest-21172858 None] Lock "cinder-2cd4f946-0231-42a6-8e23-ee59b6f885a5-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:48:10 devstack sudo[98822]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-39824b08-99d9-4245-b155-06e810f7f87a tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8.info" returned: 0 in 0.327s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-39824b08-99d9-4245-b155-06e810f7f87a tempest-GroupSnapshotsTest-2131484768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.319s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:48:10 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-39824b08-99d9-4245-b155-06e810f7f87a tempest-GroupSnapshotsTest-2131484768 None] group_snapshot 27e79b58-1462-4eec-91a2-c5d92df0befb: created successfully Jul 31 10:48:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-73972988-74b0-46a2-b97d-f1163e41408d tempest-VolumesCloneTest-21172858 None] Acquiring lock "cinder-4b75b457-d5bb-47b6-b85a-1f1f894f71a2-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:48:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-73972988-74b0-46a2-b97d-f1163e41408d tempest-VolumesCloneTest-21172858 None] Lock "cinder-4b75b457-d5bb-47b6-b85a-1f1f894f71a2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:48:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-73972988-74b0-46a2-b97d-f1163e41408d tempest-VolumesCloneTest-21172858 None] Acquiring lock "cinder-quobyte-4b75b457-d5bb-47b6-b85a-1f1f894f71a2" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:48:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-73972988-74b0-46a2-b97d-f1163e41408d tempest-VolumesCloneTest-21172858 None] Lock "cinder-quobyte-4b75b457-d5bb-47b6-b85a-1f1f894f71a2" acquired by "delete_volume" :: waited 0.031s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:48:11 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[c151f9d0-fbd7-4728-895f-6869bfc2c095]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:48:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-73972988-74b0-46a2-b97d-f1163e41408d tempest-VolumesCloneTest-21172858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:11 devstack sudo[98828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2 Jul 31 10:48:11 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-72a70f42-c0da-4332-a142-85969f2f71f3 tempest-GroupSnapshotsTest-2131484768 None] group_snapshot 27e79b58-1462-4eec-91a2-c5d92df0befb: deleting Jul 31 10:48:11 devstack sudo[98828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:11 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-72a70f42-c0da-4332-a142-85969f2f71f3 tempest-GroupSnapshotsTest-2131484768 None] group_snapshot 27e79b58-1462-4eec-91a2-c5d92df0befb: deleting {{(pid=89090) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 31 10:48:11 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-72a70f42-c0da-4332-a142-85969f2f71f3 tempest-GroupSnapshotsTest-2131484768 None] Acquiring lock "cinder-quobyte-13331246-0194-415f-8fe7-340a41d0e2c8" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:48:11 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-72a70f42-c0da-4332-a142-85969f2f71f3 tempest-GroupSnapshotsTest-2131484768 None] Lock "cinder-quobyte-13331246-0194-415f-8fe7-340a41d0e2c8" acquired by "delete_snapshot" :: waited 0.023s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:48:11 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-72a70f42-c0da-4332-a142-85969f2f71f3 tempest-GroupSnapshotsTest-2131484768 None] Acquiring lock "cinder-quobyte-c7327382-715e-42dd-a98d-e25b4eb183a1" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:48:11 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-72a70f42-c0da-4332-a142-85969f2f71f3 tempest-GroupSnapshotsTest-2131484768 None] Lock "cinder-quobyte-c7327382-715e-42dd-a98d-e25b4eb183a1" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:48:11 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-72a70f42-c0da-4332-a142-85969f2f71f3 tempest-GroupSnapshotsTest-2131484768 None] Deleting offline snapshot c7327382-715e-42dd-a98d-e25b4eb183a1 of volume 13331246-0194-415f-8fe7-340a41d0e2c8 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:48:11 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-72a70f42-c0da-4332-a142-85969f2f71f3 tempest-GroupSnapshotsTest-2131484768 None] snapshot_file for this snap is: volume-13331246-0194-415f-8fe7-340a41d0e2c8.c7327382-715e-42dd-a98d-e25b4eb183a1 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:48:11 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[4912c632-fc7c-4d57-bfbf-89af8e58020d]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:48:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-72a70f42-c0da-4332-a142-85969f2f71f3 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8.c7327382-715e-42dd-a98d-e25b4eb183a1 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:11 devstack sudo[98830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8.c7327382-715e-42dd-a98d-e25b4eb183a1 Jul 31 10:48:11 devstack sudo[98830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:11 devstack sudo[98828]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-73972988-74b0-46a2-b97d-f1163e41408d tempest-VolumesCloneTest-21172858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2" returned: 0 in 0.568s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-73972988-74b0-46a2-b97d-f1163e41408d tempest-VolumesCloneTest-21172858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:11 devstack sudo[98835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2 Jul 31 10:48:11 devstack sudo[98835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:11 devstack sudo[98830]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-72a70f42-c0da-4332-a142-85969f2f71f3 tempest-GroupSnapshotsTest-2131484768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8.c7327382-715e-42dd-a98d-e25b4eb183a1" returned: 0 in 0.651s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:12 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-72a70f42-c0da-4332-a142-85969f2f71f3 tempest-GroupSnapshotsTest-2131484768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13331246-0194-415f-8fe7-340a41d0e2c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:48:12 devstack sudo[98835]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-73972988-74b0-46a2-b97d-f1163e41408d tempest-VolumesCloneTest-21172858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4b75b457-d5bb-47b6-b85a-1f1f894f71a2" returned: 0 in 0.425s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:12 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda66c25-bda3-4bb3-95ee-12f44b29962c]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:48:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-72a70f42-c0da-4332-a142-85969f2f71f3 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:12 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-73972988-74b0-46a2-b97d-f1163e41408d tempest-VolumesCloneTest-21172858 None] Lock "cinder-quobyte-4b75b457-d5bb-47b6-b85a-1f1f894f71a2" released by "delete_volume" :: held 1.117s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:48:12 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-73972988-74b0-46a2-b97d-f1163e41408d tempest-VolumesCloneTest-21172858 None] Created reservations ['c60fe103-4ff8-4958-a984-77cd5e9598ed', 'ed39b853-b3e4-448b-808f-fa3ab541de93', 'ef5bb849-02b3-4c0a-8123-ea1af68cb5e5', 'a240e1c5-c369-4f51-9063-6aac3b56eba1'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:48:12 devstack sudo[98841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8 Jul 31 10:48:12 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-73972988-74b0-46a2-b97d-f1163e41408d tempest-VolumesCloneTest-21172858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:48:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-73972988-74b0-46a2-b97d-f1163e41408d tempest-VolumesCloneTest-21172858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:48:12 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-73972988-74b0-46a2-b97d-f1163e41408d tempest-VolumesCloneTest-21172858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:48:12 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-73972988-74b0-46a2-b97d-f1163e41408d tempest-VolumesCloneTest-21172858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:48:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-73972988-74b0-46a2-b97d-f1163e41408d tempest-VolumesCloneTest-21172858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:48:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-73972988-74b0-46a2-b97d-f1163e41408d tempest-VolumesCloneTest-21172858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:12 devstack sudo[98871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:48:12 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:12 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-72a70f42-c0da-4332-a142-85969f2f71f3 tempest-GroupSnapshotsTest-2131484768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8" returned: 0 in 0.617s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-72a70f42-c0da-4332-a142-85969f2f71f3 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8.c7327382-715e-42dd-a98d-e25b4eb183a1 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:12 devstack sudo[98886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8.c7327382-715e-42dd-a98d-e25b4eb183a1 Jul 31 10:48:12 devstack sudo[98886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:12 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-73972988-74b0-46a2-b97d-f1163e41408d tempest-VolumesCloneTest-21172858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.388s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:12 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-73972988-74b0-46a2-b97d-f1163e41408d tempest-VolumesCloneTest-21172858 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:48:12 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-73972988-74b0-46a2-b97d-f1163e41408d tempest-VolumesCloneTest-21172858 None] Deleted volume successfully. Jul 31 10:48:12 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-73972988-74b0-46a2-b97d-f1163e41408d tempest-VolumesCloneTest-21172858 None] Lock "cinder-4b75b457-d5bb-47b6-b85a-1f1f894f71a2-delete_volume" released by "delete_volume" :: held 1.958s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:48:13 devstack sudo[98886]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-72a70f42-c0da-4332-a142-85969f2f71f3 tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8.c7327382-715e-42dd-a98d-e25b4eb183a1" returned: 0 in 0.592s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-72a70f42-c0da-4332-a142-85969f2f71f3 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8.c7327382-715e-42dd-a98d-e25b4eb183a1 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:13 devstack sudo[98904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8.c7327382-715e-42dd-a98d-e25b4eb183a1 Jul 31 10:48:13 devstack sudo[98904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:13 devstack sudo[98904]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-72a70f42-c0da-4332-a142-85969f2f71f3 tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8.c7327382-715e-42dd-a98d-e25b4eb183a1" returned: 0 in 0.532s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:13 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-72a70f42-c0da-4332-a142-85969f2f71f3 tempest-GroupSnapshotsTest-2131484768 None] Lock "cinder-quobyte-c7327382-715e-42dd-a98d-e25b4eb183a1" released by "_delete_snapshot" :: held 2.561s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:48:13 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-72a70f42-c0da-4332-a142-85969f2f71f3 tempest-GroupSnapshotsTest-2131484768 None] Lock "cinder-quobyte-13331246-0194-415f-8fe7-340a41d0e2c8" released by "delete_snapshot" :: held 2.601s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:48:13 devstack cinder-volume[89090]: WARNING cinder.quota [None req-72a70f42-c0da-4332-a142-85969f2f71f3 tempest-GroupSnapshotsTest-2131484768 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1632146981 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1632146981, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:48:13 devstack cinder-volume[89090]: WARNING cinder.quota [None req-72a70f42-c0da-4332-a142-85969f2f71f3 tempest-GroupSnapshotsTest-2131484768 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1632146981 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1632146981, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:48:14 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-72a70f42-c0da-4332-a142-85969f2f71f3 tempest-GroupSnapshotsTest-2131484768 None] Created reservations ['947adc3b-b346-416a-b197-5a5b272d5491', 'b72f35ee-f5a7-425b-a619-e1d16fd483b3', 'c86a7a5b-2b06-47be-9ebf-9d0f0a49db8b', '3955ebfa-44b2-4494-9e6d-259b65a00dfb'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:48:14 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-72a70f42-c0da-4332-a142-85969f2f71f3 tempest-GroupSnapshotsTest-2131484768 None] group_snapshot 27e79b58-1462-4eec-91a2-c5d92df0befb: deleted successfully Jul 31 10:48:15 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9a2f1a82-ce9c-436f-9099-49cc79b9f983 tempest-GroupSnapshotsTest-2131484768 None] Acquiring lock "cinder-quobyte-13331246-0194-415f-8fe7-340a41d0e2c8" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:48:15 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9a2f1a82-ce9c-436f-9099-49cc79b9f983 tempest-GroupSnapshotsTest-2131484768 None] Lock "cinder-quobyte-13331246-0194-415f-8fe7-340a41d0e2c8" acquired by "delete_volume" :: waited 0.037s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:48:15 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[37dffcdc-fe4e-4c93-a055-543be9300305]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:48:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9a2f1a82-ce9c-436f-9099-49cc79b9f983 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:15 devstack sudo[98942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8 Jul 31 10:48:15 devstack sudo[98942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:16 devstack sudo[98942]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9a2f1a82-ce9c-436f-9099-49cc79b9f983 tempest-GroupSnapshotsTest-2131484768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8" returned: 0 in 0.603s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9a2f1a82-ce9c-436f-9099-49cc79b9f983 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:16 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8 Jul 31 10:48:16 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:16 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9a2f1a82-ce9c-436f-9099-49cc79b9f983 tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-13331246-0194-415f-8fe7-340a41d0e2c8" returned: 0 in 0.488s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:16 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9a2f1a82-ce9c-436f-9099-49cc79b9f983 tempest-GroupSnapshotsTest-2131484768 None] Lock "cinder-quobyte-13331246-0194-415f-8fe7-340a41d0e2c8" released by "delete_volume" :: held 1.296s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:48:17 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-9a2f1a82-ce9c-436f-9099-49cc79b9f983 tempest-GroupSnapshotsTest-2131484768 None] Created reservations ['7f170b45-fc8b-4c07-a3d1-2782b1076a28'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:48:17 devstack cinder-volume[89090]: WARNING cinder.quota [None req-9a2f1a82-ce9c-436f-9099-49cc79b9f983 tempest-GroupSnapshotsTest-2131484768 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1632146981 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1632146981, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:48:17 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-9a2f1a82-ce9c-436f-9099-49cc79b9f983 tempest-GroupSnapshotsTest-2131484768 None] Created reservations ['8c49398c-1053-4cc8-9a6c-b9355813e3a6', 'a76d7992-cbdd-4a4f-b329-f10ab6e1ca34', 'bfe699e2-f416-460e-a923-be953eed83ad', '1d1dcbae-a98a-486f-8f64-7e963c6a76f3'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:48:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9a2f1a82-ce9c-436f-9099-49cc79b9f983 tempest-GroupSnapshotsTest-2131484768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:48:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9a2f1a82-ce9c-436f-9099-49cc79b9f983 tempest-GroupSnapshotsTest-2131484768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:48:17 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-9a2f1a82-ce9c-436f-9099-49cc79b9f983 tempest-GroupSnapshotsTest-2131484768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:48:17 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-9a2f1a82-ce9c-436f-9099-49cc79b9f983 tempest-GroupSnapshotsTest-2131484768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:48:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9a2f1a82-ce9c-436f-9099-49cc79b9f983 tempest-GroupSnapshotsTest-2131484768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:48:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9a2f1a82-ce9c-436f-9099-49cc79b9f983 tempest-GroupSnapshotsTest-2131484768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:17 devstack sudo[98992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:48:17 devstack sudo[98992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:18 devstack sudo[98992]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9a2f1a82-ce9c-436f-9099-49cc79b9f983 tempest-GroupSnapshotsTest-2131484768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.712s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:18 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-9a2f1a82-ce9c-436f-9099-49cc79b9f983 tempest-GroupSnapshotsTest-2131484768 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:48:18 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-9a2f1a82-ce9c-436f-9099-49cc79b9f983 tempest-GroupSnapshotsTest-2131484768 None] Delete group completed successfully. Jul 31 10:48:27 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=34,cinder:UPDATE=47,cinder:INSERT=9,cinder:DELETE=2 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:48:27 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:UPDATE=31,cinder:SELECT=29,cinder:INSERT=11,cinder:DELETE=1 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:48:28 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-9399f1ae-9a09-4d39-bc25-aa6e1dce0baf tempest-GroupsV314Test-1368155120 None] Group tempest-GroupsV314Test-Group-536050582: creating Jul 31 10:48:28 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-9399f1ae-9a09-4d39-bc25-aa6e1dce0baf tempest-GroupsV314Test-1368155120 None] Group tempest-GroupsV314Test-Group-536050582: created successfully Jul 31 10:48:28 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-9399f1ae-9a09-4d39-bc25-aa6e1dce0baf tempest-GroupsV314Test-1368155120 None] Create group completed successfully. Jul 31 10:48:30 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd6f9bef-a6cd-43e3-abed-6bada282a5d2 tempest-GroupsV314Test-1368155120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:48:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cd6f9bef-a6cd-43e3-abed-6bada282a5d2 tempest-GroupsV314Test-1368155120 None] Flow 'volume_create_manager' (0678e216-faab-42e0-a410-a904c6c0ead4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:48:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cd6f9bef-a6cd-43e3-abed-6bada282a5d2 tempest-GroupsV314Test-1368155120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e189e9-7fc1-4f68-91de-9f742b9f8b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:48:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cd6f9bef-a6cd-43e3-abed-6bada282a5d2 tempest-GroupsV314Test-1368155120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e189e9-7fc1-4f68-91de-9f742b9f8b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2110338145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=18e1eacf-78e9-4836-ac78-4c6b111371e7,host='devstack@QuobyteHD#QuobyteHD',id=8b2e2ba1-2ad5-44b4-acdf-3f1db754377c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86aa286f84964a2999dd29df9195e854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:48:30Z,use_quota=True,user_id='8aae937067bb4462ae5f5e09ae014679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62a2f903-e443-4b29-9f85-c5d86cb2ff53),volume_type_id=62a2f903-e443-4b29-9f85-c5d86cb2ff53)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:48:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cd6f9bef-a6cd-43e3-abed-6bada282a5d2 tempest-GroupsV314Test-1368155120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d78afc5f-9bd7-4910-8d12-c5a2bc221c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:48:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cd6f9bef-a6cd-43e3-abed-6bada282a5d2 tempest-GroupsV314Test-1368155120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d78afc5f-9bd7-4910-8d12-c5a2bc221c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:48:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cd6f9bef-a6cd-43e3-abed-6bada282a5d2 tempest-GroupsV314Test-1368155120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55cf4732-ed32-4ff7-aa52-b5b5da04210e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:48:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cd6f9bef-a6cd-43e3-abed-6bada282a5d2 tempest-GroupsV314Test-1368155120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55cf4732-ed32-4ff7-aa52-b5b5da04210e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b2e2ba1-2ad5-44b4-acdf-3f1db754377c', 'volume_name': 'volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:48:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cd6f9bef-a6cd-43e3-abed-6bada282a5d2 tempest-GroupsV314Test-1368155120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a9d28a-5357-4c47-b7cc-1b75b8fc76b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:48:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cd6f9bef-a6cd-43e3-abed-6bada282a5d2 tempest-GroupsV314Test-1368155120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a9d28a-5357-4c47-b7cc-1b75b8fc76b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:48:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cd6f9bef-a6cd-43e3-abed-6bada282a5d2 tempest-GroupsV314Test-1368155120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1754a665-05d8-4197-bc4d-278c70381c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:48:30 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-cd6f9bef-a6cd-43e3-abed-6bada282a5d2 tempest-GroupsV314Test-1368155120 None] Volume 8b2e2ba1-2ad5-44b4-acdf-3f1db754377c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c', 'volume_size': 1} Jul 31 10:48:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-cd6f9bef-a6cd-43e3-abed-6bada282a5d2 tempest-GroupsV314Test-1368155120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:48:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-cd6f9bef-a6cd-43e3-abed-6bada282a5d2 tempest-GroupsV314Test-1368155120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:48:30 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-cd6f9bef-a6cd-43e3-abed-6bada282a5d2 tempest-GroupsV314Test-1368155120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=18e1eacf-78e9-4836-ac78-4c6b111371e7,created_at=2026-07-31T08:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2110338145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=18e1eacf-78e9-4836-ac78-4c6b111371e7,host='devstack@QuobyteHD#QuobyteHD',id=8b2e2ba1-2ad5-44b4-acdf-3f1db754377c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86aa286f84964a2999dd29df9195e854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:48:30Z,use_quota=True,user_id='8aae937067bb4462ae5f5e09ae014679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62a2f903-e443-4b29-9f85-c5d86cb2ff53),volume_type_id=62a2f903-e443-4b29-9f85-c5d86cb2ff53)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:48:30 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-cd6f9bef-a6cd-43e3-abed-6bada282a5d2 tempest-GroupsV314Test-1368155120 None] Creating volume 8b2e2ba1-2ad5-44b4-acdf-3f1db754377c {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:48:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-cd6f9bef-a6cd-43e3-abed-6bada282a5d2 tempest-GroupsV314Test-1368155120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:48:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-cd6f9bef-a6cd-43e3-abed-6bada282a5d2 tempest-GroupsV314Test-1368155120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:48:30 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-cd6f9bef-a6cd-43e3-abed-6bada282a5d2 tempest-GroupsV314Test-1368155120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:48:30 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-cd6f9bef-a6cd-43e3-abed-6bada282a5d2 tempest-GroupsV314Test-1368155120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:48:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-cd6f9bef-a6cd-43e3-abed-6bada282a5d2 tempest-GroupsV314Test-1368155120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:48:30 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-cd6f9bef-a6cd-43e3-abed-6bada282a5d2 tempest-GroupsV314Test-1368155120 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:48:30 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-cd6f9bef-a6cd-43e3-abed-6bada282a5d2 tempest-GroupsV314Test-1368155120 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:48:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-cd6f9bef-a6cd-43e3-abed-6bada282a5d2 tempest-GroupsV314Test-1368155120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:30 devstack sudo[99052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c 1073741824 Jul 31 10:48:30 devstack sudo[99052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:31 devstack sudo[99052]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-cd6f9bef-a6cd-43e3-abed-6bada282a5d2 tempest-GroupsV314Test-1368155120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c 1073741824" returned: 0 in 0.622s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-cd6f9bef-a6cd-43e3-abed-6bada282a5d2 tempest-GroupsV314Test-1368155120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:31 devstack sudo[99058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c Jul 31 10:48:31 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:31 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-cd6f9bef-a6cd-43e3-abed-6bada282a5d2 tempest-GroupsV314Test-1368155120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c" returned: 0 in 0.487s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:31 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-cd6f9bef-a6cd-43e3-abed-6bada282a5d2 tempest-GroupsV314Test-1368155120 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:48:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-cd6f9bef-a6cd-43e3-abed-6bada282a5d2 tempest-GroupsV314Test-1368155120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:48:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cd6f9bef-a6cd-43e3-abed-6bada282a5d2 tempest-GroupsV314Test-1368155120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1754a665-05d8-4197-bc4d-278c70381c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:48:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cd6f9bef-a6cd-43e3-abed-6bada282a5d2 tempest-GroupsV314Test-1368155120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c00fade-973c-4569-822b-bdff9b42b736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:48:31 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-cd6f9bef-a6cd-43e3-abed-6bada282a5d2 tempest-GroupsV314Test-1368155120 None] Volume volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c (8b2e2ba1-2ad5-44b4-acdf-3f1db754377c): created successfully Jul 31 10:48:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cd6f9bef-a6cd-43e3-abed-6bada282a5d2 tempest-GroupsV314Test-1368155120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c00fade-973c-4569-822b-bdff9b42b736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:48:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cd6f9bef-a6cd-43e3-abed-6bada282a5d2 tempest-GroupsV314Test-1368155120 None] Flow 'volume_create_manager' (0678e216-faab-42e0-a410-a904c6c0ead4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:48:31 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-cd6f9bef-a6cd-43e3-abed-6bada282a5d2 tempest-GroupsV314Test-1368155120 None] Created volume successfully. Jul 31 10:48:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:48:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:48:33 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] Cloning volume 8b2e2ba1-2ad5-44b4-acdf-3f1db754377c to volume 6df688d3-038a-470b-8083-175ec4fa050c Jul 31 10:48:33 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] Creating offline snapshot b95e5ce5-b564-4e97-b1ef-2d2d884ee8c1 of volume 8b2e2ba1-2ad5-44b4-acdf-3f1db754377c {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:48:33 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21d2659-58c6-474d-be36-cbb093091dd9]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:48:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:34 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c Jul 31 10:48:34 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:34 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c" returned: 0 in 0.548s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c.b95e5ce5-b564-4e97-b1ef-2d2d884ee8c1 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:34 devstack sudo[99068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c.b95e5ce5-b564-4e97-b1ef-2d2d884ee8c1 1G Jul 31 10:48:34 devstack sudo[99068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:34 devstack sudo[99068]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c.b95e5ce5-b564-4e97-b1ef-2d2d884ee8c1 1G" returned: 0 in 0.610s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c.b95e5ce5-b564-4e97-b1ef-2d2d884ee8c1 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:35 devstack sudo[99074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c.b95e5ce5-b564-4e97-b1ef-2d2d884ee8c1 Jul 31 10:48:35 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:35 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c.b95e5ce5-b564-4e97-b1ef-2d2d884ee8c1" returned: 0 in 0.425s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:35 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c.b95e5ce5-b564-4e97-b1ef-2d2d884ee8c1 is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:48:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c.b95e5ce5-b564-4e97-b1ef-2d2d884ee8c1 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:35 devstack sudo[99101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c.b95e5ce5-b564-4e97-b1ef-2d2d884ee8c1 Jul 31 10:48:35 devstack sudo[99101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:35 devstack sudo[99101]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c.b95e5ce5-b564-4e97-b1ef-2d2d884ee8c1" returned: 0 in 0.351s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:35 devstack sudo[99104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c.info Jul 31 10:48:35 devstack sudo[99104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:36 devstack sudo[99104]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c.info" returned: 0 in 0.289s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:36 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c.info is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:48:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:36 devstack sudo[99107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c.info Jul 31 10:48:36 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:36 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c.info" returned: 0 in 0.303s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:36 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] Acquiring lock "cinder-quobyte-6df688d3-038a-470b-8083-175ec4fa050c" by "_copy_volume_from_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:48:36 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] Lock "cinder-quobyte-6df688d3-038a-470b-8083-175ec4fa050c" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:48:36 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] snapshot: b95e5ce5-b564-4e97-b1ef-2d2d884ee8c1, volume: 6df688d3-038a-470b-8083-175ec4fa050c, {{(pid=89090) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 10:48:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:48:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:48:36 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:48:36 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:48:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:48:36 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb04dbe-efc5-4b94-8193-8a5f4fd31dc8]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:48:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c.b95e5ce5-b564-4e97-b1ef-2d2d884ee8c1 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:36 devstack sudo[99112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c.b95e5ce5-b564-4e97-b1ef-2d2d884ee8c1 Jul 31 10:48:36 devstack sudo[99112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:36 devstack sudo[99112]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c.b95e5ce5-b564-4e97-b1ef-2d2d884ee8c1" returned: 0 in 0.453s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:36 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:48:36 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9999479-214a-4d52-9954-c42a542c9d9d]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:48:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:37 devstack sudo[99119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c Jul 31 10:48:37 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:37 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c" returned: 0 in 0.485s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:37 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c {{(pid=89090) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 10:48:37 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] Creating direct copy from snapshot {{(pid=89090) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 10:48:37 devstack cinder-volume[89090]: DEBUG cinder.utils [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] Path /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6df688d3-038a-470b-8083-175ec4fa050c not found in is_blk_device check {{(pid=89090) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 10:48:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6df688d3-038a-470b-8083-175ec4fa050c {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:37 devstack sudo[99125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6df688d3-038a-470b-8083-175ec4fa050c Jul 31 10:48:37 devstack sudo[99125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:40 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-2209dc73-5f9a-4bb7-8698-8f828be1b1ce tempest-VolumesSnapshotTestJSON-1100319566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:48:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2209dc73-5f9a-4bb7-8698-8f828be1b1ce tempest-VolumesSnapshotTestJSON-1100319566 None] Flow 'volume_create_manager' (02e64449-afcf-4af3-8de6-584789a4c32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:48:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2209dc73-5f9a-4bb7-8698-8f828be1b1ce tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91f862e3-9748-4a65-a629-82fccbea8e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:48:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2209dc73-5f9a-4bb7-8698-8f828be1b1ce tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91f862e3-9748-4a65-a629-82fccbea8e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-180276107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e251803f-5bda-4259-8de9-8791639bfce0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c09007178794d0282b7476475ff6b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:48:40Z,use_quota=True,user_id='cb78e43820644faea3b5e8e6976ed0ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:48:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2209dc73-5f9a-4bb7-8698-8f828be1b1ce tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8c88857-a7fb-45e6-ad89-a4452a65a85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:48:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2209dc73-5f9a-4bb7-8698-8f828be1b1ce tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8c88857-a7fb-45e6-ad89-a4452a65a85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:48:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2209dc73-5f9a-4bb7-8698-8f828be1b1ce tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (014e87f1-011a-4e12-bc15-1b6c8eac7b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:48:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2209dc73-5f9a-4bb7-8698-8f828be1b1ce tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (014e87f1-011a-4e12-bc15-1b6c8eac7b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e251803f-5bda-4259-8de9-8791639bfce0', 'volume_name': 'volume-e251803f-5bda-4259-8de9-8791639bfce0', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:48:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2209dc73-5f9a-4bb7-8698-8f828be1b1ce tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6774208f-e3b6-4d5d-9e94-ac56e47064c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:48:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2209dc73-5f9a-4bb7-8698-8f828be1b1ce tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6774208f-e3b6-4d5d-9e94-ac56e47064c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:48:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2209dc73-5f9a-4bb7-8698-8f828be1b1ce tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d345eb1-db05-46fb-b452-2fd3fc6727f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:48:40 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-2209dc73-5f9a-4bb7-8698-8f828be1b1ce tempest-VolumesSnapshotTestJSON-1100319566 None] Volume e251803f-5bda-4259-8de9-8791639bfce0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e251803f-5bda-4259-8de9-8791639bfce0', 'volume_size': 1} Jul 31 10:48:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2209dc73-5f9a-4bb7-8698-8f828be1b1ce tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:48:43 devstack sudo[99125]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6df688d3-038a-470b-8083-175ec4fa050c" returned: 0 in 6.141s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:43 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] Image conversion details: src /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c, size 1024.00 MB, duration 6.14 sec, destination /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6df688d3-038a-470b-8083-175ec4fa050c {{(pid=89090) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 10:48:43 devstack cinder-volume[89090]: INFO cinder.image.image_utils [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] Converted 1024.00 MB image at 166.72 MB/s Jul 31 10:48:43 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6df688d3-038a-470b-8083-175ec4fa050c is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:48:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6df688d3-038a-470b-8083-175ec4fa050c {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:43 devstack sudo[99142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6df688d3-038a-470b-8083-175ec4fa050c Jul 31 10:48:43 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:43 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6df688d3-038a-470b-8083-175ec4fa050c" returned: 0 in 0.294s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:43 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] Lock "cinder-quobyte-6df688d3-038a-470b-8083-175ec4fa050c" released by "_copy_volume_from_snapshot" :: held 7.478s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:48:43 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] Acquiring lock "cinder-quobyte-b95e5ce5-b564-4e97-b1ef-2d2d884ee8c1" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:48:43 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] Lock "cinder-quobyte-b95e5ce5-b564-4e97-b1ef-2d2d884ee8c1" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:48:43 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] Deleting offline snapshot b95e5ce5-b564-4e97-b1ef-2d2d884ee8c1 of volume 8b2e2ba1-2ad5-44b4-acdf-3f1db754377c {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:48:43 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] snapshot_file for this snap is: volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c.b95e5ce5-b564-4e97-b1ef-2d2d884ee8c1 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:48:44 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2a6e96-bfd6-426a-8124-3c71661964e1]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:48:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c.b95e5ce5-b564-4e97-b1ef-2d2d884ee8c1 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:44 devstack sudo[99145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c.b95e5ce5-b564-4e97-b1ef-2d2d884ee8c1 Jul 31 10:48:44 devstack sudo[99145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:44 devstack sudo[99145]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c.b95e5ce5-b564-4e97-b1ef-2d2d884ee8c1" returned: 0 in 0.439s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:44 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:48:44 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d565b3b-1c74-435f-bc83-1b57d5daa868]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:48:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:44 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c Jul 31 10:48:44 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:45 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c" returned: 0 in 0.875s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c.b95e5ce5-b564-4e97-b1ef-2d2d884ee8c1 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:45 devstack sudo[99159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c.b95e5ce5-b564-4e97-b1ef-2d2d884ee8c1 Jul 31 10:48:45 devstack sudo[99159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:45 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:48:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:48:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:48:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:48:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:48:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:48:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:45 devstack sudo[99159]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c.b95e5ce5-b564-4e97-b1ef-2d2d884ee8c1" returned: 0 in 0.607s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c.b95e5ce5-b564-4e97-b1ef-2d2d884ee8c1 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:45 devstack sudo[99165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:48:45 devstack sudo[99165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:46 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c.b95e5ce5-b564-4e97-b1ef-2d2d884ee8c1 Jul 31 10:48:46 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:46 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-51d5ace9-ff15-4477-b577-f4c8ecf39a3e tempest-AttachVolumeTestJSON-1723809781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:48:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-51d5ace9-ff15-4477-b577-f4c8ecf39a3e tempest-AttachVolumeTestJSON-1723809781 None] Flow 'volume_create_manager' (c24e4a88-ff7e-4b7d-8e77-dcd173ef31fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:48:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-51d5ace9-ff15-4477-b577-f4c8ecf39a3e tempest-AttachVolumeTestJSON-1723809781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2782a42-787f-4c8a-9fee-87c343e8182d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:48:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-51d5ace9-ff15-4477-b577-f4c8ecf39a3e tempest-AttachVolumeTestJSON-1723809781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2782a42-787f-4c8a-9fee-87c343e8182d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-432239463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f45c24b9-0e69-4bcf-b3f3-f80e9b42e59a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f5fa6e507f3474980070de0fe76917c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:48:46Z,use_quota=True,user_id='ef2cbbabbb8844929cc28d92e491639a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:48:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-51d5ace9-ff15-4477-b577-f4c8ecf39a3e tempest-AttachVolumeTestJSON-1723809781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6417b76-ac88-4eb5-b866-e107fb874238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:48:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-51d5ace9-ff15-4477-b577-f4c8ecf39a3e tempest-AttachVolumeTestJSON-1723809781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6417b76-ac88-4eb5-b866-e107fb874238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:48:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-51d5ace9-ff15-4477-b577-f4c8ecf39a3e tempest-AttachVolumeTestJSON-1723809781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d09e63d9-091e-4d43-9adf-cd5e1a8e1aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:48:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-51d5ace9-ff15-4477-b577-f4c8ecf39a3e tempest-AttachVolumeTestJSON-1723809781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d09e63d9-091e-4d43-9adf-cd5e1a8e1aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f45c24b9-0e69-4bcf-b3f3-f80e9b42e59a', 'volume_name': 'volume-f45c24b9-0e69-4bcf-b3f3-f80e9b42e59a', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:48:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-51d5ace9-ff15-4477-b577-f4c8ecf39a3e tempest-AttachVolumeTestJSON-1723809781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51228710-a433-42f7-b14e-08f66dbc3329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:48:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-51d5ace9-ff15-4477-b577-f4c8ecf39a3e tempest-AttachVolumeTestJSON-1723809781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51228710-a433-42f7-b14e-08f66dbc3329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:48:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-51d5ace9-ff15-4477-b577-f4c8ecf39a3e tempest-AttachVolumeTestJSON-1723809781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c165d1ff-23de-4eb7-87b7-04e649dfb4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:48:46 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-51d5ace9-ff15-4477-b577-f4c8ecf39a3e tempest-AttachVolumeTestJSON-1723809781 None] Volume f45c24b9-0e69-4bcf-b3f3-f80e9b42e59a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f45c24b9-0e69-4bcf-b3f3-f80e9b42e59a', 'volume_size': 1} Jul 31 10:48:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-51d5ace9-ff15-4477-b577-f4c8ecf39a3e tempest-AttachVolumeTestJSON-1723809781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:48:46 devstack sudo[99165]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.367s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:46 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:48:46 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager._thread_info {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:48:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread count: 28 {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:48:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread info: [<_MainThread(MainThread, started 134005426110592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:48:46 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c.b95e5ce5-b564-4e97-b1ef-2d2d884ee8c1" returned: 0 in 0.435s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:46 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] Lock "cinder-quobyte-b95e5ce5-b564-4e97-b1ef-2d2d884ee8c1" released by "_delete_snapshot" :: held 2.482s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:48:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.770s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:48:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2209dc73-5f9a-4bb7-8698-8f828be1b1ce tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.892s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:48:46 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2209dc73-5f9a-4bb7-8698-8f828be1b1ce tempest-VolumesSnapshotTestJSON-1100319566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-180276107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e251803f-5bda-4259-8de9-8791639bfce0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c09007178794d0282b7476475ff6b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:48:40Z,use_quota=True,user_id='cb78e43820644faea3b5e8e6976ed0ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:48:46 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-2209dc73-5f9a-4bb7-8698-8f828be1b1ce tempest-VolumesSnapshotTestJSON-1100319566 None] Creating volume e251803f-5bda-4259-8de9-8791639bfce0 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:48:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2209dc73-5f9a-4bb7-8698-8f828be1b1ce tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:48:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2209dc73-5f9a-4bb7-8698-8f828be1b1ce tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:48:46 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2209dc73-5f9a-4bb7-8698-8f828be1b1ce tempest-VolumesSnapshotTestJSON-1100319566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:48:46 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2209dc73-5f9a-4bb7-8698-8f828be1b1ce tempest-VolumesSnapshotTestJSON-1100319566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:48:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2209dc73-5f9a-4bb7-8698-8f828be1b1ce tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:48:46 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2209dc73-5f9a-4bb7-8698-8f828be1b1ce tempest-VolumesSnapshotTestJSON-1100319566 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:48:46 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-2209dc73-5f9a-4bb7-8698-8f828be1b1ce tempest-VolumesSnapshotTestJSON-1100319566 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:48:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2209dc73-5f9a-4bb7-8698-8f828be1b1ce tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:46 devstack sudo[99173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0 1073741824 Jul 31 10:48:46 devstack sudo[99173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:46 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-88156ac7-1304-4bd9-b720-31f43b280b01 tempest-GroupsV314Test-1368155120 None] Create group from source-group-18e1eacf-78e9-4836-ac78-4c6b111371e7 completed successfully. Jul 31 10:48:47 devstack sudo[99173]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2209dc73-5f9a-4bb7-8698-8f828be1b1ce tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0 1073741824" returned: 0 in 0.688s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2209dc73-5f9a-4bb7-8698-8f828be1b1ce tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:47 devstack sudo[99183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0 Jul 31 10:48:47 devstack sudo[99183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:47 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-54ab730f-0efc-47b9-ae59-0e1a32ead594 req-5a9adec8-a2a4-4733-967c-c9803fde2952 tempest-TestMinimumBasicScenario-1561219327 None] Terminate volume connection completed successfully. Jul 31 10:48:47 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-54ab730f-0efc-47b9-ae59-0e1a32ead594 req-5a9adec8-a2a4-4733-967c-c9803fde2952 tempest-TestMinimumBasicScenario-1561219327 None] Deleting attachment 9c5c1d94-99c2-45b3-902e-90661c831ff0. {{(pid=89090) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:48:47 devstack sudo[99183]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2209dc73-5f9a-4bb7-8698-8f828be1b1ce tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0" returned: 0 in 0.329s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:47 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2209dc73-5f9a-4bb7-8698-8f828be1b1ce tempest-VolumesSnapshotTestJSON-1100319566 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:48:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2209dc73-5f9a-4bb7-8698-8f828be1b1ce tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:48:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-51d5ace9-ff15-4477-b577-f4c8ecf39a3e tempest-AttachVolumeTestJSON-1723809781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.412s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:48:47 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-51d5ace9-ff15-4477-b577-f4c8ecf39a3e tempest-AttachVolumeTestJSON-1723809781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-432239463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f45c24b9-0e69-4bcf-b3f3-f80e9b42e59a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f5fa6e507f3474980070de0fe76917c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:48:46Z,use_quota=True,user_id='ef2cbbabbb8844929cc28d92e491639a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:48:47 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-51d5ace9-ff15-4477-b577-f4c8ecf39a3e tempest-AttachVolumeTestJSON-1723809781 None] Creating volume f45c24b9-0e69-4bcf-b3f3-f80e9b42e59a {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:48:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-51d5ace9-ff15-4477-b577-f4c8ecf39a3e tempest-AttachVolumeTestJSON-1723809781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:48:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-51d5ace9-ff15-4477-b577-f4c8ecf39a3e tempest-AttachVolumeTestJSON-1723809781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:48:47 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-51d5ace9-ff15-4477-b577-f4c8ecf39a3e tempest-AttachVolumeTestJSON-1723809781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:48:47 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-51d5ace9-ff15-4477-b577-f4c8ecf39a3e tempest-AttachVolumeTestJSON-1723809781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:48:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-51d5ace9-ff15-4477-b577-f4c8ecf39a3e tempest-AttachVolumeTestJSON-1723809781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:48:47 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-51d5ace9-ff15-4477-b577-f4c8ecf39a3e tempest-AttachVolumeTestJSON-1723809781 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:48:47 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-51d5ace9-ff15-4477-b577-f4c8ecf39a3e tempest-AttachVolumeTestJSON-1723809781 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:48:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-51d5ace9-ff15-4477-b577-f4c8ecf39a3e tempest-AttachVolumeTestJSON-1723809781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f45c24b9-0e69-4bcf-b3f3-f80e9b42e59a 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:47 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2209dc73-5f9a-4bb7-8698-8f828be1b1ce tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d345eb1-db05-46fb-b452-2fd3fc6727f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e251803f-5bda-4259-8de9-8791639bfce0', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:48:47 devstack sudo[99189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f45c24b9-0e69-4bcf-b3f3-f80e9b42e59a 1073741824 Jul 31 10:48:47 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:47 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2209dc73-5f9a-4bb7-8698-8f828be1b1ce tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3090d85-09a5-4545-bff9-e396223b403f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:48:47 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-2209dc73-5f9a-4bb7-8698-8f828be1b1ce tempest-VolumesSnapshotTestJSON-1100319566 None] Volume volume-e251803f-5bda-4259-8de9-8791639bfce0 (e251803f-5bda-4259-8de9-8791639bfce0): created successfully Jul 31 10:48:47 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2209dc73-5f9a-4bb7-8698-8f828be1b1ce tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3090d85-09a5-4545-bff9-e396223b403f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:48:47 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2209dc73-5f9a-4bb7-8698-8f828be1b1ce tempest-VolumesSnapshotTestJSON-1100319566 None] Flow 'volume_create_manager' (02e64449-afcf-4af3-8de6-584789a4c32c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:48:47 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-2209dc73-5f9a-4bb7-8698-8f828be1b1ce tempest-VolumesSnapshotTestJSON-1100319566 None] Created volume successfully. Jul 31 10:48:47 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-5f84ba50-5329-4965-b3a4-7e94244c0025 tempest-GroupsV314Test-1368155120 None] Acquiring lock "cinder-quobyte-6df688d3-038a-470b-8083-175ec4fa050c" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:48:47 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-5f84ba50-5329-4965-b3a4-7e94244c0025 tempest-GroupsV314Test-1368155120 None] Lock "cinder-quobyte-6df688d3-038a-470b-8083-175ec4fa050c" acquired by "delete_volume" :: waited 0.025s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:48:47 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[406b38bd-74c8-4768-a6af-cbbd4b24a3a4]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:48:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5f84ba50-5329-4965-b3a4-7e94244c0025 tempest-GroupsV314Test-1368155120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6df688d3-038a-470b-8083-175ec4fa050c {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:47 devstack sudo[99191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6df688d3-038a-470b-8083-175ec4fa050c Jul 31 10:48:47 devstack sudo[99191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:48 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-51d5ace9-ff15-4477-b577-f4c8ecf39a3e tempest-AttachVolumeTestJSON-1723809781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f45c24b9-0e69-4bcf-b3f3-f80e9b42e59a 1073741824" returned: 0 in 0.676s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:48 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a58bb56c-48bc-40d9-8d7f-ce51c34769d5 tempest-TestMinimumBasicScenario-1561219327 None] Acquiring lock "cinder-b54ffca6-cfc5-438d-b46b-0748164c18c7-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:48:48 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a58bb56c-48bc-40d9-8d7f-ce51c34769d5 tempest-TestMinimumBasicScenario-1561219327 None] Lock "cinder-b54ffca6-cfc5-438d-b46b-0748164c18c7-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:48:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-51d5ace9-ff15-4477-b577-f4c8ecf39a3e tempest-AttachVolumeTestJSON-1723809781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f45c24b9-0e69-4bcf-b3f3-f80e9b42e59a {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:48 devstack sudo[99200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f45c24b9-0e69-4bcf-b3f3-f80e9b42e59a Jul 31 10:48:48 devstack sudo[99200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:48 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a58bb56c-48bc-40d9-8d7f-ce51c34769d5 tempest-TestMinimumBasicScenario-1561219327 None] Acquiring lock "cinder-quobyte-b54ffca6-cfc5-438d-b46b-0748164c18c7" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:48:48 devstack sudo[99191]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5f84ba50-5329-4965-b3a4-7e94244c0025 tempest-GroupsV314Test-1368155120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6df688d3-038a-470b-8083-175ec4fa050c" returned: 0 in 0.627s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5f84ba50-5329-4965-b3a4-7e94244c0025 tempest-GroupsV314Test-1368155120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6df688d3-038a-470b-8083-175ec4fa050c {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:48 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a58bb56c-48bc-40d9-8d7f-ce51c34769d5 tempest-TestMinimumBasicScenario-1561219327 None] Lock "cinder-quobyte-b54ffca6-cfc5-438d-b46b-0748164c18c7" acquired by "delete_volume" :: waited 0.038s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:48:48 devstack sudo[99202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6df688d3-038a-470b-8083-175ec4fa050c Jul 31 10:48:48 devstack sudo[99202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:48 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d13422-ce46-4013-b1b9-372929620ff9]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:48:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a58bb56c-48bc-40d9-8d7f-ce51c34769d5 tempest-TestMinimumBasicScenario-1561219327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b54ffca6-cfc5-438d-b46b-0748164c18c7 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8b7f957f-e123-4248-bb93-18eadbc746be tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:48:48 devstack sudo[99204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b54ffca6-cfc5-438d-b46b-0748164c18c7 Jul 31 10:48:48 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:48 devstack sudo[99200]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-51d5ace9-ff15-4477-b577-f4c8ecf39a3e tempest-AttachVolumeTestJSON-1723809781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f45c24b9-0e69-4bcf-b3f3-f80e9b42e59a" returned: 0 in 0.355s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:48 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-51d5ace9-ff15-4477-b577-f4c8ecf39a3e tempest-AttachVolumeTestJSON-1723809781 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:48:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-51d5ace9-ff15-4477-b577-f4c8ecf39a3e tempest-AttachVolumeTestJSON-1723809781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:48:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8b7f957f-e123-4248-bb93-18eadbc746be tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.197s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:48:48 devstack sudo[99202]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-51d5ace9-ff15-4477-b577-f4c8ecf39a3e tempest-AttachVolumeTestJSON-1723809781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c165d1ff-23de-4eb7-87b7-04e649dfb4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f45c24b9-0e69-4bcf-b3f3-f80e9b42e59a', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:48:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-51d5ace9-ff15-4477-b577-f4c8ecf39a3e tempest-AttachVolumeTestJSON-1723809781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e51b3f-ced5-4bde-b187-8d744d7a0a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:48:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5f84ba50-5329-4965-b3a4-7e94244c0025 tempest-GroupsV314Test-1368155120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6df688d3-038a-470b-8083-175ec4fa050c" returned: 0 in 0.311s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:48 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-8b7f957f-e123-4248-bb93-18eadbc746be tempest-VolumesSnapshotTestJSON-1100319566 None] Creating offline snapshot 526517dd-7b0c-40ac-b0ae-a3d118f4255c of volume e251803f-5bda-4259-8de9-8791639bfce0 {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:48:48 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-51d5ace9-ff15-4477-b577-f4c8ecf39a3e tempest-AttachVolumeTestJSON-1723809781 None] Volume volume-f45c24b9-0e69-4bcf-b3f3-f80e9b42e59a (f45c24b9-0e69-4bcf-b3f3-f80e9b42e59a): created successfully Jul 31 10:48:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-51d5ace9-ff15-4477-b577-f4c8ecf39a3e tempest-AttachVolumeTestJSON-1723809781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e51b3f-ced5-4bde-b187-8d744d7a0a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:48:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-51d5ace9-ff15-4477-b577-f4c8ecf39a3e tempest-AttachVolumeTestJSON-1723809781 None] Flow 'volume_create_manager' (c24e4a88-ff7e-4b7d-8e77-dcd173ef31fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:48:48 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[03775cc9-1a5e-463d-8174-c20b96e9c778]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:48:48 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-5f84ba50-5329-4965-b3a4-7e94244c0025 tempest-GroupsV314Test-1368155120 None] Lock "cinder-quobyte-6df688d3-038a-470b-8083-175ec4fa050c" released by "delete_volume" :: held 1.027s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:48:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8b7f957f-e123-4248-bb93-18eadbc746be tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:48 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-51d5ace9-ff15-4477-b577-f4c8ecf39a3e tempest-AttachVolumeTestJSON-1723809781 None] Created volume successfully. Jul 31 10:48:48 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-5f84ba50-5329-4965-b3a4-7e94244c0025 tempest-GroupsV314Test-1368155120 None] Created reservations ['86474b1c-7f77-4bc1-af91-0a32709e4cfe'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:48:48 devstack cinder-volume[89090]: WARNING cinder.quota [None req-5f84ba50-5329-4965-b3a4-7e94244c0025 tempest-GroupsV314Test-1368155120 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-577403592 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-577403592, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:48:48 devstack sudo[99208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0 Jul 31 10:48:48 devstack cinder-volume[89090]: WARNING cinder.quota [None req-5f84ba50-5329-4965-b3a4-7e94244c0025 tempest-GroupsV314Test-1368155120 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-577403592 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-577403592, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:48:48 devstack sudo[99208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:48 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a58bb56c-48bc-40d9-8d7f-ce51c34769d5 tempest-TestMinimumBasicScenario-1561219327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b54ffca6-cfc5-438d-b46b-0748164c18c7" returned: 0 in 0.464s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a58bb56c-48bc-40d9-8d7f-ce51c34769d5 tempest-TestMinimumBasicScenario-1561219327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b54ffca6-cfc5-438d-b46b-0748164c18c7 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:48 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-5f84ba50-5329-4965-b3a4-7e94244c0025 tempest-GroupsV314Test-1368155120 None] Created reservations ['242d0d33-36c7-4cf6-8102-9032126c3573', '35fdec11-3e20-4f0a-9170-c2e01b582c81', '5893260a-9449-4c8d-bf7f-19fd98b01445', '81ca8018-4818-4501-aea5-139c5c4a96f3'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:48:49 devstack sudo[99214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b54ffca6-cfc5-438d-b46b-0748164c18c7 Jul 31 10:48:49 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-5f84ba50-5329-4965-b3a4-7e94244c0025 tempest-GroupsV314Test-1368155120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:48:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-5f84ba50-5329-4965-b3a4-7e94244c0025 tempest-GroupsV314Test-1368155120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:48:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-5f84ba50-5329-4965-b3a4-7e94244c0025 tempest-GroupsV314Test-1368155120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:48:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-5f84ba50-5329-4965-b3a4-7e94244c0025 tempest-GroupsV314Test-1368155120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:48:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-5f84ba50-5329-4965-b3a4-7e94244c0025 tempest-GroupsV314Test-1368155120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:48:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5f84ba50-5329-4965-b3a4-7e94244c0025 tempest-GroupsV314Test-1368155120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:49 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:48:49 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:49 devstack sudo[99208]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8b7f957f-e123-4248-bb93-18eadbc746be tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0" returned: 0 in 0.485s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8b7f957f-e123-4248-bb93-18eadbc746be tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0.526517dd-7b0c-40ac-b0ae-a3d118f4255c 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:49 devstack sudo[99221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0.526517dd-7b0c-40ac-b0ae-a3d118f4255c 1G Jul 31 10:48:49 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:49 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a58bb56c-48bc-40d9-8d7f-ce51c34769d5 tempest-TestMinimumBasicScenario-1561219327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b54ffca6-cfc5-438d-b46b-0748164c18c7" returned: 0 in 0.424s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:49 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a58bb56c-48bc-40d9-8d7f-ce51c34769d5 tempest-TestMinimumBasicScenario-1561219327 None] Lock "cinder-quobyte-b54ffca6-cfc5-438d-b46b-0748164c18c7" released by "delete_volume" :: held 0.974s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:48:49 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-a58bb56c-48bc-40d9-8d7f-ce51c34769d5 tempest-TestMinimumBasicScenario-1561219327 None] Created reservations ['1bb98e5e-4ce0-44e5-a812-ffe596ead86a', 'ab00fea6-c576-46af-afe0-ea1fcd319daa', '055971bd-e305-4b90-9135-eeed3d7ea353', '1a0d643a-647b-4460-a6a3-043a1c833561'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:48:49 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5f84ba50-5329-4965-b3a4-7e94244c0025 tempest-GroupsV314Test-1368155120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.387s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:49 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-5f84ba50-5329-4965-b3a4-7e94244c0025 tempest-GroupsV314Test-1368155120 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:48:49 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-5f84ba50-5329-4965-b3a4-7e94244c0025 tempest-GroupsV314Test-1368155120 None] Delete group completed successfully. Jul 31 10:48:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a58bb56c-48bc-40d9-8d7f-ce51c34769d5 tempest-TestMinimumBasicScenario-1561219327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:48:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a58bb56c-48bc-40d9-8d7f-ce51c34769d5 tempest-TestMinimumBasicScenario-1561219327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:48:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a58bb56c-48bc-40d9-8d7f-ce51c34769d5 tempest-TestMinimumBasicScenario-1561219327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:48:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a58bb56c-48bc-40d9-8d7f-ce51c34769d5 tempest-TestMinimumBasicScenario-1561219327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:48:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a58bb56c-48bc-40d9-8d7f-ce51c34769d5 tempest-TestMinimumBasicScenario-1561219327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:48:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a58bb56c-48bc-40d9-8d7f-ce51c34769d5 tempest-TestMinimumBasicScenario-1561219327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:49 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:48:49 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:49 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8b7f957f-e123-4248-bb93-18eadbc746be tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0.526517dd-7b0c-40ac-b0ae-a3d118f4255c 1G" returned: 0 in 0.680s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8b7f957f-e123-4248-bb93-18eadbc746be tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e251803f-5bda-4259-8de9-8791639bfce0 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0.526517dd-7b0c-40ac-b0ae-a3d118f4255c {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:50 devstack sudo[99240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e251803f-5bda-4259-8de9-8791639bfce0 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0.526517dd-7b0c-40ac-b0ae-a3d118f4255c Jul 31 10:48:50 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:50 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a58bb56c-48bc-40d9-8d7f-ce51c34769d5 tempest-TestMinimumBasicScenario-1561219327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.391s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:50 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-a58bb56c-48bc-40d9-8d7f-ce51c34769d5 tempest-TestMinimumBasicScenario-1561219327 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:48:50 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-a58bb56c-48bc-40d9-8d7f-ce51c34769d5 tempest-TestMinimumBasicScenario-1561219327 None] Deleted volume successfully. Jul 31 10:48:50 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a58bb56c-48bc-40d9-8d7f-ce51c34769d5 tempest-TestMinimumBasicScenario-1561219327 None] Lock "cinder-b54ffca6-cfc5-438d-b46b-0748164c18c7-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:48:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-8bfbfb96-c4af-4a68-b01c-b1586b237acb req-2ff0596e-46f9-4459-9a00-10167374aecc tempest-AttachVolumeTestJSON-1723809781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:48:50 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8b7f957f-e123-4248-bb93-18eadbc746be tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e251803f-5bda-4259-8de9-8791639bfce0 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0.526517dd-7b0c-40ac-b0ae-a3d118f4255c" returned: 0 in 0.400s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:50 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-8b7f957f-e123-4248-bb93-18eadbc746be tempest-VolumesSnapshotTestJSON-1100319566 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0.526517dd-7b0c-40ac-b0ae-a3d118f4255c is being set with open permissions: ugo+rw Jul 31 10:48:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8b7f957f-e123-4248-bb93-18eadbc746be tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0.526517dd-7b0c-40ac-b0ae-a3d118f4255c {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:50 devstack sudo[99248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0.526517dd-7b0c-40ac-b0ae-a3d118f4255c Jul 31 10:48:50 devstack sudo[99248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:50 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-21433bee-adbb-474d-b223-65ab89d9b6ee tempest-GroupsV314Test-1368155120 None] Acquiring lock "cinder-quobyte-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:48:50 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-21433bee-adbb-474d-b223-65ab89d9b6ee tempest-GroupsV314Test-1368155120 None] Lock "cinder-quobyte-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c" acquired by "delete_volume" :: waited 0.017s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:48:50 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[0706f451-d807-47b1-b59e-ef83035dbc05]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:48:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-21433bee-adbb-474d-b223-65ab89d9b6ee tempest-GroupsV314Test-1368155120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:50 devstack sudo[99248]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8b7f957f-e123-4248-bb93-18eadbc746be tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0.526517dd-7b0c-40ac-b0ae-a3d118f4255c" returned: 0 in 0.328s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:50 devstack sudo[99250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c Jul 31 10:48:50 devstack sudo[99250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8b7f957f-e123-4248-bb93-18eadbc746be tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:50 devstack sudo[99253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0.info Jul 31 10:48:50 devstack sudo[99253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:51 devstack sudo[99250]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-21433bee-adbb-474d-b223-65ab89d9b6ee tempest-GroupsV314Test-1368155120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c" returned: 0 in 0.488s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-21433bee-adbb-474d-b223-65ab89d9b6ee tempest-GroupsV314Test-1368155120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:51 devstack sudo[99259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c Jul 31 10:48:51 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:51 devstack sudo[99253]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8b7f957f-e123-4248-bb93-18eadbc746be tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0.info" returned: 0 in 0.436s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:51 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-8b7f957f-e123-4248-bb93-18eadbc746be tempest-VolumesSnapshotTestJSON-1100319566 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0.info is being set with open permissions: ugo+rw Jul 31 10:48:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8b7f957f-e123-4248-bb93-18eadbc746be tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:51 devstack sudo[99263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0.info Jul 31 10:48:51 devstack sudo[99263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:51 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-21433bee-adbb-474d-b223-65ab89d9b6ee tempest-GroupsV314Test-1368155120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c" returned: 0 in 0.345s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:51 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-21433bee-adbb-474d-b223-65ab89d9b6ee tempest-GroupsV314Test-1368155120 None] Lock "cinder-quobyte-8b2e2ba1-2ad5-44b4-acdf-3f1db754377c" released by "delete_volume" :: held 0.923s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:48:51 devstack sudo[99263]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8b7f957f-e123-4248-bb93-18eadbc746be tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0.info" returned: 0 in 0.293s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8b7f957f-e123-4248-bb93-18eadbc746be tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.787s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:48:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-8bfbfb96-c4af-4a68-b01c-b1586b237acb req-2ff0596e-46f9-4459-9a00-10167374aecc tempest-AttachVolumeTestJSON-1723809781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.281s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:48:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-8bfbfb96-c4af-4a68-b01c-b1586b237acb req-2ff0596e-46f9-4459-9a00-10167374aecc tempest-AttachVolumeTestJSON-1723809781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:48:51 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-21433bee-adbb-474d-b223-65ab89d9b6ee tempest-GroupsV314Test-1368155120 None] Created reservations ['fbfad279-c5f4-48ed-817d-b6196cf0ebfa'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:48:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-8bfbfb96-c4af-4a68-b01c-b1586b237acb req-2ff0596e-46f9-4459-9a00-10167374aecc tempest-AttachVolumeTestJSON-1723809781 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c', 'name': 'volume-f45c24b9-0e69-4bcf-b3f3-f80e9b42e59a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3ecacb22-c522-4c5b-881a-978b9ecaf1ec', 'enforce_multipath': True} {{(pid=89090) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:48:51 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-8b7f957f-e123-4248-bb93-18eadbc746be tempest-VolumesSnapshotTestJSON-1100319566 None] Create snapshot completed successfully Jul 31 10:48:51 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-21433bee-adbb-474d-b223-65ab89d9b6ee tempest-GroupsV314Test-1368155120 None] Created reservations ['05916c8c-e365-486e-80b8-1a5810e44439', '344d955f-f0ca-4f10-b782-fb874658708e', 'aef6f6bb-f053-4318-925e-9a4f228c2e06', '3987aae5-f329-4201-b388-28f3391dee11'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:48:51 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-8bfbfb96-c4af-4a68-b01c-b1586b237acb req-2ff0596e-46f9-4459-9a00-10167374aecc tempest-AttachVolumeTestJSON-1723809781 None] attachment_update completed successfully. Jul 31 10:48:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-21433bee-adbb-474d-b223-65ab89d9b6ee tempest-GroupsV314Test-1368155120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:48:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-21433bee-adbb-474d-b223-65ab89d9b6ee tempest-GroupsV314Test-1368155120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:48:52 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-21433bee-adbb-474d-b223-65ab89d9b6ee tempest-GroupsV314Test-1368155120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:48:52 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-21433bee-adbb-474d-b223-65ab89d9b6ee tempest-GroupsV314Test-1368155120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:48:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-21433bee-adbb-474d-b223-65ab89d9b6ee tempest-GroupsV314Test-1368155120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:48:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-21433bee-adbb-474d-b223-65ab89d9b6ee tempest-GroupsV314Test-1368155120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:52 devstack sudo[99311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:48:52 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:52 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d92c6e67-f97b-47ea-b957-f2820e0cbf71 tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "cinder-526517dd-7b0c-40ac-b0ae-a3d118f4255c-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:48:52 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d92c6e67-f97b-47ea-b957-f2820e0cbf71 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-526517dd-7b0c-40ac-b0ae-a3d118f4255c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:48:52 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d92c6e67-f97b-47ea-b957-f2820e0cbf71 tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "cinder-quobyte-e251803f-5bda-4259-8de9-8791639bfce0" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:48:52 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d92c6e67-f97b-47ea-b957-f2820e0cbf71 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-quobyte-e251803f-5bda-4259-8de9-8791639bfce0" acquired by "delete_snapshot" :: waited 0.037s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:48:52 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d92c6e67-f97b-47ea-b957-f2820e0cbf71 tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "cinder-quobyte-526517dd-7b0c-40ac-b0ae-a3d118f4255c" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:48:52 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d92c6e67-f97b-47ea-b957-f2820e0cbf71 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-quobyte-526517dd-7b0c-40ac-b0ae-a3d118f4255c" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:48:52 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-d92c6e67-f97b-47ea-b957-f2820e0cbf71 tempest-VolumesSnapshotTestJSON-1100319566 None] Deleting offline snapshot 526517dd-7b0c-40ac-b0ae-a3d118f4255c of volume e251803f-5bda-4259-8de9-8791639bfce0 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:48:52 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-d92c6e67-f97b-47ea-b957-f2820e0cbf71 tempest-VolumesSnapshotTestJSON-1100319566 None] snapshot_file for this snap is: volume-e251803f-5bda-4259-8de9-8791639bfce0.526517dd-7b0c-40ac-b0ae-a3d118f4255c {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:48:52 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-21433bee-adbb-474d-b223-65ab89d9b6ee tempest-GroupsV314Test-1368155120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.536s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:52 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-21433bee-adbb-474d-b223-65ab89d9b6ee tempest-GroupsV314Test-1368155120 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:48:52 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-21433bee-adbb-474d-b223-65ab89d9b6ee tempest-GroupsV314Test-1368155120 None] Delete group completed successfully. Jul 31 10:48:52 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4e18a5-d501-4d1e-a8cc-0112e1062242]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:48:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d92c6e67-f97b-47ea-b957-f2820e0cbf71 tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0.526517dd-7b0c-40ac-b0ae-a3d118f4255c {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:52 devstack sudo[99676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0.526517dd-7b0c-40ac-b0ae-a3d118f4255c Jul 31 10:48:52 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:53 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d92c6e67-f97b-47ea-b957-f2820e0cbf71 tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0.526517dd-7b0c-40ac-b0ae-a3d118f4255c" returned: 0 in 0.739s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:53 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-d92c6e67-f97b-47ea-b957-f2820e0cbf71 tempest-VolumesSnapshotTestJSON-1100319566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e251803f-5bda-4259-8de9-8791639bfce0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:48:53 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[98854098-f852-45a9-bce3-6a9fb9c2453e]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:48:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d92c6e67-f97b-47ea-b957-f2820e0cbf71 tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:53 devstack sudo[99685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0 Jul 31 10:48:53 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:54 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d92c6e67-f97b-47ea-b957-f2820e0cbf71 tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0" returned: 0 in 0.571s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d92c6e67-f97b-47ea-b957-f2820e0cbf71 tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0.526517dd-7b0c-40ac-b0ae-a3d118f4255c {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:54 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0.526517dd-7b0c-40ac-b0ae-a3d118f4255c Jul 31 10:48:54 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:54 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d92c6e67-f97b-47ea-b957-f2820e0cbf71 tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0.526517dd-7b0c-40ac-b0ae-a3d118f4255c" returned: 0 in 0.593s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d92c6e67-f97b-47ea-b957-f2820e0cbf71 tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0.526517dd-7b0c-40ac-b0ae-a3d118f4255c {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:54 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0.526517dd-7b0c-40ac-b0ae-a3d118f4255c Jul 31 10:48:54 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:55 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d92c6e67-f97b-47ea-b957-f2820e0cbf71 tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0.526517dd-7b0c-40ac-b0ae-a3d118f4255c" returned: 0 in 0.379s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:55 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d92c6e67-f97b-47ea-b957-f2820e0cbf71 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-quobyte-526517dd-7b0c-40ac-b0ae-a3d118f4255c" released by "_delete_snapshot" :: held 2.516s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:48:55 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d92c6e67-f97b-47ea-b957-f2820e0cbf71 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-quobyte-e251803f-5bda-4259-8de9-8791639bfce0" released by "delete_snapshot" :: held 2.575s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:48:55 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-d92c6e67-f97b-47ea-b957-f2820e0cbf71 tempest-VolumesSnapshotTestJSON-1100319566 None] Created reservations ['9238be4f-31e3-4bd8-bcc2-79b2fbff7087', 'faea9426-b1ae-4442-b820-e94cf652f6e4', 'f912ea6a-25c6-4f76-b130-e5284d63f623', '4ca1d1c9-04c9-4d86-99dc-7dafdcdf8dac'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:48:55 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-d92c6e67-f97b-47ea-b957-f2820e0cbf71 tempest-VolumesSnapshotTestJSON-1100319566 None] Delete snapshot completed successfully. Jul 31 10:48:55 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d92c6e67-f97b-47ea-b957-f2820e0cbf71 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-526517dd-7b0c-40ac-b0ae-a3d118f4255c-delete_snapshot" released by "delete_snapshot" :: held 2.953s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:48:55 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0dc980f-8051-442c-8f78-10ced10f03b1 tempest-AttachVolumeTestJSON-1723809781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:48:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0dc980f-8051-442c-8f78-10ced10f03b1 tempest-AttachVolumeTestJSON-1723809781 None] Flow 'volume_create_manager' (ca9bdd20-1662-499d-b20d-e5c1951cc14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:48:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0dc980f-8051-442c-8f78-10ced10f03b1 tempest-AttachVolumeTestJSON-1723809781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eac0b55-8794-4d90-84af-db3c20f60f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:48:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0dc980f-8051-442c-8f78-10ced10f03b1 tempest-AttachVolumeTestJSON-1723809781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eac0b55-8794-4d90-84af-db3c20f60f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-111981543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c15b046a-c969-4f5f-be3f-1be33bac7375,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f5fa6e507f3474980070de0fe76917c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:48:55Z,use_quota=True,user_id='ef2cbbabbb8844929cc28d92e491639a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:48:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0dc980f-8051-442c-8f78-10ced10f03b1 tempest-AttachVolumeTestJSON-1723809781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (093d8ff2-543e-4f4e-9cb5-2611a32b442c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:48:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0dc980f-8051-442c-8f78-10ced10f03b1 tempest-AttachVolumeTestJSON-1723809781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (093d8ff2-543e-4f4e-9cb5-2611a32b442c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:48:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0dc980f-8051-442c-8f78-10ced10f03b1 tempest-AttachVolumeTestJSON-1723809781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef21d4b-8d60-4990-8b6d-de09e94d0461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:48:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0dc980f-8051-442c-8f78-10ced10f03b1 tempest-AttachVolumeTestJSON-1723809781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef21d4b-8d60-4990-8b6d-de09e94d0461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c15b046a-c969-4f5f-be3f-1be33bac7375', 'volume_name': 'volume-c15b046a-c969-4f5f-be3f-1be33bac7375', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:48:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0dc980f-8051-442c-8f78-10ced10f03b1 tempest-AttachVolumeTestJSON-1723809781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffd63e4a-13fa-47ab-97d3-28e04c902e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:48:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0dc980f-8051-442c-8f78-10ced10f03b1 tempest-AttachVolumeTestJSON-1723809781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffd63e4a-13fa-47ab-97d3-28e04c902e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:48:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0dc980f-8051-442c-8f78-10ced10f03b1 tempest-AttachVolumeTestJSON-1723809781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da5b9c1c-bfca-4ab5-a7cf-5ac4f9ec2f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:48:55 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-c0dc980f-8051-442c-8f78-10ced10f03b1 tempest-AttachVolumeTestJSON-1723809781 None] Volume c15b046a-c969-4f5f-be3f-1be33bac7375: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c15b046a-c969-4f5f-be3f-1be33bac7375', 'volume_size': 1} Jul 31 10:48:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c0dc980f-8051-442c-8f78-10ced10f03b1 tempest-AttachVolumeTestJSON-1723809781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:48:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c0dc980f-8051-442c-8f78-10ced10f03b1 tempest-AttachVolumeTestJSON-1723809781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:48:55 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c0dc980f-8051-442c-8f78-10ced10f03b1 tempest-AttachVolumeTestJSON-1723809781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-111981543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c15b046a-c969-4f5f-be3f-1be33bac7375,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f5fa6e507f3474980070de0fe76917c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:48:55Z,use_quota=True,user_id='ef2cbbabbb8844929cc28d92e491639a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:48:55 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-c0dc980f-8051-442c-8f78-10ced10f03b1 tempest-AttachVolumeTestJSON-1723809781 None] Creating volume c15b046a-c969-4f5f-be3f-1be33bac7375 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:48:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c0dc980f-8051-442c-8f78-10ced10f03b1 tempest-AttachVolumeTestJSON-1723809781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:48:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c0dc980f-8051-442c-8f78-10ced10f03b1 tempest-AttachVolumeTestJSON-1723809781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:48:55 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c0dc980f-8051-442c-8f78-10ced10f03b1 tempest-AttachVolumeTestJSON-1723809781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:48:55 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c0dc980f-8051-442c-8f78-10ced10f03b1 tempest-AttachVolumeTestJSON-1723809781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:48:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c0dc980f-8051-442c-8f78-10ced10f03b1 tempest-AttachVolumeTestJSON-1723809781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:48:55 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c0dc980f-8051-442c-8f78-10ced10f03b1 tempest-AttachVolumeTestJSON-1723809781 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:48:55 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-c0dc980f-8051-442c-8f78-10ced10f03b1 tempest-AttachVolumeTestJSON-1723809781 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:48:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c0dc980f-8051-442c-8f78-10ced10f03b1 tempest-AttachVolumeTestJSON-1723809781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c15b046a-c969-4f5f-be3f-1be33bac7375 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:55 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c15b046a-c969-4f5f-be3f-1be33bac7375 1073741824 Jul 31 10:48:55 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:56 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c0dc980f-8051-442c-8f78-10ced10f03b1 tempest-AttachVolumeTestJSON-1723809781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c15b046a-c969-4f5f-be3f-1be33bac7375 1073741824" returned: 0 in 0.813s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c0dc980f-8051-442c-8f78-10ced10f03b1 tempest-AttachVolumeTestJSON-1723809781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c15b046a-c969-4f5f-be3f-1be33bac7375 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:56 devstack sudo[99705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c15b046a-c969-4f5f-be3f-1be33bac7375 Jul 31 10:48:56 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:56 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-a34d8269-53ca-40ae-bd19-44ef5d124747 tempest-VolumesSnapshotTestJSON-1100319566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:48:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a34d8269-53ca-40ae-bd19-44ef5d124747 tempest-VolumesSnapshotTestJSON-1100319566 None] Flow 'volume_create_manager' (1d39c317-0e17-4b91-b4a8-79f1270cb7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:48:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a34d8269-53ca-40ae-bd19-44ef5d124747 tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (097715d1-a42f-436e-ae0a-b8950a5ca0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:48:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a34d8269-53ca-40ae-bd19-44ef5d124747 tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (097715d1-a42f-436e-ae0a-b8950a5ca0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1298400338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1ec8f70-810c-459c-a078-63c5b8ac2d79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c09007178794d0282b7476475ff6b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:48:57Z,use_quota=True,user_id='cb78e43820644faea3b5e8e6976ed0ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:48:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a34d8269-53ca-40ae-bd19-44ef5d124747 tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (167f2d22-c151-4d7c-b229-9a3e47ac00c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:48:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a34d8269-53ca-40ae-bd19-44ef5d124747 tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (167f2d22-c151-4d7c-b229-9a3e47ac00c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:48:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a34d8269-53ca-40ae-bd19-44ef5d124747 tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a4bd4de-7bd1-44d9-8f67-2ba10deb52b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:48:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a34d8269-53ca-40ae-bd19-44ef5d124747 tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a4bd4de-7bd1-44d9-8f67-2ba10deb52b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1ec8f70-810c-459c-a078-63c5b8ac2d79', 'volume_name': 'volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:48:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a34d8269-53ca-40ae-bd19-44ef5d124747 tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf2dab6-67cd-4f40-bc12-eb5a1677d479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:48:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a34d8269-53ca-40ae-bd19-44ef5d124747 tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf2dab6-67cd-4f40-bc12-eb5a1677d479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:48:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a34d8269-53ca-40ae-bd19-44ef5d124747 tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b200ade5-308a-4a4c-a42a-efb955eb14e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:48:56 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-a34d8269-53ca-40ae-bd19-44ef5d124747 tempest-VolumesSnapshotTestJSON-1100319566 None] Volume d1ec8f70-810c-459c-a078-63c5b8ac2d79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79', 'volume_size': 1} Jul 31 10:48:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a34d8269-53ca-40ae-bd19-44ef5d124747 tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:48:56 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c0dc980f-8051-442c-8f78-10ced10f03b1 tempest-AttachVolumeTestJSON-1723809781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c15b046a-c969-4f5f-be3f-1be33bac7375" returned: 0 in 0.420s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:56 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c0dc980f-8051-442c-8f78-10ced10f03b1 tempest-AttachVolumeTestJSON-1723809781 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:48:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c0dc980f-8051-442c-8f78-10ced10f03b1 tempest-AttachVolumeTestJSON-1723809781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:48:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a34d8269-53ca-40ae-bd19-44ef5d124747 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.046s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:48:56 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a34d8269-53ca-40ae-bd19-44ef5d124747 tempest-VolumesSnapshotTestJSON-1100319566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1298400338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1ec8f70-810c-459c-a078-63c5b8ac2d79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c09007178794d0282b7476475ff6b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:48:57Z,use_quota=True,user_id='cb78e43820644faea3b5e8e6976ed0ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:48:56 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-a34d8269-53ca-40ae-bd19-44ef5d124747 tempest-VolumesSnapshotTestJSON-1100319566 None] Creating volume d1ec8f70-810c-459c-a078-63c5b8ac2d79 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:48:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a34d8269-53ca-40ae-bd19-44ef5d124747 tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:48:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a34d8269-53ca-40ae-bd19-44ef5d124747 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:48:56 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a34d8269-53ca-40ae-bd19-44ef5d124747 tempest-VolumesSnapshotTestJSON-1100319566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:48:56 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a34d8269-53ca-40ae-bd19-44ef5d124747 tempest-VolumesSnapshotTestJSON-1100319566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:48:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a34d8269-53ca-40ae-bd19-44ef5d124747 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:48:56 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a34d8269-53ca-40ae-bd19-44ef5d124747 tempest-VolumesSnapshotTestJSON-1100319566 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:48:56 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-a34d8269-53ca-40ae-bd19-44ef5d124747 tempest-VolumesSnapshotTestJSON-1100319566 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:48:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a34d8269-53ca-40ae-bd19-44ef5d124747 tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:56 devstack sudo[99708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79 1073741824 Jul 31 10:48:56 devstack sudo[99708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0dc980f-8051-442c-8f78-10ced10f03b1 tempest-AttachVolumeTestJSON-1723809781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da5b9c1c-bfca-4ab5-a7cf-5ac4f9ec2f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c15b046a-c969-4f5f-be3f-1be33bac7375', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:48:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0dc980f-8051-442c-8f78-10ced10f03b1 tempest-AttachVolumeTestJSON-1723809781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e40563d1-e40b-4572-b9af-a2c1213ccdde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:48:57 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-c0dc980f-8051-442c-8f78-10ced10f03b1 tempest-AttachVolumeTestJSON-1723809781 None] Volume volume-c15b046a-c969-4f5f-be3f-1be33bac7375 (c15b046a-c969-4f5f-be3f-1be33bac7375): created successfully Jul 31 10:48:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0dc980f-8051-442c-8f78-10ced10f03b1 tempest-AttachVolumeTestJSON-1723809781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e40563d1-e40b-4572-b9af-a2c1213ccdde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:48:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0dc980f-8051-442c-8f78-10ced10f03b1 tempest-AttachVolumeTestJSON-1723809781 None] Flow 'volume_create_manager' (ca9bdd20-1662-499d-b20d-e5c1951cc14b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:48:57 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-c0dc980f-8051-442c-8f78-10ced10f03b1 tempest-AttachVolumeTestJSON-1723809781 None] Created volume successfully. Jul 31 10:48:57 devstack sudo[99708]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a34d8269-53ca-40ae-bd19-44ef5d124747 tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79 1073741824" returned: 0 in 0.708s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a34d8269-53ca-40ae-bd19-44ef5d124747 tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:57 devstack sudo[99718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79 Jul 31 10:48:57 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:58 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a34d8269-53ca-40ae-bd19-44ef5d124747 tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79" returned: 0 in 0.369s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:58 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a34d8269-53ca-40ae-bd19-44ef5d124747 tempest-VolumesSnapshotTestJSON-1100319566 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:48:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a34d8269-53ca-40ae-bd19-44ef5d124747 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:48:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a34d8269-53ca-40ae-bd19-44ef5d124747 tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b200ade5-308a-4a4c-a42a-efb955eb14e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:48:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a34d8269-53ca-40ae-bd19-44ef5d124747 tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8229fe2f-253e-480a-a3b3-1ed6482b3eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:48:58 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-a34d8269-53ca-40ae-bd19-44ef5d124747 tempest-VolumesSnapshotTestJSON-1100319566 None] Volume volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79 (d1ec8f70-810c-459c-a078-63c5b8ac2d79): created successfully Jul 31 10:48:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a34d8269-53ca-40ae-bd19-44ef5d124747 tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8229fe2f-253e-480a-a3b3-1ed6482b3eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:48:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a34d8269-53ca-40ae-bd19-44ef5d124747 tempest-VolumesSnapshotTestJSON-1100319566 None] Flow 'volume_create_manager' (1d39c317-0e17-4b91-b4a8-79f1270cb7d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:48:58 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-a34d8269-53ca-40ae-bd19-44ef5d124747 tempest-VolumesSnapshotTestJSON-1100319566 None] Created volume successfully. Jul 31 10:48:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-045d4dd2-6814-4d0c-a35f-a5f942c5d989 req-2933af8a-b572-4250-a6ec-8732376545a1 tempest-AttachVolumeTestJSON-1723809781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:48:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-045d4dd2-6814-4d0c-a35f-a5f942c5d989 req-2933af8a-b572-4250-a6ec-8732376545a1 tempest-AttachVolumeTestJSON-1723809781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:48:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-325237c9-2ae3-464e-826c-d5b2637e1788 tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:48:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-045d4dd2-6814-4d0c-a35f-a5f942c5d989 req-2933af8a-b572-4250-a6ec-8732376545a1 tempest-AttachVolumeTestJSON-1723809781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:48:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-325237c9-2ae3-464e-826c-d5b2637e1788 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.015s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:48:59 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-325237c9-2ae3-464e-826c-d5b2637e1788 tempest-VolumesSnapshotTestJSON-1100319566 None] Creating offline snapshot c929a2bb-8364-4e6f-85f7-849bd484b00b of volume d1ec8f70-810c-459c-a078-63c5b8ac2d79 {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:48:59 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0d1805-1686-4169-b2fd-b3045e94e786]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:48:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-325237c9-2ae3-464e-826c-d5b2637e1788 tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:59 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-045d4dd2-6814-4d0c-a35f-a5f942c5d989 req-2933af8a-b572-4250-a6ec-8732376545a1 tempest-AttachVolumeTestJSON-1723809781 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c', 'name': 'volume-c15b046a-c969-4f5f-be3f-1be33bac7375', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b7e4f6a5-2963-4ba8-b4d1-abac99f4bc0a', 'enforce_multipath': True} {{(pid=89090) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:48:59 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-045d4dd2-6814-4d0c-a35f-a5f942c5d989 req-2933af8a-b572-4250-a6ec-8732376545a1 tempest-AttachVolumeTestJSON-1723809781 None] attachment_update completed successfully. Jul 31 10:48:59 devstack sudo[99730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79 Jul 31 10:48:59 devstack sudo[99730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:59 devstack sudo[99730]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-325237c9-2ae3-464e-826c-d5b2637e1788 tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79" returned: 0 in 0.666s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-325237c9-2ae3-464e-826c-d5b2637e1788 tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79.c929a2bb-8364-4e6f-85f7-849bd484b00b 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:59 devstack sudo[99740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79.c929a2bb-8364-4e6f-85f7-849bd484b00b 1G Jul 31 10:48:59 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:00 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-325237c9-2ae3-464e-826c-d5b2637e1788 tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79.c929a2bb-8364-4e6f-85f7-849bd484b00b 1G" returned: 0 in 0.768s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-325237c9-2ae3-464e-826c-d5b2637e1788 tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79.c929a2bb-8364-4e6f-85f7-849bd484b00b {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:00 devstack sudo[99752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79.c929a2bb-8364-4e6f-85f7-849bd484b00b Jul 31 10:49:00 devstack sudo[99752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:01 devstack sudo[99752]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-325237c9-2ae3-464e-826c-d5b2637e1788 tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79.c929a2bb-8364-4e6f-85f7-849bd484b00b" returned: 0 in 0.569s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:01 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-325237c9-2ae3-464e-826c-d5b2637e1788 tempest-VolumesSnapshotTestJSON-1100319566 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79.c929a2bb-8364-4e6f-85f7-849bd484b00b is being set with open permissions: ugo+rw Jul 31 10:49:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-325237c9-2ae3-464e-826c-d5b2637e1788 tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79.c929a2bb-8364-4e6f-85f7-849bd484b00b {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:01 devstack sudo[99762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79.c929a2bb-8364-4e6f-85f7-849bd484b00b Jul 31 10:49:01 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:01 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-325237c9-2ae3-464e-826c-d5b2637e1788 tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79.c929a2bb-8364-4e6f-85f7-849bd484b00b" returned: 0 in 0.341s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-325237c9-2ae3-464e-826c-d5b2637e1788 tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:01 devstack sudo[99801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79.info Jul 31 10:49:01 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:02 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-325237c9-2ae3-464e-826c-d5b2637e1788 tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79.info" returned: 0 in 0.491s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:02 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-325237c9-2ae3-464e-826c-d5b2637e1788 tempest-VolumesSnapshotTestJSON-1100319566 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79.info is being set with open permissions: ugo+rw Jul 31 10:49:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-325237c9-2ae3-464e-826c-d5b2637e1788 tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:02 devstack sudo[99806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79.info Jul 31 10:49:02 devstack sudo[99806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:02 devstack sudo[99806]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-325237c9-2ae3-464e-826c-d5b2637e1788 tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79.info" returned: 0 in 0.433s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-325237c9-2ae3-464e-826c-d5b2637e1788 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.428s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:49:02 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-325237c9-2ae3-464e-826c-d5b2637e1788 tempest-VolumesSnapshotTestJSON-1100319566 None] Create snapshot completed successfully Jul 31 10:49:02 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-aa391c53-a2cc-4d7c-bc42-7c518c928d23 req-3b48b850-cd5d-4128-8680-b2386259b072 tempest-AttachVolumeTestJSON-1723809781 None] Terminate volume connection completed successfully. Jul 31 10:49:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-aa391c53-a2cc-4d7c-bc42-7c518c928d23 req-3b48b850-cd5d-4128-8680-b2386259b072 tempest-AttachVolumeTestJSON-1723809781 None] Deleting attachment 3ecacb22-c522-4c5b-881a-978b9ecaf1ec. {{(pid=89090) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:49:04 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:49:04 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Flow 'volume_create_manager' (99c6fb3b-ef1d-4ef0-a24a-060010a4ad23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:49:04 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f7aa400-067b-4ef8-9e16-1786300052c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:04 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f7aa400-067b-4ef8-9e16-1786300052c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1712555921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f1c1da0-cd1c-4b56-9342-be1da3899ce2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c09007178794d0282b7476475ff6b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:49:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=c929a2bb-8364-4e6f-85f7-849bd484b00b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:49:04Z,use_quota=True,user_id='cb78e43820644faea3b5e8e6976ed0ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:04 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e395e59-3d18-46f1-a557-4badc4ec2997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:04 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e395e59-3d18-46f1-a557-4badc4ec2997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:04 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edb4604c-5c44-4491-a462-912115419a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:04 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edb4604c-5c44-4491-a462-912115419a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0f1c1da0-cd1c-4b56-9342-be1da3899ce2', 'volume_name': 'volume-0f1c1da0-cd1c-4b56-9342-be1da3899ce2', 'volume_size': 2, 'snapshot_id': 'c929a2bb-8364-4e6f-85f7-849bd484b00b'}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:04 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89d88708-ad51-442d-98b3-5491c5b3d332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:04 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89d88708-ad51-442d-98b3-5491c5b3d332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:04 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3944dc9-e76e-48b4-8138-9a3db194b0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:04 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Volume 0f1c1da0-cd1c-4b56-9342-be1da3899ce2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0f1c1da0-cd1c-4b56-9342-be1da3899ce2', 'volume_size': 2, 'snapshot_id': 'c929a2bb-8364-4e6f-85f7-849bd484b00b'} Jul 31 10:49:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:49:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:49:04 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "cinder-quobyte-c929a2bb-8364-4e6f-85f7-849bd484b00b-0f1c1da0-cd1c-4b56-9342-be1da3899ce2" by "_create_volume_from_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:49:04 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-quobyte-c929a2bb-8364-4e6f-85f7-849bd484b00b-0f1c1da0-cd1c-4b56-9342-be1da3899ce2" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:49:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Creating volume 0f1c1da0-cd1c-4b56-9342-be1da3899ce2 from snapshot c929a2bb-8364-4e6f-85f7-849bd484b00b {{(pid=89090) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 10:49:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:49:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:49:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:49:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:49:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:49:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:49:04 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "cinder-quobyte-0f1c1da0-cd1c-4b56-9342-be1da3899ce2" by "_copy_volume_from_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:49:04 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-b9db4e86-83bb-4207-bee3-2f4186719eef req-57bfa79f-2cd7-469d-b28a-d68cf4348fc2 tempest-AttachVolumeTestJSON-1723809781 None] Terminate volume connection completed successfully. Jul 31 10:49:04 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-b9db4e86-83bb-4207-bee3-2f4186719eef req-57bfa79f-2cd7-469d-b28a-d68cf4348fc2 tempest-AttachVolumeTestJSON-1723809781 None] Deleting attachment b7e4f6a5-2963-4ba8-b4d1-abac99f4bc0a. {{(pid=89090) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:49:04 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-quobyte-0f1c1da0-cd1c-4b56-9342-be1da3899ce2" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:49:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] snapshot: c929a2bb-8364-4e6f-85f7-849bd484b00b, volume: 0f1c1da0-cd1c-4b56-9342-be1da3899ce2, {{(pid=89090) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 10:49:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:49:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:49:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:49:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:49:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:49:04 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8ef95a-2f03-464d-91c8-3a8eb34c6622]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:49:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79.c929a2bb-8364-4e6f-85f7-849bd484b00b {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:04 devstack sudo[99845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79.c929a2bb-8364-4e6f-85f7-849bd484b00b Jul 31 10:49:04 devstack sudo[99845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:05 devstack sudo[99845]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79.c929a2bb-8364-4e6f-85f7-849bd484b00b" returned: 0 in 0.570s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:05 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:49:05 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25935d1-8fd1-4f5f-b869-c73ac8a9b4cc]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:49:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:05 devstack sudo[99851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79 Jul 31 10:49:05 devstack sudo[99851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:05 devstack sudo[99851]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79" returned: 0 in 0.680s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:05 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79 {{(pid=89090) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 10:49:05 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Creating direct copy from snapshot {{(pid=89090) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 10:49:05 devstack cinder-volume[89090]: DEBUG cinder.utils [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Path /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0f1c1da0-cd1c-4b56-9342-be1da3899ce2 not found in is_blk_device check {{(pid=89090) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 10:49:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0f1c1da0-cd1c-4b56-9342-be1da3899ce2 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:05 devstack sudo[99856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0f1c1da0-cd1c-4b56-9342-be1da3899ce2 Jul 31 10:49:05 devstack sudo[99856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:13 devstack sudo[99856]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0f1c1da0-cd1c-4b56-9342-be1da3899ce2" returned: 0 in 7.330s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:13 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Image conversion details: src /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79, size 1024.00 MB, duration 7.33 sec, destination /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0f1c1da0-cd1c-4b56-9342-be1da3899ce2 {{(pid=89090) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 10:49:13 devstack cinder-volume[89090]: INFO cinder.image.image_utils [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Converted 1024.00 MB image at 139.67 MB/s Jul 31 10:49:13 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0f1c1da0-cd1c-4b56-9342-be1da3899ce2 is being set with open permissions: ugo+rw Jul 31 10:49:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0f1c1da0-cd1c-4b56-9342-be1da3899ce2 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:13 devstack sudo[99903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0f1c1da0-cd1c-4b56-9342-be1da3899ce2 Jul 31 10:49:13 devstack sudo[99903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:13 devstack sudo[99903]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0f1c1da0-cd1c-4b56-9342-be1da3899ce2" returned: 0 in 0.346s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:13 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-quobyte-0f1c1da0-cd1c-4b56-9342-be1da3899ce2" released by "_copy_volume_from_snapshot" :: held 9.083s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:49:13 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-quobyte-c929a2bb-8364-4e6f-85f7-849bd484b00b-0f1c1da0-cd1c-4b56-9342-be1da3899ce2" released by "_create_volume_from_snapshot" :: held 9.172s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:49:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.204s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:49:13 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3944dc9-e76e-48b4-8138-9a3db194b0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f1c1da0-cd1c-4b56-9342-be1da3899ce2', 'volume_size': 2, 'snapshot_id': 'c929a2bb-8364-4e6f-85f7-849bd484b00b'}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:13 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (322ccdd8-3694-4bd0-96db-73624e768658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:13 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Volume volume-0f1c1da0-cd1c-4b56-9342-be1da3899ce2 (0f1c1da0-cd1c-4b56-9342-be1da3899ce2): created successfully Jul 31 10:49:13 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (322ccdd8-3694-4bd0-96db-73624e768658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:13 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Flow 'volume_create_manager' (99c6fb3b-ef1d-4ef0-a24a-060010a4ad23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:49:13 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-0db20e65-dc2b-44fd-9514-216c3f5f13bc tempest-VolumesSnapshotTestJSON-1100319566 None] Created volume successfully. Jul 31 10:49:14 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f1bfa6c1-242c-4347-bba6-52c9596c7821 tempest-AttachVolumeTestJSON-1723809781 None] Acquiring lock "cinder-c15b046a-c969-4f5f-be3f-1be33bac7375-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:49:14 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f1bfa6c1-242c-4347-bba6-52c9596c7821 tempest-AttachVolumeTestJSON-1723809781 None] Lock "cinder-c15b046a-c969-4f5f-be3f-1be33bac7375-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:49:14 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f1bfa6c1-242c-4347-bba6-52c9596c7821 tempest-AttachVolumeTestJSON-1723809781 None] Acquiring lock "cinder-quobyte-c15b046a-c969-4f5f-be3f-1be33bac7375" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:49:14 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f1bfa6c1-242c-4347-bba6-52c9596c7821 tempest-AttachVolumeTestJSON-1723809781 None] Lock "cinder-quobyte-c15b046a-c969-4f5f-be3f-1be33bac7375" acquired by "delete_volume" :: waited 0.017s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:49:14 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdd6808-c027-4a25-bcda-7ce270eae2fc]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:49:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f1bfa6c1-242c-4347-bba6-52c9596c7821 tempest-AttachVolumeTestJSON-1723809781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c15b046a-c969-4f5f-be3f-1be33bac7375 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:14 devstack sudo[99906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c15b046a-c969-4f5f-be3f-1be33bac7375 Jul 31 10:49:14 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:14 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f1bfa6c1-242c-4347-bba6-52c9596c7821 tempest-AttachVolumeTestJSON-1723809781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c15b046a-c969-4f5f-be3f-1be33bac7375" returned: 0 in 0.494s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f1bfa6c1-242c-4347-bba6-52c9596c7821 tempest-AttachVolumeTestJSON-1723809781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c15b046a-c969-4f5f-be3f-1be33bac7375 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:14 devstack sudo[99911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c15b046a-c969-4f5f-be3f-1be33bac7375 Jul 31 10:49:14 devstack sudo[99911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:15 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-835f5b9d-0389-4d51-962e-b823e04f3106 tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "cinder-0f1c1da0-cd1c-4b56-9342-be1da3899ce2-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:49:15 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-835f5b9d-0389-4d51-962e-b823e04f3106 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-0f1c1da0-cd1c-4b56-9342-be1da3899ce2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:49:15 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-835f5b9d-0389-4d51-962e-b823e04f3106 tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "cinder-quobyte-0f1c1da0-cd1c-4b56-9342-be1da3899ce2" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:49:15 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-835f5b9d-0389-4d51-962e-b823e04f3106 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-quobyte-0f1c1da0-cd1c-4b56-9342-be1da3899ce2" acquired by "delete_volume" :: waited 0.024s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:49:15 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c6f285-4160-4d9f-8b47-e037d6a9bf79]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:49:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-835f5b9d-0389-4d51-962e-b823e04f3106 tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0f1c1da0-cd1c-4b56-9342-be1da3899ce2 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:15 devstack sudo[99911]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f1bfa6c1-242c-4347-bba6-52c9596c7821 tempest-AttachVolumeTestJSON-1723809781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c15b046a-c969-4f5f-be3f-1be33bac7375" returned: 0 in 0.344s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:15 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f1bfa6c1-242c-4347-bba6-52c9596c7821 tempest-AttachVolumeTestJSON-1723809781 None] Lock "cinder-quobyte-c15b046a-c969-4f5f-be3f-1be33bac7375" released by "delete_volume" :: held 0.894s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:49:15 devstack sudo[99913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0f1c1da0-cd1c-4b56-9342-be1da3899ce2 Jul 31 10:49:15 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:15 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-f1bfa6c1-242c-4347-bba6-52c9596c7821 tempest-AttachVolumeTestJSON-1723809781 None] Created reservations ['d8409a8c-4857-4823-b1ad-e5991c563b71', '322cf05f-ba66-4e02-af74-098d374bd343', '67ac4392-a3e6-4d11-8ac3-c515bc6a9370', 'a54031d2-387b-4a5b-a3cd-f530ddc9f9ef'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:49:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f1bfa6c1-242c-4347-bba6-52c9596c7821 tempest-AttachVolumeTestJSON-1723809781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:49:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f1bfa6c1-242c-4347-bba6-52c9596c7821 tempest-AttachVolumeTestJSON-1723809781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:49:15 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f1bfa6c1-242c-4347-bba6-52c9596c7821 tempest-AttachVolumeTestJSON-1723809781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:49:15 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f1bfa6c1-242c-4347-bba6-52c9596c7821 tempest-AttachVolumeTestJSON-1723809781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:49:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f1bfa6c1-242c-4347-bba6-52c9596c7821 tempest-AttachVolumeTestJSON-1723809781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:49:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f1bfa6c1-242c-4347-bba6-52c9596c7821 tempest-AttachVolumeTestJSON-1723809781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:15 devstack sudo[99916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:49:15 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:15 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-061bdf2e-019a-4f44-b709-4577f399acd7 tempest-AttachVolumeTestJSON-1723809781 None] Acquiring lock "cinder-f45c24b9-0e69-4bcf-b3f3-f80e9b42e59a-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:49:15 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-061bdf2e-019a-4f44-b709-4577f399acd7 tempest-AttachVolumeTestJSON-1723809781 None] Lock "cinder-f45c24b9-0e69-4bcf-b3f3-f80e9b42e59a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:49:15 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-061bdf2e-019a-4f44-b709-4577f399acd7 tempest-AttachVolumeTestJSON-1723809781 None] Acquiring lock "cinder-quobyte-f45c24b9-0e69-4bcf-b3f3-f80e9b42e59a" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:49:15 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-061bdf2e-019a-4f44-b709-4577f399acd7 tempest-AttachVolumeTestJSON-1723809781 None] Lock "cinder-quobyte-f45c24b9-0e69-4bcf-b3f3-f80e9b42e59a" acquired by "delete_volume" :: waited 0.040s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:49:15 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-835f5b9d-0389-4d51-962e-b823e04f3106 tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0f1c1da0-cd1c-4b56-9342-be1da3899ce2" returned: 0 in 0.610s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-835f5b9d-0389-4d51-962e-b823e04f3106 tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0f1c1da0-cd1c-4b56-9342-be1da3899ce2 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:15 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bf565a-9d32-48bb-9580-c6d2272b640b]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:49:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-061bdf2e-019a-4f44-b709-4577f399acd7 tempest-AttachVolumeTestJSON-1723809781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f45c24b9-0e69-4bcf-b3f3-f80e9b42e59a {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:15 devstack sudo[99921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0f1c1da0-cd1c-4b56-9342-be1da3899ce2 Jul 31 10:49:15 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:16 devstack sudo[99922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f45c24b9-0e69-4bcf-b3f3-f80e9b42e59a Jul 31 10:49:16 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:16 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f1bfa6c1-242c-4347-bba6-52c9596c7821 tempest-AttachVolumeTestJSON-1723809781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.577s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:16 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-f1bfa6c1-242c-4347-bba6-52c9596c7821 tempest-AttachVolumeTestJSON-1723809781 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:49:16 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-f1bfa6c1-242c-4347-bba6-52c9596c7821 tempest-AttachVolumeTestJSON-1723809781 None] Deleted volume successfully. Jul 31 10:49:16 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f1bfa6c1-242c-4347-bba6-52c9596c7821 tempest-AttachVolumeTestJSON-1723809781 None] Lock "cinder-c15b046a-c969-4f5f-be3f-1be33bac7375-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:49:16 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-835f5b9d-0389-4d51-962e-b823e04f3106 tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0f1c1da0-cd1c-4b56-9342-be1da3899ce2" returned: 0 in 0.510s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:16 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-835f5b9d-0389-4d51-962e-b823e04f3106 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-quobyte-0f1c1da0-cd1c-4b56-9342-be1da3899ce2" released by "delete_volume" :: held 1.176s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:49:16 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-835f5b9d-0389-4d51-962e-b823e04f3106 tempest-VolumesSnapshotTestJSON-1100319566 None] Created reservations ['5d9e3cd9-42f0-4415-9676-03077db3ac8b', '30d8f5ea-64f8-4af0-8001-40edbc454c85', '54028a54-b7f0-43d1-ad13-fa469a4737fc', 'c9fd476a-f6ee-4c17-96ac-1439fd22c471'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:49:16 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-061bdf2e-019a-4f44-b709-4577f399acd7 tempest-AttachVolumeTestJSON-1723809781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f45c24b9-0e69-4bcf-b3f3-f80e9b42e59a" returned: 0 in 0.613s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-061bdf2e-019a-4f44-b709-4577f399acd7 tempest-AttachVolumeTestJSON-1723809781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f45c24b9-0e69-4bcf-b3f3-f80e9b42e59a {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:16 devstack sudo[99931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f45c24b9-0e69-4bcf-b3f3-f80e9b42e59a Jul 31 10:49:16 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-835f5b9d-0389-4d51-962e-b823e04f3106 tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:49:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-835f5b9d-0389-4d51-962e-b823e04f3106 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:49:16 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-835f5b9d-0389-4d51-962e-b823e04f3106 tempest-VolumesSnapshotTestJSON-1100319566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:49:16 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-835f5b9d-0389-4d51-962e-b823e04f3106 tempest-VolumesSnapshotTestJSON-1100319566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:49:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-835f5b9d-0389-4d51-962e-b823e04f3106 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:49:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-835f5b9d-0389-4d51-962e-b823e04f3106 tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:16 devstack sudo[99933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:49:16 devstack sudo[99933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:16 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-061bdf2e-019a-4f44-b709-4577f399acd7 tempest-AttachVolumeTestJSON-1723809781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f45c24b9-0e69-4bcf-b3f3-f80e9b42e59a" returned: 0 in 0.346s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:16 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-061bdf2e-019a-4f44-b709-4577f399acd7 tempest-AttachVolumeTestJSON-1723809781 None] Lock "cinder-quobyte-f45c24b9-0e69-4bcf-b3f3-f80e9b42e59a" released by "delete_volume" :: held 1.043s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:49:16 devstack sudo[99933]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:16 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-061bdf2e-019a-4f44-b709-4577f399acd7 tempest-AttachVolumeTestJSON-1723809781 None] Created reservations ['f25c6a1f-6d40-49b4-b092-f3da00dc10d3', 'd793d3ae-f656-4eb5-9aa6-da57cd4ba550', '5b329da8-3eed-4139-b3a0-5510011f9686', 'edb6940c-b78a-46f1-b34f-d960251a5224'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:49:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-835f5b9d-0389-4d51-962e-b823e04f3106 tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.392s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:16 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-835f5b9d-0389-4d51-962e-b823e04f3106 tempest-VolumesSnapshotTestJSON-1100319566 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:49:16 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-835f5b9d-0389-4d51-962e-b823e04f3106 tempest-VolumesSnapshotTestJSON-1100319566 None] Deleted volume successfully. Jul 31 10:49:16 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-835f5b9d-0389-4d51-962e-b823e04f3106 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-0f1c1da0-cd1c-4b56-9342-be1da3899ce2-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:49:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-061bdf2e-019a-4f44-b709-4577f399acd7 tempest-AttachVolumeTestJSON-1723809781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:49:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-061bdf2e-019a-4f44-b709-4577f399acd7 tempest-AttachVolumeTestJSON-1723809781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:49:17 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-061bdf2e-019a-4f44-b709-4577f399acd7 tempest-AttachVolumeTestJSON-1723809781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:49:17 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-061bdf2e-019a-4f44-b709-4577f399acd7 tempest-AttachVolumeTestJSON-1723809781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:49:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-061bdf2e-019a-4f44-b709-4577f399acd7 tempest-AttachVolumeTestJSON-1723809781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:49:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-061bdf2e-019a-4f44-b709-4577f399acd7 tempest-AttachVolumeTestJSON-1723809781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:17 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:49:17 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:17 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-061bdf2e-019a-4f44-b709-4577f399acd7 tempest-AttachVolumeTestJSON-1723809781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.311s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:17 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-061bdf2e-019a-4f44-b709-4577f399acd7 tempest-AttachVolumeTestJSON-1723809781 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:49:17 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-061bdf2e-019a-4f44-b709-4577f399acd7 tempest-AttachVolumeTestJSON-1723809781 None] Deleted volume successfully. Jul 31 10:49:17 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e64558b3-1d40-4aef-ac8b-fd39ac02ff0d tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "cinder-c929a2bb-8364-4e6f-85f7-849bd484b00b-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:49:17 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-061bdf2e-019a-4f44-b709-4577f399acd7 tempest-AttachVolumeTestJSON-1723809781 None] Lock "cinder-f45c24b9-0e69-4bcf-b3f3-f80e9b42e59a-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:49:17 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e64558b3-1d40-4aef-ac8b-fd39ac02ff0d tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-c929a2bb-8364-4e6f-85f7-849bd484b00b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:49:17 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e64558b3-1d40-4aef-ac8b-fd39ac02ff0d tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "cinder-quobyte-d1ec8f70-810c-459c-a078-63c5b8ac2d79" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:49:17 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e64558b3-1d40-4aef-ac8b-fd39ac02ff0d tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-quobyte-d1ec8f70-810c-459c-a078-63c5b8ac2d79" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:49:17 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e64558b3-1d40-4aef-ac8b-fd39ac02ff0d tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "cinder-quobyte-c929a2bb-8364-4e6f-85f7-849bd484b00b" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:49:17 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e64558b3-1d40-4aef-ac8b-fd39ac02ff0d tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-quobyte-c929a2bb-8364-4e6f-85f7-849bd484b00b" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:49:17 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-e64558b3-1d40-4aef-ac8b-fd39ac02ff0d tempest-VolumesSnapshotTestJSON-1100319566 None] Deleting offline snapshot c929a2bb-8364-4e6f-85f7-849bd484b00b of volume d1ec8f70-810c-459c-a078-63c5b8ac2d79 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:49:17 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-e64558b3-1d40-4aef-ac8b-fd39ac02ff0d tempest-VolumesSnapshotTestJSON-1100319566 None] snapshot_file for this snap is: volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79.c929a2bb-8364-4e6f-85f7-849bd484b00b {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:49:17 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[84799241-48da-4c31-ad6e-9669b93daf59]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:49:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e64558b3-1d40-4aef-ac8b-fd39ac02ff0d tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79.c929a2bb-8364-4e6f-85f7-849bd484b00b {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:17 devstack sudo[99941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79.c929a2bb-8364-4e6f-85f7-849bd484b00b Jul 31 10:49:17 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:17 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e64558b3-1d40-4aef-ac8b-fd39ac02ff0d tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79.c929a2bb-8364-4e6f-85f7-849bd484b00b" returned: 0 in 0.456s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:17 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-e64558b3-1d40-4aef-ac8b-fd39ac02ff0d tempest-VolumesSnapshotTestJSON-1100319566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:49:18 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[3931c198-3db6-4301-a418-49d169803182]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:49:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e64558b3-1d40-4aef-ac8b-fd39ac02ff0d tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:18 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-877d30e2-f2f2-42c7-9bda-64be5d5ba7c1 tempest-AttachVolumeTestJSON-1723809781 None] Acquiring lock "cinder-856ea32b-d54b-4c4f-820b-f7fdd64059e2-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:49:18 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-877d30e2-f2f2-42c7-9bda-64be5d5ba7c1 tempest-AttachVolumeTestJSON-1723809781 None] Lock "cinder-856ea32b-d54b-4c4f-820b-f7fdd64059e2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:49:18 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-877d30e2-f2f2-42c7-9bda-64be5d5ba7c1 tempest-AttachVolumeTestJSON-1723809781 None] Acquiring lock "cinder-quobyte-856ea32b-d54b-4c4f-820b-f7fdd64059e2" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:49:18 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-877d30e2-f2f2-42c7-9bda-64be5d5ba7c1 tempest-AttachVolumeTestJSON-1723809781 None] Lock "cinder-quobyte-856ea32b-d54b-4c4f-820b-f7fdd64059e2" acquired by "delete_volume" :: waited 0.023s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:49:18 devstack sudo[99946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79 Jul 31 10:49:18 devstack sudo[99946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:18 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f4042f-6fb8-4b87-8bbb-6b7ac3082146]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:49:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-877d30e2-f2f2-42c7-9bda-64be5d5ba7c1 tempest-AttachVolumeTestJSON-1723809781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-856ea32b-d54b-4c4f-820b-f7fdd64059e2 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:18 devstack sudo[99948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-856ea32b-d54b-4c4f-820b-f7fdd64059e2 Jul 31 10:49:18 devstack sudo[99948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:18 devstack sudo[99948]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-877d30e2-f2f2-42c7-9bda-64be5d5ba7c1 tempest-AttachVolumeTestJSON-1723809781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-856ea32b-d54b-4c4f-820b-f7fdd64059e2" returned: 0 in 0.478s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-877d30e2-f2f2-42c7-9bda-64be5d5ba7c1 tempest-AttachVolumeTestJSON-1723809781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-856ea32b-d54b-4c4f-820b-f7fdd64059e2 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:18 devstack sudo[99955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-856ea32b-d54b-4c4f-820b-f7fdd64059e2 Jul 31 10:49:18 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:18 devstack sudo[99946]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e64558b3-1d40-4aef-ac8b-fd39ac02ff0d tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79" returned: 0 in 0.775s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e64558b3-1d40-4aef-ac8b-fd39ac02ff0d tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79.c929a2bb-8364-4e6f-85f7-849bd484b00b {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:18 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79.c929a2bb-8364-4e6f-85f7-849bd484b00b Jul 31 10:49:18 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:19 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-877d30e2-f2f2-42c7-9bda-64be5d5ba7c1 tempest-AttachVolumeTestJSON-1723809781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-856ea32b-d54b-4c4f-820b-f7fdd64059e2" returned: 0 in 0.360s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:19 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-877d30e2-f2f2-42c7-9bda-64be5d5ba7c1 tempest-AttachVolumeTestJSON-1723809781 None] Lock "cinder-quobyte-856ea32b-d54b-4c4f-820b-f7fdd64059e2" released by "delete_volume" :: held 0.900s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:49:19 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-877d30e2-f2f2-42c7-9bda-64be5d5ba7c1 tempest-AttachVolumeTestJSON-1723809781 None] Created reservations ['ce8d726f-ed44-485f-95bb-4d0a59bbc0e0', '7be2cdf1-673f-4ccb-8af5-c5f81719ae35', 'e01c5d4f-070e-42fb-bef3-54bc76b7b3c4', '0d7c7e03-f452-4cbf-af1d-1764c0b0eb4f'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:49:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-877d30e2-f2f2-42c7-9bda-64be5d5ba7c1 tempest-AttachVolumeTestJSON-1723809781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:49:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-877d30e2-f2f2-42c7-9bda-64be5d5ba7c1 tempest-AttachVolumeTestJSON-1723809781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:49:19 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-877d30e2-f2f2-42c7-9bda-64be5d5ba7c1 tempest-AttachVolumeTestJSON-1723809781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:49:19 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-877d30e2-f2f2-42c7-9bda-64be5d5ba7c1 tempest-AttachVolumeTestJSON-1723809781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:49:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-877d30e2-f2f2-42c7-9bda-64be5d5ba7c1 tempest-AttachVolumeTestJSON-1723809781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:49:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-877d30e2-f2f2-42c7-9bda-64be5d5ba7c1 tempest-AttachVolumeTestJSON-1723809781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:19 devstack sudo[99964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:49:19 devstack sudo[99964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:19 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e64558b3-1d40-4aef-ac8b-fd39ac02ff0d tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79.c929a2bb-8364-4e6f-85f7-849bd484b00b" returned: 0 in 0.593s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e64558b3-1d40-4aef-ac8b-fd39ac02ff0d tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79.c929a2bb-8364-4e6f-85f7-849bd484b00b {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:19 devstack sudo[99966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79.c929a2bb-8364-4e6f-85f7-849bd484b00b Jul 31 10:49:19 devstack sudo[99966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:19 devstack sudo[99964]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-877d30e2-f2f2-42c7-9bda-64be5d5ba7c1 tempest-AttachVolumeTestJSON-1723809781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.358s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:19 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-877d30e2-f2f2-42c7-9bda-64be5d5ba7c1 tempest-AttachVolumeTestJSON-1723809781 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:49:19 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-877d30e2-f2f2-42c7-9bda-64be5d5ba7c1 tempest-AttachVolumeTestJSON-1723809781 None] Deleted volume successfully. Jul 31 10:49:19 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-877d30e2-f2f2-42c7-9bda-64be5d5ba7c1 tempest-AttachVolumeTestJSON-1723809781 None] Lock "cinder-856ea32b-d54b-4c4f-820b-f7fdd64059e2-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:49:19 devstack sudo[99966]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e64558b3-1d40-4aef-ac8b-fd39ac02ff0d tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79.c929a2bb-8364-4e6f-85f7-849bd484b00b" returned: 0 in 0.330s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:19 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e64558b3-1d40-4aef-ac8b-fd39ac02ff0d tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-quobyte-c929a2bb-8364-4e6f-85f7-849bd484b00b" released by "_delete_snapshot" :: held 2.298s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:49:19 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e64558b3-1d40-4aef-ac8b-fd39ac02ff0d tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-quobyte-d1ec8f70-810c-459c-a078-63c5b8ac2d79" released by "delete_snapshot" :: held 2.332s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:49:19 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-e64558b3-1d40-4aef-ac8b-fd39ac02ff0d tempest-VolumesSnapshotTestJSON-1100319566 None] Created reservations ['d64cb7f1-8bdf-4ef4-8253-6187a01f129f', '2e6282ae-7046-45a2-9cc9-c3e164e4e37d', 'fd738b02-c853-4451-8d96-d13d3b3bd3dc', '8f903a5a-8822-43f7-af4f-43eb7d2b1b76'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:49:19 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-e64558b3-1d40-4aef-ac8b-fd39ac02ff0d tempest-VolumesSnapshotTestJSON-1100319566 None] Delete snapshot completed successfully. Jul 31 10:49:19 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e64558b3-1d40-4aef-ac8b-fd39ac02ff0d tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-c929a2bb-8364-4e6f-85f7-849bd484b00b-delete_snapshot" released by "delete_snapshot" :: held 2.529s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:49:20 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-11b6e272-af69-4f42-b5af-691cb7d00247 tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "cinder-d1ec8f70-810c-459c-a078-63c5b8ac2d79-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:49:20 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-11b6e272-af69-4f42-b5af-691cb7d00247 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-d1ec8f70-810c-459c-a078-63c5b8ac2d79-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:49:20 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-11b6e272-af69-4f42-b5af-691cb7d00247 tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "cinder-quobyte-d1ec8f70-810c-459c-a078-63c5b8ac2d79" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:49:20 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-11b6e272-af69-4f42-b5af-691cb7d00247 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-quobyte-d1ec8f70-810c-459c-a078-63c5b8ac2d79" acquired by "delete_volume" :: waited 0.027s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:49:20 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31b3572-ff13-49da-a1aa-cd282dbec067]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:49:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-11b6e272-af69-4f42-b5af-691cb7d00247 tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:21 devstack sudo[99970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79 Jul 31 10:49:21 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:21 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-11b6e272-af69-4f42-b5af-691cb7d00247 tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79" returned: 0 in 0.438s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-11b6e272-af69-4f42-b5af-691cb7d00247 tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:21 devstack sudo[99976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79 Jul 31 10:49:21 devstack sudo[99976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:21 devstack sudo[99976]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-11b6e272-af69-4f42-b5af-691cb7d00247 tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1ec8f70-810c-459c-a078-63c5b8ac2d79" returned: 0 in 0.331s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:21 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-11b6e272-af69-4f42-b5af-691cb7d00247 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-quobyte-d1ec8f70-810c-459c-a078-63c5b8ac2d79" released by "delete_volume" :: held 0.855s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:49:21 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-11b6e272-af69-4f42-b5af-691cb7d00247 tempest-VolumesSnapshotTestJSON-1100319566 None] Created reservations ['315daa0d-3415-4707-b5cd-089e90f22918', 'a70ed33b-660a-44df-bd04-64c46298479a', 'bd8a0ac3-7b63-4677-b165-7f1362a5b5e7', '9bc087d1-adf7-42a3-a904-aea6b5e535aa'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:49:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-11b6e272-af69-4f42-b5af-691cb7d00247 tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:49:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-11b6e272-af69-4f42-b5af-691cb7d00247 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:49:21 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-11b6e272-af69-4f42-b5af-691cb7d00247 tempest-VolumesSnapshotTestJSON-1100319566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:49:21 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-11b6e272-af69-4f42-b5af-691cb7d00247 tempest-VolumesSnapshotTestJSON-1100319566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:49:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-11b6e272-af69-4f42-b5af-691cb7d00247 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:49:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-11b6e272-af69-4f42-b5af-691cb7d00247 tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:21 devstack sudo[99980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:49:22 devstack sudo[99980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:22 devstack sudo[99980]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-11b6e272-af69-4f42-b5af-691cb7d00247 tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.460s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:22 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-11b6e272-af69-4f42-b5af-691cb7d00247 tempest-VolumesSnapshotTestJSON-1100319566 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:49:22 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-11b6e272-af69-4f42-b5af-691cb7d00247 tempest-VolumesSnapshotTestJSON-1100319566 None] Deleted volume successfully. Jul 31 10:49:22 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-11b6e272-af69-4f42-b5af-691cb7d00247 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-d1ec8f70-810c-459c-a078-63c5b8ac2d79-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:49:22 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a8fa724-b3e5-4330-b6d0-fb33956438f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:49:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0a8fa724-b3e5-4330-b6d0-fb33956438f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Flow 'volume_create_manager' (93daac44-3275-4508-aa17-6086d1b27e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:49:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0a8fa724-b3e5-4330-b6d0-fb33956438f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59452efa-0c23-4417-a88f-42c446587a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0a8fa724-b3e5-4330-b6d0-fb33956438f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59452efa-0c23-4417-a88f-42c446587a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1090632146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c09007178794d0282b7476475ff6b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:49:23Z,use_quota=True,user_id='cb78e43820644faea3b5e8e6976ed0ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0a8fa724-b3e5-4330-b6d0-fb33956438f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c22c08c2-743a-449d-97b5-f05de601810b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0a8fa724-b3e5-4330-b6d0-fb33956438f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c22c08c2-743a-449d-97b5-f05de601810b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0a8fa724-b3e5-4330-b6d0-fb33956438f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80e5ad13-228d-44a0-b669-84fc77e01749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0a8fa724-b3e5-4330-b6d0-fb33956438f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80e5ad13-228d-44a0-b669-84fc77e01749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b', 'volume_name': 'volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0a8fa724-b3e5-4330-b6d0-fb33956438f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6faf553-630b-4344-8366-65bce09f759e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0a8fa724-b3e5-4330-b6d0-fb33956438f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6faf553-630b-4344-8366-65bce09f759e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0a8fa724-b3e5-4330-b6d0-fb33956438f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f30643f9-07f7-49c3-8e0a-39f1b3949ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:22 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-0a8fa724-b3e5-4330-b6d0-fb33956438f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Volume 3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b', 'volume_size': 1} Jul 31 10:49:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0a8fa724-b3e5-4330-b6d0-fb33956438f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:49:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0a8fa724-b3e5-4330-b6d0-fb33956438f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:49:22 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0a8fa724-b3e5-4330-b6d0-fb33956438f4 tempest-VolumesSnapshotTestJSON-1100319566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1090632146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c09007178794d0282b7476475ff6b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:49:23Z,use_quota=True,user_id='cb78e43820644faea3b5e8e6976ed0ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:49:22 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-0a8fa724-b3e5-4330-b6d0-fb33956438f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Creating volume 3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:49:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0a8fa724-b3e5-4330-b6d0-fb33956438f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:49:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0a8fa724-b3e5-4330-b6d0-fb33956438f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:49:22 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0a8fa724-b3e5-4330-b6d0-fb33956438f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:49:22 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0a8fa724-b3e5-4330-b6d0-fb33956438f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:49:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0a8fa724-b3e5-4330-b6d0-fb33956438f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:49:22 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0a8fa724-b3e5-4330-b6d0-fb33956438f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:49:22 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-0a8fa724-b3e5-4330-b6d0-fb33956438f4 tempest-VolumesSnapshotTestJSON-1100319566 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:49:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0a8fa724-b3e5-4330-b6d0-fb33956438f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:22 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b 1073741824 Jul 31 10:49:22 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:23 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0a8fa724-b3e5-4330-b6d0-fb33956438f4 tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b 1073741824" returned: 0 in 0.541s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0a8fa724-b3e5-4330-b6d0-fb33956438f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:23 devstack sudo[99989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b Jul 31 10:49:23 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:23 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0a8fa724-b3e5-4330-b6d0-fb33956438f4 tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b" returned: 0 in 0.324s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:23 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0a8fa724-b3e5-4330-b6d0-fb33956438f4 tempest-VolumesSnapshotTestJSON-1100319566 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:49:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0a8fa724-b3e5-4330-b6d0-fb33956438f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:49:23 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0a8fa724-b3e5-4330-b6d0-fb33956438f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f30643f9-07f7-49c3-8e0a-39f1b3949ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:23 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0a8fa724-b3e5-4330-b6d0-fb33956438f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847176a3-8d3d-46ce-b5e2-e9b4c26a43ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:23 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-0a8fa724-b3e5-4330-b6d0-fb33956438f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Volume volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b (3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b): created successfully Jul 31 10:49:23 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0a8fa724-b3e5-4330-b6d0-fb33956438f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847176a3-8d3d-46ce-b5e2-e9b4c26a43ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:23 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0a8fa724-b3e5-4330-b6d0-fb33956438f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Flow 'volume_create_manager' (93daac44-3275-4508-aa17-6086d1b27e4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:49:23 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-0a8fa724-b3e5-4330-b6d0-fb33956438f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Created volume successfully. Jul 31 10:49:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0ed1e6db-3e90-4203-a08a-505a9610ed68 tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:49:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0ed1e6db-3e90-4203-a08a-505a9610ed68 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:49:25 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-0ed1e6db-3e90-4203-a08a-505a9610ed68 tempest-VolumesSnapshotTestJSON-1100319566 None] Creating offline snapshot 34a0aeb9-938e-41e8-a20e-7f09546c6d07 of volume 3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:49:25 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[6680161f-0d50-4372-a0ec-a85f25904a29]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:49:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0ed1e6db-3e90-4203-a08a-505a9610ed68 tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:25 devstack sudo[99992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b Jul 31 10:49:25 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:25 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0ed1e6db-3e90-4203-a08a-505a9610ed68 tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b" returned: 0 in 0.527s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0ed1e6db-3e90-4203-a08a-505a9610ed68 tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b.34a0aeb9-938e-41e8-a20e-7f09546c6d07 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:25 devstack sudo[99998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b.34a0aeb9-938e-41e8-a20e-7f09546c6d07 1G Jul 31 10:49:25 devstack sudo[99998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:26 devstack sudo[99998]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0ed1e6db-3e90-4203-a08a-505a9610ed68 tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b.34a0aeb9-938e-41e8-a20e-7f09546c6d07 1G" returned: 0 in 0.663s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0ed1e6db-3e90-4203-a08a-505a9610ed68 tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b.34a0aeb9-938e-41e8-a20e-7f09546c6d07 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:26 devstack sudo[100004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b.34a0aeb9-938e-41e8-a20e-7f09546c6d07 Jul 31 10:49:26 devstack sudo[100004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:26 devstack sudo[100004]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0ed1e6db-3e90-4203-a08a-505a9610ed68 tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b.34a0aeb9-938e-41e8-a20e-7f09546c6d07" returned: 0 in 0.408s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:26 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-0ed1e6db-3e90-4203-a08a-505a9610ed68 tempest-VolumesSnapshotTestJSON-1100319566 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b.34a0aeb9-938e-41e8-a20e-7f09546c6d07 is being set with open permissions: ugo+rw Jul 31 10:49:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0ed1e6db-3e90-4203-a08a-505a9610ed68 tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b.34a0aeb9-938e-41e8-a20e-7f09546c6d07 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:26 devstack sudo[100010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b.34a0aeb9-938e-41e8-a20e-7f09546c6d07 Jul 31 10:49:26 devstack sudo[100010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:27 devstack sudo[100010]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0ed1e6db-3e90-4203-a08a-505a9610ed68 tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b.34a0aeb9-938e-41e8-a20e-7f09546c6d07" returned: 0 in 0.484s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0ed1e6db-3e90-4203-a08a-505a9610ed68 tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:27 devstack sudo[100014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b.info Jul 31 10:49:27 devstack sudo[100014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:27 devstack sudo[100014]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0ed1e6db-3e90-4203-a08a-505a9610ed68 tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b.info" returned: 0 in 0.362s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:27 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-0ed1e6db-3e90-4203-a08a-505a9610ed68 tempest-VolumesSnapshotTestJSON-1100319566 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b.info is being set with open permissions: ugo+rw Jul 31 10:49:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0ed1e6db-3e90-4203-a08a-505a9610ed68 tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:27 devstack sudo[100017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b.info Jul 31 10:49:27 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:28 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0ed1e6db-3e90-4203-a08a-505a9610ed68 tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b.info" returned: 0 in 0.407s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0ed1e6db-3e90-4203-a08a-505a9610ed68 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.991s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:49:28 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=115,cinder:UPDATE=110,cinder:INSERT=27,cinder:DELETE=6 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:49:28 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=113,cinder:UPDATE=118,cinder:DELETE=9,cinder:INSERT=27 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:49:28 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-0ed1e6db-3e90-4203-a08a-505a9610ed68 tempest-VolumesSnapshotTestJSON-1100319566 None] Create snapshot completed successfully Jul 31 10:49:29 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:49:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Flow 'volume_create_manager' (494673aa-2f82-45b3-9e82-c1a024d4a2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:49:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82f508a9-e6b3-47fc-93db-772080b9fb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82f508a9-e6b3-47fc-93db-772080b9fb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:49:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1987827545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed0e01e2-fef9-480c-84c8-eb3a2b617fc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c09007178794d0282b7476475ff6b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=34a0aeb9-938e-41e8-a20e-7f09546c6d07,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:49:29Z,use_quota=True,user_id='cb78e43820644faea3b5e8e6976ed0ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (100f0147-b935-49ef-b0c4-9f61cbe5d88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (100f0147-b935-49ef-b0c4-9f61cbe5d88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d1b8aae-6b50-4a66-a4e0-76f83c803d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d1b8aae-6b50-4a66-a4e0-76f83c803d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ed0e01e2-fef9-480c-84c8-eb3a2b617fc9', 'volume_name': 'volume-ed0e01e2-fef9-480c-84c8-eb3a2b617fc9', 'volume_size': 1, 'snapshot_id': '34a0aeb9-938e-41e8-a20e-7f09546c6d07'}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f2c1a10-ee39-4baf-b337-f5c4c4d058cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f2c1a10-ee39-4baf-b337-f5c4c4d058cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (409d7c25-6d84-4de9-a551-60b8cf3cef15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:29 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Volume ed0e01e2-fef9-480c-84c8-eb3a2b617fc9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ed0e01e2-fef9-480c-84c8-eb3a2b617fc9', 'volume_size': 1, 'snapshot_id': '34a0aeb9-938e-41e8-a20e-7f09546c6d07'} Jul 31 10:49:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:49:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:49:29 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "cinder-quobyte-34a0aeb9-938e-41e8-a20e-7f09546c6d07-ed0e01e2-fef9-480c-84c8-eb3a2b617fc9" by "_create_volume_from_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:49:29 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-quobyte-34a0aeb9-938e-41e8-a20e-7f09546c6d07-ed0e01e2-fef9-480c-84c8-eb3a2b617fc9" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:49:29 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Creating volume ed0e01e2-fef9-480c-84c8-eb3a2b617fc9 from snapshot 34a0aeb9-938e-41e8-a20e-7f09546c6d07 {{(pid=89090) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 10:49:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:49:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:49:29 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:49:29 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:49:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:49:29 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:49:29 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "cinder-quobyte-ed0e01e2-fef9-480c-84c8-eb3a2b617fc9" by "_copy_volume_from_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:49:29 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-quobyte-ed0e01e2-fef9-480c-84c8-eb3a2b617fc9" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:49:29 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] snapshot: 34a0aeb9-938e-41e8-a20e-7f09546c6d07, volume: ed0e01e2-fef9-480c-84c8-eb3a2b617fc9, {{(pid=89090) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 10:49:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:49:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:49:29 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:49:29 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:49:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:49:29 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a97579-8341-44ae-bfcf-25d308f83979]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:49:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b.34a0aeb9-938e-41e8-a20e-7f09546c6d07 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:29 devstack sudo[100020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b.34a0aeb9-938e-41e8-a20e-7f09546c6d07 Jul 31 10:49:29 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:30 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b.34a0aeb9-938e-41e8-a20e-7f09546c6d07" returned: 0 in 0.598s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:30 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:49:30 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91670c9-4d20-4960-a936-38c44ec49358]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:49:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:30 devstack sudo[100027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b Jul 31 10:49:30 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:30 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [req-e8b70e87-3b20-493b-baac-4e30f0522dc5 req-8c7d2bc2-1754-4f5a-be11-6b8a1831aea5 tempest-VolumesSnapshotsTestJSON-619067719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:49:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-e8b70e87-3b20-493b-baac-4e30f0522dc5 req-8c7d2bc2-1754-4f5a-be11-6b8a1831aea5 tempest-VolumesSnapshotsTestJSON-619067719 None] Flow 'volume_create_manager' (a21dcaf5-158d-4817-8925-738b7f311b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:49:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-e8b70e87-3b20-493b-baac-4e30f0522dc5 req-8c7d2bc2-1754-4f5a-be11-6b8a1831aea5 tempest-VolumesSnapshotsTestJSON-619067719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11d000c0-d8e6-4431-b98f-f10665cc879f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-e8b70e87-3b20-493b-baac-4e30f0522dc5 req-8c7d2bc2-1754-4f5a-be11-6b8a1831aea5 tempest-VolumesSnapshotsTestJSON-619067719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11d000c0-d8e6-4431-b98f-f10665cc879f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1607933467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb1a616-3049-4506-8260-8b187b2b9c98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb7eb0fa8b204ae9a4814a9a01d162e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:49:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:49:30Z,use_quota=True,user_id='4e91d4dfe1044778b864898286c6daec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-e8b70e87-3b20-493b-baac-4e30f0522dc5 req-8c7d2bc2-1754-4f5a-be11-6b8a1831aea5 tempest-VolumesSnapshotsTestJSON-619067719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a39276-b35e-4f0b-9efd-769ad415d1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-e8b70e87-3b20-493b-baac-4e30f0522dc5 req-8c7d2bc2-1754-4f5a-be11-6b8a1831aea5 tempest-VolumesSnapshotsTestJSON-619067719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a39276-b35e-4f0b-9efd-769ad415d1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-e8b70e87-3b20-493b-baac-4e30f0522dc5 req-8c7d2bc2-1754-4f5a-be11-6b8a1831aea5 tempest-VolumesSnapshotsTestJSON-619067719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (004dc055-8be1-4300-9000-b9098fd73eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-e8b70e87-3b20-493b-baac-4e30f0522dc5 req-8c7d2bc2-1754-4f5a-be11-6b8a1831aea5 tempest-VolumesSnapshotsTestJSON-619067719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (004dc055-8be1-4300-9000-b9098fd73eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeb1a616-3049-4506-8260-8b187b2b9c98', 'volume_name': 'volume-aeb1a616-3049-4506-8260-8b187b2b9c98', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-e8b70e87-3b20-493b-baac-4e30f0522dc5 req-8c7d2bc2-1754-4f5a-be11-6b8a1831aea5 tempest-VolumesSnapshotsTestJSON-619067719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c7cecb-9f92-42e7-8d46-1987cfef3abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-e8b70e87-3b20-493b-baac-4e30f0522dc5 req-8c7d2bc2-1754-4f5a-be11-6b8a1831aea5 tempest-VolumesSnapshotsTestJSON-619067719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c7cecb-9f92-42e7-8d46-1987cfef3abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-e8b70e87-3b20-493b-baac-4e30f0522dc5 req-8c7d2bc2-1754-4f5a-be11-6b8a1831aea5 tempest-VolumesSnapshotsTestJSON-619067719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13bc58a2-94b9-4c23-a4d6-46805531ae66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:30 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [req-e8b70e87-3b20-493b-baac-4e30f0522dc5 req-8c7d2bc2-1754-4f5a-be11-6b8a1831aea5 tempest-VolumesSnapshotsTestJSON-619067719 None] Volume aeb1a616-3049-4506-8260-8b187b2b9c98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeb1a616-3049-4506-8260-8b187b2b9c98', 'volume_size': 1} Jul 31 10:49:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-e8b70e87-3b20-493b-baac-4e30f0522dc5 req-8c7d2bc2-1754-4f5a-be11-6b8a1831aea5 tempest-VolumesSnapshotsTestJSON-619067719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:49:30 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b" returned: 0 in 0.695s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:30 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b {{(pid=89090) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 10:49:30 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Creating direct copy from snapshot {{(pid=89090) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 10:49:30 devstack cinder-volume[89090]: DEBUG cinder.utils [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Path /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ed0e01e2-fef9-480c-84c8-eb3a2b617fc9 not found in is_blk_device check {{(pid=89090) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 10:49:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ed0e01e2-fef9-480c-84c8-eb3a2b617fc9 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:30 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ed0e01e2-fef9-480c-84c8-eb3a2b617fc9 Jul 31 10:49:30 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:37 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ed0e01e2-fef9-480c-84c8-eb3a2b617fc9" returned: 0 in 6.169s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:37 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Image conversion details: src /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b, size 1024.00 MB, duration 6.17 sec, destination /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ed0e01e2-fef9-480c-84c8-eb3a2b617fc9 {{(pid=89090) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 10:49:37 devstack cinder-volume[89090]: INFO cinder.image.image_utils [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Converted 1024.00 MB image at 165.95 MB/s Jul 31 10:49:37 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ed0e01e2-fef9-480c-84c8-eb3a2b617fc9 is being set with open permissions: ugo+rw Jul 31 10:49:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ed0e01e2-fef9-480c-84c8-eb3a2b617fc9 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:37 devstack sudo[100049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ed0e01e2-fef9-480c-84c8-eb3a2b617fc9 Jul 31 10:49:37 devstack sudo[100049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:37 devstack sudo[100049]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ed0e01e2-fef9-480c-84c8-eb3a2b617fc9" returned: 0 in 0.302s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-quobyte-ed0e01e2-fef9-480c-84c8-eb3a2b617fc9" released by "_copy_volume_from_snapshot" :: held 7.952s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:49:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-quobyte-34a0aeb9-938e-41e8-a20e-7f09546c6d07-ed0e01e2-fef9-480c-84c8-eb3a2b617fc9" released by "_create_volume_from_snapshot" :: held 8.044s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:49:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.074s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:49:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-e8b70e87-3b20-493b-baac-4e30f0522dc5 req-8c7d2bc2-1754-4f5a-be11-6b8a1831aea5 tempest-VolumesSnapshotsTestJSON-619067719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.789s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:49:37 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [req-e8b70e87-3b20-493b-baac-4e30f0522dc5 req-8c7d2bc2-1754-4f5a-be11-6b8a1831aea5 tempest-VolumesSnapshotsTestJSON-619067719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1607933467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb1a616-3049-4506-8260-8b187b2b9c98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb7eb0fa8b204ae9a4814a9a01d162e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:49:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:49:30Z,use_quota=True,user_id='4e91d4dfe1044778b864898286c6daec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:49:37 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [req-e8b70e87-3b20-493b-baac-4e30f0522dc5 req-8c7d2bc2-1754-4f5a-be11-6b8a1831aea5 tempest-VolumesSnapshotsTestJSON-619067719 None] Creating volume aeb1a616-3049-4506-8260-8b187b2b9c98 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:49:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-e8b70e87-3b20-493b-baac-4e30f0522dc5 req-8c7d2bc2-1754-4f5a-be11-6b8a1831aea5 tempest-VolumesSnapshotsTestJSON-619067719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:49:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-e8b70e87-3b20-493b-baac-4e30f0522dc5 req-8c7d2bc2-1754-4f5a-be11-6b8a1831aea5 tempest-VolumesSnapshotsTestJSON-619067719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:49:37 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [req-e8b70e87-3b20-493b-baac-4e30f0522dc5 req-8c7d2bc2-1754-4f5a-be11-6b8a1831aea5 tempest-VolumesSnapshotsTestJSON-619067719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:49:37 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [req-e8b70e87-3b20-493b-baac-4e30f0522dc5 req-8c7d2bc2-1754-4f5a-be11-6b8a1831aea5 tempest-VolumesSnapshotsTestJSON-619067719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:49:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-e8b70e87-3b20-493b-baac-4e30f0522dc5 req-8c7d2bc2-1754-4f5a-be11-6b8a1831aea5 tempest-VolumesSnapshotsTestJSON-619067719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:49:37 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [req-e8b70e87-3b20-493b-baac-4e30f0522dc5 req-8c7d2bc2-1754-4f5a-be11-6b8a1831aea5 tempest-VolumesSnapshotsTestJSON-619067719 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:49:37 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [req-e8b70e87-3b20-493b-baac-4e30f0522dc5 req-8c7d2bc2-1754-4f5a-be11-6b8a1831aea5 tempest-VolumesSnapshotsTestJSON-619067719 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:49:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-e8b70e87-3b20-493b-baac-4e30f0522dc5 req-8c7d2bc2-1754-4f5a-be11-6b8a1831aea5 tempest-VolumesSnapshotsTestJSON-619067719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:37 devstack sudo[100053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98 1073741824 Jul 31 10:49:37 devstack sudo[100053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:37 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (409d7c25-6d84-4de9-a551-60b8cf3cef15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed0e01e2-fef9-480c-84c8-eb3a2b617fc9', 'volume_size': 1, 'snapshot_id': '34a0aeb9-938e-41e8-a20e-7f09546c6d07'}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:37 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (535f43e9-c639-4545-b844-8e8b86673145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:37 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Volume volume-ed0e01e2-fef9-480c-84c8-eb3a2b617fc9 (ed0e01e2-fef9-480c-84c8-eb3a2b617fc9): created successfully Jul 31 10:49:37 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (535f43e9-c639-4545-b844-8e8b86673145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:37 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Flow 'volume_create_manager' (494673aa-2f82-45b3-9e82-c1a024d4a2d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:49:37 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-d73e82ea-c5c7-41f2-ab2d-2e211fefb3f4 tempest-VolumesSnapshotTestJSON-1100319566 None] Created volume successfully. Jul 31 10:49:38 devstack sudo[100053]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-e8b70e87-3b20-493b-baac-4e30f0522dc5 req-8c7d2bc2-1754-4f5a-be11-6b8a1831aea5 tempest-VolumesSnapshotsTestJSON-619067719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98 1073741824" returned: 0 in 0.584s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-e8b70e87-3b20-493b-baac-4e30f0522dc5 req-8c7d2bc2-1754-4f5a-be11-6b8a1831aea5 tempest-VolumesSnapshotsTestJSON-619067719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:38 devstack sudo[100059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98 Jul 31 10:49:38 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:38 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a9630946-d19d-4d4b-8f32-8f82c7dff0b2 tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "cinder-ed0e01e2-fef9-480c-84c8-eb3a2b617fc9-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:49:38 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a9630946-d19d-4d4b-8f32-8f82c7dff0b2 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-ed0e01e2-fef9-480c-84c8-eb3a2b617fc9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:49:38 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a9630946-d19d-4d4b-8f32-8f82c7dff0b2 tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "cinder-quobyte-ed0e01e2-fef9-480c-84c8-eb3a2b617fc9" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:49:38 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a9630946-d19d-4d4b-8f32-8f82c7dff0b2 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-quobyte-ed0e01e2-fef9-480c-84c8-eb3a2b617fc9" acquired by "delete_volume" :: waited 0.023s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:49:38 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-e8b70e87-3b20-493b-baac-4e30f0522dc5 req-8c7d2bc2-1754-4f5a-be11-6b8a1831aea5 tempest-VolumesSnapshotsTestJSON-619067719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98" returned: 0 in 0.421s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:38 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [req-e8b70e87-3b20-493b-baac-4e30f0522dc5 req-8c7d2bc2-1754-4f5a-be11-6b8a1831aea5 tempest-VolumesSnapshotsTestJSON-619067719 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:49:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-e8b70e87-3b20-493b-baac-4e30f0522dc5 req-8c7d2bc2-1754-4f5a-be11-6b8a1831aea5 tempest-VolumesSnapshotsTestJSON-619067719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:49:38 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[8325bd9c-1b91-40e0-99a7-3d89cc0b61ad]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:49:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a9630946-d19d-4d4b-8f32-8f82c7dff0b2 tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ed0e01e2-fef9-480c-84c8-eb3a2b617fc9 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:38 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-e8b70e87-3b20-493b-baac-4e30f0522dc5 req-8c7d2bc2-1754-4f5a-be11-6b8a1831aea5 tempest-VolumesSnapshotsTestJSON-619067719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13bc58a2-94b9-4c23-a4d6-46805531ae66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeb1a616-3049-4506-8260-8b187b2b9c98', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:38 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-e8b70e87-3b20-493b-baac-4e30f0522dc5 req-8c7d2bc2-1754-4f5a-be11-6b8a1831aea5 tempest-VolumesSnapshotsTestJSON-619067719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8964eca2-a3a5-478b-b6b3-b4b35579ddbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:38 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [req-e8b70e87-3b20-493b-baac-4e30f0522dc5 req-8c7d2bc2-1754-4f5a-be11-6b8a1831aea5 tempest-VolumesSnapshotsTestJSON-619067719 None] Volume volume-aeb1a616-3049-4506-8260-8b187b2b9c98 (aeb1a616-3049-4506-8260-8b187b2b9c98): created successfully Jul 31 10:49:38 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-e8b70e87-3b20-493b-baac-4e30f0522dc5 req-8c7d2bc2-1754-4f5a-be11-6b8a1831aea5 tempest-VolumesSnapshotsTestJSON-619067719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8964eca2-a3a5-478b-b6b3-b4b35579ddbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:38 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-e8b70e87-3b20-493b-baac-4e30f0522dc5 req-8c7d2bc2-1754-4f5a-be11-6b8a1831aea5 tempest-VolumesSnapshotsTestJSON-619067719 None] Flow 'volume_create_manager' (a21dcaf5-158d-4817-8925-738b7f311b56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:49:38 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-e8b70e87-3b20-493b-baac-4e30f0522dc5 req-8c7d2bc2-1754-4f5a-be11-6b8a1831aea5 tempest-VolumesSnapshotsTestJSON-619067719 None] Created volume successfully. Jul 31 10:49:38 devstack sudo[100062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ed0e01e2-fef9-480c-84c8-eb3a2b617fc9 Jul 31 10:49:38 devstack sudo[100062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:39 devstack sudo[100062]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a9630946-d19d-4d4b-8f32-8f82c7dff0b2 tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ed0e01e2-fef9-480c-84c8-eb3a2b617fc9" returned: 0 in 0.478s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a9630946-d19d-4d4b-8f32-8f82c7dff0b2 tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ed0e01e2-fef9-480c-84c8-eb3a2b617fc9 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:39 devstack sudo[100067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ed0e01e2-fef9-480c-84c8-eb3a2b617fc9 Jul 31 10:49:39 devstack sudo[100067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:39 devstack sudo[100067]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a9630946-d19d-4d4b-8f32-8f82c7dff0b2 tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ed0e01e2-fef9-480c-84c8-eb3a2b617fc9" returned: 0 in 0.363s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:39 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a9630946-d19d-4d4b-8f32-8f82c7dff0b2 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-quobyte-ed0e01e2-fef9-480c-84c8-eb3a2b617fc9" released by "delete_volume" :: held 0.915s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:49:39 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-a9630946-d19d-4d4b-8f32-8f82c7dff0b2 tempest-VolumesSnapshotTestJSON-1100319566 None] Created reservations ['3f747a9f-75b4-4e8b-91e0-d893293e4999', '72ab93b1-57cb-4e04-adec-4469092e1212', '71a3c498-1f71-45f0-a58a-1cab56652ff2', '5f374c65-3eac-4891-bd3d-35e186c5f7cd'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:49:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a9630946-d19d-4d4b-8f32-8f82c7dff0b2 tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:49:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a9630946-d19d-4d4b-8f32-8f82c7dff0b2 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:49:39 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a9630946-d19d-4d4b-8f32-8f82c7dff0b2 tempest-VolumesSnapshotTestJSON-1100319566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:49:39 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a9630946-d19d-4d4b-8f32-8f82c7dff0b2 tempest-VolumesSnapshotTestJSON-1100319566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:49:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a9630946-d19d-4d4b-8f32-8f82c7dff0b2 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:49:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a9630946-d19d-4d4b-8f32-8f82c7dff0b2 tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:39 devstack sudo[100070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:49:39 devstack sudo[100070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-b5b3612d-a7d1-42ea-9228-768d17ba98b4 req-c49d77cd-2a99-4741-ae01-24a35cf36f9a tempest-VolumesSnapshotsTestJSON-619067719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:49:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-b5b3612d-a7d1-42ea-9228-768d17ba98b4 req-c49d77cd-2a99-4741-ae01-24a35cf36f9a tempest-VolumesSnapshotsTestJSON-619067719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:49:39 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [req-b5b3612d-a7d1-42ea-9228-768d17ba98b4 req-c49d77cd-2a99-4741-ae01-24a35cf36f9a tempest-VolumesSnapshotsTestJSON-619067719 None] Creating offline snapshot 6b798d4f-ebea-428b-a587-e3b391474af8 of volume aeb1a616-3049-4506-8260-8b187b2b9c98 {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:49:39 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2feaa4b-fe1b-437c-a49a-762c6f081bc1]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:49:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-b5b3612d-a7d1-42ea-9228-768d17ba98b4 req-c49d77cd-2a99-4741-ae01-24a35cf36f9a tempest-VolumesSnapshotsTestJSON-619067719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:39 devstack sudo[100072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98 Jul 31 10:49:39 devstack sudo[100072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:40 devstack sudo[100070]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a9630946-d19d-4d4b-8f32-8f82c7dff0b2 tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.579s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:40 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-a9630946-d19d-4d4b-8f32-8f82c7dff0b2 tempest-VolumesSnapshotTestJSON-1100319566 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:49:40 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-a9630946-d19d-4d4b-8f32-8f82c7dff0b2 tempest-VolumesSnapshotTestJSON-1100319566 None] Deleted volume successfully. Jul 31 10:49:40 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a9630946-d19d-4d4b-8f32-8f82c7dff0b2 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-ed0e01e2-fef9-480c-84c8-eb3a2b617fc9-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:49:40 devstack sudo[100072]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-b5b3612d-a7d1-42ea-9228-768d17ba98b4 req-c49d77cd-2a99-4741-ae01-24a35cf36f9a tempest-VolumesSnapshotsTestJSON-619067719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98" returned: 0 in 0.587s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-b5b3612d-a7d1-42ea-9228-768d17ba98b4 req-c49d77cd-2a99-4741-ae01-24a35cf36f9a tempest-VolumesSnapshotsTestJSON-619067719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98.6b798d4f-ebea-428b-a587-e3b391474af8 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:40 devstack sudo[100079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98.6b798d4f-ebea-428b-a587-e3b391474af8 1G Jul 31 10:49:40 devstack sudo[100079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:40 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-0dbbcab5-1be3-4bfd-9c6b-a71c61184cb9 tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "cinder-34a0aeb9-938e-41e8-a20e-7f09546c6d07-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:49:40 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-0dbbcab5-1be3-4bfd-9c6b-a71c61184cb9 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-34a0aeb9-938e-41e8-a20e-7f09546c6d07-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:49:40 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-0dbbcab5-1be3-4bfd-9c6b-a71c61184cb9 tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "cinder-quobyte-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:49:40 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-0dbbcab5-1be3-4bfd-9c6b-a71c61184cb9 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-quobyte-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b" acquired by "delete_snapshot" :: waited 0.028s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:49:40 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-0dbbcab5-1be3-4bfd-9c6b-a71c61184cb9 tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "cinder-quobyte-34a0aeb9-938e-41e8-a20e-7f09546c6d07" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:49:40 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-0dbbcab5-1be3-4bfd-9c6b-a71c61184cb9 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-quobyte-34a0aeb9-938e-41e8-a20e-7f09546c6d07" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:49:40 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-0dbbcab5-1be3-4bfd-9c6b-a71c61184cb9 tempest-VolumesSnapshotTestJSON-1100319566 None] Deleting offline snapshot 34a0aeb9-938e-41e8-a20e-7f09546c6d07 of volume 3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:49:40 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-0dbbcab5-1be3-4bfd-9c6b-a71c61184cb9 tempest-VolumesSnapshotTestJSON-1100319566 None] snapshot_file for this snap is: volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b.34a0aeb9-938e-41e8-a20e-7f09546c6d07 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:49:40 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fefa88-d8c3-44e8-b19e-c90b56f05053]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:49:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0dbbcab5-1be3-4bfd-9c6b-a71c61184cb9 tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b.34a0aeb9-938e-41e8-a20e-7f09546c6d07 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:41 devstack sudo[100079]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-b5b3612d-a7d1-42ea-9228-768d17ba98b4 req-c49d77cd-2a99-4741-ae01-24a35cf36f9a tempest-VolumesSnapshotsTestJSON-619067719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98.6b798d4f-ebea-428b-a587-e3b391474af8 1G" returned: 0 in 0.686s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-b5b3612d-a7d1-42ea-9228-768d17ba98b4 req-c49d77cd-2a99-4741-ae01-24a35cf36f9a tempest-VolumesSnapshotsTestJSON-619067719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeb1a616-3049-4506-8260-8b187b2b9c98 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98.6b798d4f-ebea-428b-a587-e3b391474af8 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:41 devstack sudo[100086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeb1a616-3049-4506-8260-8b187b2b9c98 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98.6b798d4f-ebea-428b-a587-e3b391474af8 Jul 31 10:49:41 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:41 devstack sudo[100084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b.34a0aeb9-938e-41e8-a20e-7f09546c6d07 Jul 31 10:49:41 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:41 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0dbbcab5-1be3-4bfd-9c6b-a71c61184cb9 tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b.34a0aeb9-938e-41e8-a20e-7f09546c6d07" returned: 0 in 0.692s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:41 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-0dbbcab5-1be3-4bfd-9c6b-a71c61184cb9 tempest-VolumesSnapshotTestJSON-1100319566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:49:41 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b182300-7083-48f5-aae2-90f5a435b3db]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:49:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0dbbcab5-1be3-4bfd-9c6b-a71c61184cb9 tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:41 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-b5b3612d-a7d1-42ea-9228-768d17ba98b4 req-c49d77cd-2a99-4741-ae01-24a35cf36f9a tempest-VolumesSnapshotsTestJSON-619067719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeb1a616-3049-4506-8260-8b187b2b9c98 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98.6b798d4f-ebea-428b-a587-e3b391474af8" returned: 0 in 0.593s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:41 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [req-b5b3612d-a7d1-42ea-9228-768d17ba98b4 req-c49d77cd-2a99-4741-ae01-24a35cf36f9a tempest-VolumesSnapshotsTestJSON-619067719 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98.6b798d4f-ebea-428b-a587-e3b391474af8 is being set with open permissions: ugo+rw Jul 31 10:49:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-b5b3612d-a7d1-42ea-9228-768d17ba98b4 req-c49d77cd-2a99-4741-ae01-24a35cf36f9a tempest-VolumesSnapshotsTestJSON-619067719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98.6b798d4f-ebea-428b-a587-e3b391474af8 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:41 devstack sudo[100097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98.6b798d4f-ebea-428b-a587-e3b391474af8 Jul 31 10:49:41 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:41 devstack sudo[100096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b Jul 31 10:49:41 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:42 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-b5b3612d-a7d1-42ea-9228-768d17ba98b4 req-c49d77cd-2a99-4741-ae01-24a35cf36f9a tempest-VolumesSnapshotsTestJSON-619067719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98.6b798d4f-ebea-428b-a587-e3b391474af8" returned: 0 in 0.426s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-b5b3612d-a7d1-42ea-9228-768d17ba98b4 req-c49d77cd-2a99-4741-ae01-24a35cf36f9a tempest-VolumesSnapshotsTestJSON-619067719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:42 devstack sudo[100103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98.info Jul 31 10:49:42 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:42 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0dbbcab5-1be3-4bfd-9c6b-a71c61184cb9 tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b" returned: 0 in 0.800s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0dbbcab5-1be3-4bfd-9c6b-a71c61184cb9 tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b.34a0aeb9-938e-41e8-a20e-7f09546c6d07 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:42 devstack sudo[100106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b.34a0aeb9-938e-41e8-a20e-7f09546c6d07 Jul 31 10:49:42 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:42 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-b5b3612d-a7d1-42ea-9228-768d17ba98b4 req-c49d77cd-2a99-4741-ae01-24a35cf36f9a tempest-VolumesSnapshotsTestJSON-619067719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98.info" returned: 0 in 0.455s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:42 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [req-b5b3612d-a7d1-42ea-9228-768d17ba98b4 req-c49d77cd-2a99-4741-ae01-24a35cf36f9a tempest-VolumesSnapshotsTestJSON-619067719 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98.info is being set with open permissions: ugo+rw Jul 31 10:49:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-b5b3612d-a7d1-42ea-9228-768d17ba98b4 req-c49d77cd-2a99-4741-ae01-24a35cf36f9a tempest-VolumesSnapshotsTestJSON-619067719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:42 devstack sudo[100109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98.info Jul 31 10:49:42 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:42 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0dbbcab5-1be3-4bfd-9c6b-a71c61184cb9 tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b.34a0aeb9-938e-41e8-a20e-7f09546c6d07" returned: 0 in 0.535s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0dbbcab5-1be3-4bfd-9c6b-a71c61184cb9 tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b.34a0aeb9-938e-41e8-a20e-7f09546c6d07 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:43 devstack sudo[100114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b.34a0aeb9-938e-41e8-a20e-7f09546c6d07 Jul 31 10:49:43 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:43 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-b5b3612d-a7d1-42ea-9228-768d17ba98b4 req-c49d77cd-2a99-4741-ae01-24a35cf36f9a tempest-VolumesSnapshotsTestJSON-619067719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98.info" returned: 0 in 0.453s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-b5b3612d-a7d1-42ea-9228-768d17ba98b4 req-c49d77cd-2a99-4741-ae01-24a35cf36f9a tempest-VolumesSnapshotsTestJSON-619067719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.350s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:49:43 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-b5b3612d-a7d1-42ea-9228-768d17ba98b4 req-c49d77cd-2a99-4741-ae01-24a35cf36f9a tempest-VolumesSnapshotsTestJSON-619067719 None] Create snapshot completed successfully Jul 31 10:49:43 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0dbbcab5-1be3-4bfd-9c6b-a71c61184cb9 tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b.34a0aeb9-938e-41e8-a20e-7f09546c6d07" returned: 0 in 0.383s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:43 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-0dbbcab5-1be3-4bfd-9c6b-a71c61184cb9 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-quobyte-34a0aeb9-938e-41e8-a20e-7f09546c6d07" released by "_delete_snapshot" :: held 2.544s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:49:43 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-0dbbcab5-1be3-4bfd-9c6b-a71c61184cb9 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-quobyte-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b" released by "delete_snapshot" :: held 2.580s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:49:43 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-0dbbcab5-1be3-4bfd-9c6b-a71c61184cb9 tempest-VolumesSnapshotTestJSON-1100319566 None] Created reservations ['909e889b-9a98-4f3b-a335-e3b8eba1ad4d', 'c4085a96-d8e0-4bf2-a965-07384c69375c', '0cb2f746-dc6c-43bf-9b2c-f1cf48f6c217', 'f88dfca8-33d3-4c01-ad66-de39fa00fbf1'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:49:43 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-0dbbcab5-1be3-4bfd-9c6b-a71c61184cb9 tempest-VolumesSnapshotTestJSON-1100319566 None] Delete snapshot completed successfully. Jul 31 10:49:43 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-0dbbcab5-1be3-4bfd-9c6b-a71c61184cb9 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-34a0aeb9-938e-41e8-a20e-7f09546c6d07-delete_snapshot" released by "delete_snapshot" :: held 2.824s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:49:43 devstack cinder-volume[89090]: DEBUG cinder.coordination [req-af46fd16-9efc-4ece-8a8d-7aeec526a941 req-d3500b18-092c-4d58-905d-097b34304c63 tempest-VolumesSnapshotsTestJSON-619067719 None] Acquiring lock "cinder-6b798d4f-ebea-428b-a587-e3b391474af8-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:49:43 devstack cinder-volume[89090]: DEBUG cinder.coordination [req-af46fd16-9efc-4ece-8a8d-7aeec526a941 req-d3500b18-092c-4d58-905d-097b34304c63 tempest-VolumesSnapshotsTestJSON-619067719 None] Lock "cinder-6b798d4f-ebea-428b-a587-e3b391474af8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:49:43 devstack cinder-volume[89090]: DEBUG cinder.coordination [req-af46fd16-9efc-4ece-8a8d-7aeec526a941 req-d3500b18-092c-4d58-905d-097b34304c63 tempest-VolumesSnapshotsTestJSON-619067719 None] Acquiring lock "cinder-quobyte-aeb1a616-3049-4506-8260-8b187b2b9c98" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:49:43 devstack cinder-volume[89090]: DEBUG cinder.coordination [req-af46fd16-9efc-4ece-8a8d-7aeec526a941 req-d3500b18-092c-4d58-905d-097b34304c63 tempest-VolumesSnapshotsTestJSON-619067719 None] Lock "cinder-quobyte-aeb1a616-3049-4506-8260-8b187b2b9c98" acquired by "delete_snapshot" :: waited 0.029s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:49:43 devstack cinder-volume[89090]: DEBUG cinder.coordination [req-af46fd16-9efc-4ece-8a8d-7aeec526a941 req-d3500b18-092c-4d58-905d-097b34304c63 tempest-VolumesSnapshotsTestJSON-619067719 None] Acquiring lock "cinder-quobyte-6b798d4f-ebea-428b-a587-e3b391474af8" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:49:43 devstack cinder-volume[89090]: DEBUG cinder.coordination [req-af46fd16-9efc-4ece-8a8d-7aeec526a941 req-d3500b18-092c-4d58-905d-097b34304c63 tempest-VolumesSnapshotsTestJSON-619067719 None] Lock "cinder-quobyte-6b798d4f-ebea-428b-a587-e3b391474af8" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:49:43 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [req-af46fd16-9efc-4ece-8a8d-7aeec526a941 req-d3500b18-092c-4d58-905d-097b34304c63 tempest-VolumesSnapshotsTestJSON-619067719 None] Deleting offline snapshot 6b798d4f-ebea-428b-a587-e3b391474af8 of volume aeb1a616-3049-4506-8260-8b187b2b9c98 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:49:43 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [req-af46fd16-9efc-4ece-8a8d-7aeec526a941 req-d3500b18-092c-4d58-905d-097b34304c63 tempest-VolumesSnapshotsTestJSON-619067719 None] snapshot_file for this snap is: volume-aeb1a616-3049-4506-8260-8b187b2b9c98.6b798d4f-ebea-428b-a587-e3b391474af8 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:49:43 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c80b0ab-8740-4135-8c45-40927f789db4]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:49:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-af46fd16-9efc-4ece-8a8d-7aeec526a941 req-d3500b18-092c-4d58-905d-097b34304c63 tempest-VolumesSnapshotsTestJSON-619067719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98.6b798d4f-ebea-428b-a587-e3b391474af8 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:44 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98.6b798d4f-ebea-428b-a587-e3b391474af8 Jul 31 10:49:44 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:44 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-019338a1-d355-48d7-8926-70dae2f1d919 tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "cinder-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:49:44 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-019338a1-d355-48d7-8926-70dae2f1d919 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:49:44 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-019338a1-d355-48d7-8926-70dae2f1d919 tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "cinder-quobyte-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:49:44 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-019338a1-d355-48d7-8926-70dae2f1d919 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-quobyte-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b" acquired by "delete_volume" :: waited 0.026s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:49:44 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[54831ca2-29b2-49a6-8b4d-81f3df261a95]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:49:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-019338a1-d355-48d7-8926-70dae2f1d919 tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:44 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-af46fd16-9efc-4ece-8a8d-7aeec526a941 req-d3500b18-092c-4d58-905d-097b34304c63 tempest-VolumesSnapshotsTestJSON-619067719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98.6b798d4f-ebea-428b-a587-e3b391474af8" returned: 0 in 0.509s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:44 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [req-af46fd16-9efc-4ece-8a8d-7aeec526a941 req-d3500b18-092c-4d58-905d-097b34304c63 tempest-VolumesSnapshotsTestJSON-619067719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aeb1a616-3049-4506-8260-8b187b2b9c98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:49:44 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae17067-fc0b-43ef-addb-a75ac7843b93]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:49:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-af46fd16-9efc-4ece-8a8d-7aeec526a941 req-d3500b18-092c-4d58-905d-097b34304c63 tempest-VolumesSnapshotsTestJSON-619067719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:44 devstack sudo[100123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b Jul 31 10:49:44 devstack sudo[100123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:44 devstack sudo[100124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98 Jul 31 10:49:44 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:45 devstack sudo[100123]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-019338a1-d355-48d7-8926-70dae2f1d919 tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b" returned: 0 in 0.561s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-019338a1-d355-48d7-8926-70dae2f1d919 tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:45 devstack sudo[100133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b Jul 31 10:49:45 devstack sudo[100133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:45 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-af46fd16-9efc-4ece-8a8d-7aeec526a941 req-d3500b18-092c-4d58-905d-097b34304c63 tempest-VolumesSnapshotsTestJSON-619067719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98" returned: 0 in 0.588s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-af46fd16-9efc-4ece-8a8d-7aeec526a941 req-d3500b18-092c-4d58-905d-097b34304c63 tempest-VolumesSnapshotsTestJSON-619067719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98.6b798d4f-ebea-428b-a587-e3b391474af8 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:45 devstack sudo[100136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98.6b798d4f-ebea-428b-a587-e3b391474af8 Jul 31 10:49:45 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:45 devstack sudo[100133]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-019338a1-d355-48d7-8926-70dae2f1d919 tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b" returned: 0 in 0.385s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:45 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-019338a1-d355-48d7-8926-70dae2f1d919 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-quobyte-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b" released by "delete_volume" :: held 1.061s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:49:45 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-019338a1-d355-48d7-8926-70dae2f1d919 tempest-VolumesSnapshotTestJSON-1100319566 None] Created reservations ['38e939ca-38cf-44b2-beb3-da175ef286d8', '93db595a-dbeb-4fcf-ac7c-10b2f3c680db', 'd2233664-90e2-4b68-8ef3-7b6fed8a69de', '223ecb76-9320-422a-aae9-be1f02dd4d0b'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:49:45 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-af46fd16-9efc-4ece-8a8d-7aeec526a941 req-d3500b18-092c-4d58-905d-097b34304c63 tempest-VolumesSnapshotsTestJSON-619067719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98.6b798d4f-ebea-428b-a587-e3b391474af8" returned: 0 in 0.615s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-af46fd16-9efc-4ece-8a8d-7aeec526a941 req-d3500b18-092c-4d58-905d-097b34304c63 tempest-VolumesSnapshotsTestJSON-619067719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98.6b798d4f-ebea-428b-a587-e3b391474af8 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-019338a1-d355-48d7-8926-70dae2f1d919 tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:49:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-019338a1-d355-48d7-8926-70dae2f1d919 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:49:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-019338a1-d355-48d7-8926-70dae2f1d919 tempest-VolumesSnapshotTestJSON-1100319566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:49:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-019338a1-d355-48d7-8926-70dae2f1d919 tempest-VolumesSnapshotTestJSON-1100319566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:49:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-019338a1-d355-48d7-8926-70dae2f1d919 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:49:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-019338a1-d355-48d7-8926-70dae2f1d919 tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:45 devstack sudo[100142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98.6b798d4f-ebea-428b-a587-e3b391474af8 Jul 31 10:49:45 devstack sudo[100142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:45 devstack sudo[100144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:49:45 devstack sudo[100144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:45 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:49:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:49:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:49:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:49:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:49:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:49:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:46 devstack sudo[100146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:49:46 devstack sudo[100146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:46 devstack sudo[100142]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-af46fd16-9efc-4ece-8a8d-7aeec526a941 req-d3500b18-092c-4d58-905d-097b34304c63 tempest-VolumesSnapshotsTestJSON-619067719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98.6b798d4f-ebea-428b-a587-e3b391474af8" returned: 0 in 0.397s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:46 devstack sudo[100144]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-019338a1-d355-48d7-8926-70dae2f1d919 tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.441s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:46 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-019338a1-d355-48d7-8926-70dae2f1d919 tempest-VolumesSnapshotTestJSON-1100319566 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:49:46 devstack cinder-volume[89090]: DEBUG cinder.coordination [req-af46fd16-9efc-4ece-8a8d-7aeec526a941 req-d3500b18-092c-4d58-905d-097b34304c63 tempest-VolumesSnapshotsTestJSON-619067719 None] Lock "cinder-quobyte-6b798d4f-ebea-428b-a587-e3b391474af8" released by "_delete_snapshot" :: held 2.320s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:49:46 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-019338a1-d355-48d7-8926-70dae2f1d919 tempest-VolumesSnapshotTestJSON-1100319566 None] Deleted volume successfully. Jul 31 10:49:46 devstack cinder-volume[89090]: DEBUG cinder.coordination [req-af46fd16-9efc-4ece-8a8d-7aeec526a941 req-d3500b18-092c-4d58-905d-097b34304c63 tempest-VolumesSnapshotsTestJSON-619067719 None] Lock "cinder-quobyte-aeb1a616-3049-4506-8260-8b187b2b9c98" released by "delete_snapshot" :: held 2.364s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:49:46 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-019338a1-d355-48d7-8926-70dae2f1d919 tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-3b3d14b0-3408-4bc7-8d5a-189b55dc2d3b-delete_volume" released by "delete_volume" :: held 2.006s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:49:46 devstack sudo[100146]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.397s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:46 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:49:46 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager._thread_info {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:49:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread count: 28 {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:49:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread info: [<_MainThread(MainThread, started 134005426110592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:49:46 devstack cinder-volume[89090]: DEBUG cinder.quota [req-af46fd16-9efc-4ece-8a8d-7aeec526a941 req-d3500b18-092c-4d58-905d-097b34304c63 tempest-VolumesSnapshotsTestJSON-619067719 None] Created reservations ['aa37bf3e-24ae-4f9d-9664-743d2a52a927', '51aac988-ea0f-487d-b52f-eb4b2aef64c9', '4b0fe793-1516-43d8-98b3-2ed099eb2b51', '24d37579-79c2-4cc5-ac99-bb8b2a36ed1d'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:49:46 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-af46fd16-9efc-4ece-8a8d-7aeec526a941 req-d3500b18-092c-4d58-905d-097b34304c63 tempest-VolumesSnapshotsTestJSON-619067719 None] Delete snapshot completed successfully. Jul 31 10:49:46 devstack cinder-volume[89090]: DEBUG cinder.coordination [req-af46fd16-9efc-4ece-8a8d-7aeec526a941 req-d3500b18-092c-4d58-905d-097b34304c63 tempest-VolumesSnapshotsTestJSON-619067719 None] Lock "cinder-6b798d4f-ebea-428b-a587-e3b391474af8-delete_snapshot" released by "delete_snapshot" :: held 2.732s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:49:46 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-87daf8e5-e013-49a1-9ad4-de98457b027d tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "cinder-e251803f-5bda-4259-8de9-8791639bfce0-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:49:46 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-87daf8e5-e013-49a1-9ad4-de98457b027d tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-e251803f-5bda-4259-8de9-8791639bfce0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:49:46 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-87daf8e5-e013-49a1-9ad4-de98457b027d tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "cinder-quobyte-e251803f-5bda-4259-8de9-8791639bfce0" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:49:46 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-87daf8e5-e013-49a1-9ad4-de98457b027d tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-quobyte-e251803f-5bda-4259-8de9-8791639bfce0" acquired by "delete_volume" :: waited 0.017s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:49:46 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc519167-1d29-46da-92f3-e07c723f4bf0]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:49:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-87daf8e5-e013-49a1-9ad4-de98457b027d tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:47 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0 Jul 31 10:49:47 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:47 devstack cinder-volume[89090]: DEBUG cinder.coordination [req-e12f0cc4-999b-4cf8-854c-f478db37fc21 req-17a6dafc-d436-41fd-8c5d-da6d9522f735 tempest-VolumesSnapshotsTestJSON-619067719 None] Acquiring lock "cinder-aeb1a616-3049-4506-8260-8b187b2b9c98-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:49:47 devstack cinder-volume[89090]: DEBUG cinder.coordination [req-e12f0cc4-999b-4cf8-854c-f478db37fc21 req-17a6dafc-d436-41fd-8c5d-da6d9522f735 tempest-VolumesSnapshotsTestJSON-619067719 None] Lock "cinder-aeb1a616-3049-4506-8260-8b187b2b9c98-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:49:47 devstack cinder-volume[89090]: DEBUG cinder.coordination [req-e12f0cc4-999b-4cf8-854c-f478db37fc21 req-17a6dafc-d436-41fd-8c5d-da6d9522f735 tempest-VolumesSnapshotsTestJSON-619067719 None] Acquiring lock "cinder-quobyte-aeb1a616-3049-4506-8260-8b187b2b9c98" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:49:47 devstack cinder-volume[89090]: DEBUG cinder.coordination [req-e12f0cc4-999b-4cf8-854c-f478db37fc21 req-17a6dafc-d436-41fd-8c5d-da6d9522f735 tempest-VolumesSnapshotsTestJSON-619067719 None] Lock "cinder-quobyte-aeb1a616-3049-4506-8260-8b187b2b9c98" acquired by "delete_volume" :: waited 0.031s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:49:47 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-87daf8e5-e013-49a1-9ad4-de98457b027d tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0" returned: 0 in 0.642s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-87daf8e5-e013-49a1-9ad4-de98457b027d tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:47 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[942b71f9-c411-407f-a8b7-70ffe30dc4a8]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:49:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-e12f0cc4-999b-4cf8-854c-f478db37fc21 req-17a6dafc-d436-41fd-8c5d-da6d9522f735 tempest-VolumesSnapshotsTestJSON-619067719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:47 devstack sudo[100158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0 Jul 31 10:49:47 devstack sudo[100158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:47 devstack sudo[100159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98 Jul 31 10:49:47 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:48 devstack sudo[100158]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-87daf8e5-e013-49a1-9ad4-de98457b027d tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e251803f-5bda-4259-8de9-8791639bfce0" returned: 0 in 0.475s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-87daf8e5-e013-49a1-9ad4-de98457b027d tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-quobyte-e251803f-5bda-4259-8de9-8791639bfce0" released by "delete_volume" :: held 1.230s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-87daf8e5-e013-49a1-9ad4-de98457b027d tempest-VolumesSnapshotTestJSON-1100319566 None] Created reservations ['b675b3cd-4cff-4a11-a8fc-c9d127ae5fa6', '13755ea0-88f6-431e-af0c-d0ff656e58bd', '4d5c2a72-3c7f-41df-b057-2df011280121', '0fe4dcc9-7474-459c-8da5-62f457179079'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:49:48 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-e12f0cc4-999b-4cf8-854c-f478db37fc21 req-17a6dafc-d436-41fd-8c5d-da6d9522f735 tempest-VolumesSnapshotsTestJSON-619067719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98" returned: 0 in 0.652s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-e12f0cc4-999b-4cf8-854c-f478db37fc21 req-17a6dafc-d436-41fd-8c5d-da6d9522f735 tempest-VolumesSnapshotsTestJSON-619067719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:48 devstack sudo[100166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98 Jul 31 10:49:48 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-87daf8e5-e013-49a1-9ad4-de98457b027d tempest-VolumesSnapshotTestJSON-1100319566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-87daf8e5-e013-49a1-9ad4-de98457b027d tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-87daf8e5-e013-49a1-9ad4-de98457b027d tempest-VolumesSnapshotTestJSON-1100319566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-87daf8e5-e013-49a1-9ad4-de98457b027d tempest-VolumesSnapshotTestJSON-1100319566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-87daf8e5-e013-49a1-9ad4-de98457b027d tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-87daf8e5-e013-49a1-9ad4-de98457b027d tempest-VolumesSnapshotTestJSON-1100319566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:48 devstack sudo[100168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:49:48 devstack sudo[100168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-85ba4ae9-7216-4b2a-a7f9-28f8d368a78d tempest-VolumesCloneNegativeTest-54069578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-85ba4ae9-7216-4b2a-a7f9-28f8d368a78d tempest-VolumesCloneNegativeTest-54069578 None] Flow 'volume_create_manager' (7318f761-fd5d-4690-ab6f-e8adcccf26f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-85ba4ae9-7216-4b2a-a7f9-28f8d368a78d tempest-VolumesCloneNegativeTest-54069578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (765a8395-5d97-48b6-9c03-4ad732d59d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-85ba4ae9-7216-4b2a-a7f9-28f8d368a78d tempest-VolumesCloneNegativeTest-54069578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (765a8395-5d97-48b6-9c03-4ad732d59d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-391533730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9abe680d-71fc-42c2-a8cb-43dda7bf7a28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b165f5fa882d41deb09d600f4f44f454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:49:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:49:48Z,use_quota=True,user_id='eaf5e5f1779a42c5b9357c7bf3579d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-85ba4ae9-7216-4b2a-a7f9-28f8d368a78d tempest-VolumesCloneNegativeTest-54069578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47192fdc-e87d-413b-b495-f004f14650a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-85ba4ae9-7216-4b2a-a7f9-28f8d368a78d tempest-VolumesCloneNegativeTest-54069578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47192fdc-e87d-413b-b495-f004f14650a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-85ba4ae9-7216-4b2a-a7f9-28f8d368a78d tempest-VolumesCloneNegativeTest-54069578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bd18c22-5fe7-4e57-ae2e-90969cccb0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-85ba4ae9-7216-4b2a-a7f9-28f8d368a78d tempest-VolumesCloneNegativeTest-54069578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bd18c22-5fe7-4e57-ae2e-90969cccb0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9abe680d-71fc-42c2-a8cb-43dda7bf7a28', 'volume_name': 'volume-9abe680d-71fc-42c2-a8cb-43dda7bf7a28', 'volume_size': 2}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-85ba4ae9-7216-4b2a-a7f9-28f8d368a78d tempest-VolumesCloneNegativeTest-54069578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7eb0257-6cfa-422b-9175-87ae9078d4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:48 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-85ba4ae9-7216-4b2a-a7f9-28f8d368a78d tempest-VolumesCloneNegativeTest-54069578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7eb0257-6cfa-422b-9175-87ae9078d4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-85ba4ae9-7216-4b2a-a7f9-28f8d368a78d tempest-VolumesCloneNegativeTest-54069578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71d95f8b-c28d-47f3-8e2f-501ec316aeb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:48 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-85ba4ae9-7216-4b2a-a7f9-28f8d368a78d tempest-VolumesCloneNegativeTest-54069578 None] Volume 9abe680d-71fc-42c2-a8cb-43dda7bf7a28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9abe680d-71fc-42c2-a8cb-43dda7bf7a28', 'volume_size': 2} Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-85ba4ae9-7216-4b2a-a7f9-28f8d368a78d tempest-VolumesCloneNegativeTest-54069578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-85ba4ae9-7216-4b2a-a7f9-28f8d368a78d tempest-VolumesCloneNegativeTest-54069578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-85ba4ae9-7216-4b2a-a7f9-28f8d368a78d tempest-VolumesCloneNegativeTest-54069578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-391533730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9abe680d-71fc-42c2-a8cb-43dda7bf7a28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b165f5fa882d41deb09d600f4f44f454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:49:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:49:48Z,use_quota=True,user_id='eaf5e5f1779a42c5b9357c7bf3579d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-85ba4ae9-7216-4b2a-a7f9-28f8d368a78d tempest-VolumesCloneNegativeTest-54069578 None] Creating volume 9abe680d-71fc-42c2-a8cb-43dda7bf7a28 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-85ba4ae9-7216-4b2a-a7f9-28f8d368a78d tempest-VolumesCloneNegativeTest-54069578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-85ba4ae9-7216-4b2a-a7f9-28f8d368a78d tempest-VolumesCloneNegativeTest-54069578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-85ba4ae9-7216-4b2a-a7f9-28f8d368a78d tempest-VolumesCloneNegativeTest-54069578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-85ba4ae9-7216-4b2a-a7f9-28f8d368a78d tempest-VolumesCloneNegativeTest-54069578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-85ba4ae9-7216-4b2a-a7f9-28f8d368a78d tempest-VolumesCloneNegativeTest-54069578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-85ba4ae9-7216-4b2a-a7f9-28f8d368a78d tempest-VolumesCloneNegativeTest-54069578 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:49:48 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-85ba4ae9-7216-4b2a-a7f9-28f8d368a78d tempest-VolumesCloneNegativeTest-54069578 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-85ba4ae9-7216-4b2a-a7f9-28f8d368a78d tempest-VolumesCloneNegativeTest-54069578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9abe680d-71fc-42c2-a8cb-43dda7bf7a28 2147483648 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-e12f0cc4-999b-4cf8-854c-f478db37fc21 req-17a6dafc-d436-41fd-8c5d-da6d9522f735 tempest-VolumesSnapshotsTestJSON-619067719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aeb1a616-3049-4506-8260-8b187b2b9c98" returned: 0 in 0.429s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:48 devstack sudo[100172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9abe680d-71fc-42c2-a8cb-43dda7bf7a28 2147483648 Jul 31 10:49:48 devstack sudo[100172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG cinder.coordination [req-e12f0cc4-999b-4cf8-854c-f478db37fc21 req-17a6dafc-d436-41fd-8c5d-da6d9522f735 tempest-VolumesSnapshotsTestJSON-619067719 None] Lock "cinder-quobyte-aeb1a616-3049-4506-8260-8b187b2b9c98" released by "delete_volume" :: held 1.190s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:49:48 devstack sudo[100168]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-87daf8e5-e013-49a1-9ad4-de98457b027d tempest-VolumesSnapshotTestJSON-1100319566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.390s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-87daf8e5-e013-49a1-9ad4-de98457b027d tempest-VolumesSnapshotTestJSON-1100319566 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:49:48 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-87daf8e5-e013-49a1-9ad4-de98457b027d tempest-VolumesSnapshotTestJSON-1100319566 None] Deleted volume successfully. Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-87daf8e5-e013-49a1-9ad4-de98457b027d tempest-VolumesSnapshotTestJSON-1100319566 None] Lock "cinder-e251803f-5bda-4259-8de9-8791639bfce0-delete_volume" released by "delete_volume" :: held 2.020s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG cinder.quota [req-e12f0cc4-999b-4cf8-854c-f478db37fc21 req-17a6dafc-d436-41fd-8c5d-da6d9522f735 tempest-VolumesSnapshotsTestJSON-619067719 None] Created reservations ['add27b7e-183d-4d30-ae3f-100624a1d511', '86bd993c-ab9e-41b7-acf9-cc638487960a', 'c7b7f709-83da-469e-a4ed-753f6c8fbcba', 'eda67b37-2d4f-4831-9fbe-26a87a7c7fad'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-e12f0cc4-999b-4cf8-854c-f478db37fc21 req-17a6dafc-d436-41fd-8c5d-da6d9522f735 tempest-VolumesSnapshotsTestJSON-619067719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-e12f0cc4-999b-4cf8-854c-f478db37fc21 req-17a6dafc-d436-41fd-8c5d-da6d9522f735 tempest-VolumesSnapshotsTestJSON-619067719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [req-e12f0cc4-999b-4cf8-854c-f478db37fc21 req-17a6dafc-d436-41fd-8c5d-da6d9522f735 tempest-VolumesSnapshotsTestJSON-619067719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [req-e12f0cc4-999b-4cf8-854c-f478db37fc21 req-17a6dafc-d436-41fd-8c5d-da6d9522f735 tempest-VolumesSnapshotsTestJSON-619067719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-e12f0cc4-999b-4cf8-854c-f478db37fc21 req-17a6dafc-d436-41fd-8c5d-da6d9522f735 tempest-VolumesSnapshotsTestJSON-619067719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:49:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-e12f0cc4-999b-4cf8-854c-f478db37fc21 req-17a6dafc-d436-41fd-8c5d-da6d9522f735 tempest-VolumesSnapshotsTestJSON-619067719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:48 devstack sudo[100176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:49:48 devstack sudo[100176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-13dc5638-f2af-4702-93a9-8af8000741ba tempest-TestServerVolumeAttachmentScenario-666866145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-13dc5638-f2af-4702-93a9-8af8000741ba tempest-TestServerVolumeAttachmentScenario-666866145 None] Flow 'volume_create_manager' (0bceff0a-a6c9-4327-b62e-2ade9d3df767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-13dc5638-f2af-4702-93a9-8af8000741ba tempest-TestServerVolumeAttachmentScenario-666866145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f96e653-035a-47ba-b7d6-b5d1c5d9feac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-13dc5638-f2af-4702-93a9-8af8000741ba tempest-TestServerVolumeAttachmentScenario-666866145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f96e653-035a-47ba-b7d6-b5d1c5d9feac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1222790889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f47e99a-7f41-47b5-b27d-0fb7b9bea336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b062139c436449bba3a32d8eb48c6002',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:49:49Z,use_quota=True,user_id='9bb3a91eb7f6451d91fa45b74d821969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-13dc5638-f2af-4702-93a9-8af8000741ba tempest-TestServerVolumeAttachmentScenario-666866145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b31e139-25c3-42f2-9694-2f68e9d29c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-13dc5638-f2af-4702-93a9-8af8000741ba tempest-TestServerVolumeAttachmentScenario-666866145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b31e139-25c3-42f2-9694-2f68e9d29c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-13dc5638-f2af-4702-93a9-8af8000741ba tempest-TestServerVolumeAttachmentScenario-666866145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ffcb54f-cb5d-4824-a6fa-084df7185e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-13dc5638-f2af-4702-93a9-8af8000741ba tempest-TestServerVolumeAttachmentScenario-666866145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ffcb54f-cb5d-4824-a6fa-084df7185e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f47e99a-7f41-47b5-b27d-0fb7b9bea336', 'volume_name': 'volume-5f47e99a-7f41-47b5-b27d-0fb7b9bea336', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-13dc5638-f2af-4702-93a9-8af8000741ba tempest-TestServerVolumeAttachmentScenario-666866145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae30a7b5-beb0-46e7-bbdc-9722b7551beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-13dc5638-f2af-4702-93a9-8af8000741ba tempest-TestServerVolumeAttachmentScenario-666866145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae30a7b5-beb0-46e7-bbdc-9722b7551beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:49 devstack sudo[100176]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-13dc5638-f2af-4702-93a9-8af8000741ba tempest-TestServerVolumeAttachmentScenario-666866145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6a22735-ace1-43fe-b7c4-a76ce3c71970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:49 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-13dc5638-f2af-4702-93a9-8af8000741ba tempest-TestServerVolumeAttachmentScenario-666866145 None] Volume 5f47e99a-7f41-47b5-b27d-0fb7b9bea336: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f47e99a-7f41-47b5-b27d-0fb7b9bea336', 'volume_size': 1} Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-13dc5638-f2af-4702-93a9-8af8000741ba tempest-TestServerVolumeAttachmentScenario-666866145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-e12f0cc4-999b-4cf8-854c-f478db37fc21 req-17a6dafc-d436-41fd-8c5d-da6d9522f735 tempest-VolumesSnapshotsTestJSON-619067719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.407s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG cinder.manager [req-e12f0cc4-999b-4cf8-854c-f478db37fc21 req-17a6dafc-d436-41fd-8c5d-da6d9522f735 tempest-VolumesSnapshotsTestJSON-619067719 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:49:49 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-e12f0cc4-999b-4cf8-854c-f478db37fc21 req-17a6dafc-d436-41fd-8c5d-da6d9522f735 tempest-VolumesSnapshotsTestJSON-619067719 None] Deleted volume successfully. Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG cinder.coordination [req-e12f0cc4-999b-4cf8-854c-f478db37fc21 req-17a6dafc-d436-41fd-8c5d-da6d9522f735 tempest-VolumesSnapshotsTestJSON-619067719 None] Lock "cinder-aeb1a616-3049-4506-8260-8b187b2b9c98-delete_volume" released by "delete_volume" :: held 1.988s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:49:49 devstack sudo[100172]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-85ba4ae9-7216-4b2a-a7f9-28f8d368a78d tempest-VolumesCloneNegativeTest-54069578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9abe680d-71fc-42c2-a8cb-43dda7bf7a28 2147483648" returned: 0 in 0.807s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-85ba4ae9-7216-4b2a-a7f9-28f8d368a78d tempest-VolumesCloneNegativeTest-54069578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9abe680d-71fc-42c2-a8cb-43dda7bf7a28 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:49 devstack sudo[100181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9abe680d-71fc-42c2-a8cb-43dda7bf7a28 Jul 31 10:49:49 devstack sudo[100181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-89ab3e88-f1b6-4213-a31e-386fd5028287 tempest-TestServerVolumeAttachmentScenario-666866145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-89ab3e88-f1b6-4213-a31e-386fd5028287 tempest-TestServerVolumeAttachmentScenario-666866145 None] Flow 'volume_create_manager' (475ee456-03ca-4f28-9153-8b24bc90c8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-89ab3e88-f1b6-4213-a31e-386fd5028287 tempest-TestServerVolumeAttachmentScenario-666866145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b60f35c1-f861-4000-beaa-288721c13b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:49 devstack sudo[100181]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-85ba4ae9-7216-4b2a-a7f9-28f8d368a78d tempest-VolumesCloneNegativeTest-54069578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9abe680d-71fc-42c2-a8cb-43dda7bf7a28" returned: 0 in 0.364s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-85ba4ae9-7216-4b2a-a7f9-28f8d368a78d tempest-VolumesCloneNegativeTest-54069578 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-85ba4ae9-7216-4b2a-a7f9-28f8d368a78d tempest-VolumesCloneNegativeTest-54069578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-13dc5638-f2af-4702-93a9-8af8000741ba tempest-TestServerVolumeAttachmentScenario-666866145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.551s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-13dc5638-f2af-4702-93a9-8af8000741ba tempest-TestServerVolumeAttachmentScenario-666866145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1222790889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f47e99a-7f41-47b5-b27d-0fb7b9bea336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b062139c436449bba3a32d8eb48c6002',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:49:49Z,use_quota=True,user_id='9bb3a91eb7f6451d91fa45b74d821969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-13dc5638-f2af-4702-93a9-8af8000741ba tempest-TestServerVolumeAttachmentScenario-666866145 None] Creating volume 5f47e99a-7f41-47b5-b27d-0fb7b9bea336 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-13dc5638-f2af-4702-93a9-8af8000741ba tempest-TestServerVolumeAttachmentScenario-666866145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-13dc5638-f2af-4702-93a9-8af8000741ba tempest-TestServerVolumeAttachmentScenario-666866145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-13dc5638-f2af-4702-93a9-8af8000741ba tempest-TestServerVolumeAttachmentScenario-666866145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-13dc5638-f2af-4702-93a9-8af8000741ba tempest-TestServerVolumeAttachmentScenario-666866145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-13dc5638-f2af-4702-93a9-8af8000741ba tempest-TestServerVolumeAttachmentScenario-666866145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-13dc5638-f2af-4702-93a9-8af8000741ba tempest-TestServerVolumeAttachmentScenario-666866145 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:49:49 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-13dc5638-f2af-4702-93a9-8af8000741ba tempest-TestServerVolumeAttachmentScenario-666866145 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-13dc5638-f2af-4702-93a9-8af8000741ba tempest-TestServerVolumeAttachmentScenario-666866145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5f47e99a-7f41-47b5-b27d-0fb7b9bea336 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-89ab3e88-f1b6-4213-a31e-386fd5028287 tempest-TestServerVolumeAttachmentScenario-666866145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b60f35c1-f861-4000-beaa-288721c13b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-450398083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1341c917-f7a8-4cfd-8ae9-1295d879381e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b062139c436449bba3a32d8eb48c6002',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:49:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:49:50Z,use_quota=True,user_id='9bb3a91eb7f6451d91fa45b74d821969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-89ab3e88-f1b6-4213-a31e-386fd5028287 tempest-TestServerVolumeAttachmentScenario-666866145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ec82fb2-485e-41ab-9142-7fb36daee6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-89ab3e88-f1b6-4213-a31e-386fd5028287 tempest-TestServerVolumeAttachmentScenario-666866145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ec82fb2-485e-41ab-9142-7fb36daee6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-89ab3e88-f1b6-4213-a31e-386fd5028287 tempest-TestServerVolumeAttachmentScenario-666866145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb534f86-97b3-431e-b4c2-4dd8b71fae50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-89ab3e88-f1b6-4213-a31e-386fd5028287 tempest-TestServerVolumeAttachmentScenario-666866145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb534f86-97b3-431e-b4c2-4dd8b71fae50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1341c917-f7a8-4cfd-8ae9-1295d879381e', 'volume_name': 'volume-1341c917-f7a8-4cfd-8ae9-1295d879381e', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:49 devstack sudo[100184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5f47e99a-7f41-47b5-b27d-0fb7b9bea336 1073741824 Jul 31 10:49:49 devstack sudo[100184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-89ab3e88-f1b6-4213-a31e-386fd5028287 tempest-TestServerVolumeAttachmentScenario-666866145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80096e69-7253-410f-952c-d580d17a0a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-89ab3e88-f1b6-4213-a31e-386fd5028287 tempest-TestServerVolumeAttachmentScenario-666866145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80096e69-7253-410f-952c-d580d17a0a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-89ab3e88-f1b6-4213-a31e-386fd5028287 tempest-TestServerVolumeAttachmentScenario-666866145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cef5342-5bf7-4b73-a5ee-207b4a495153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:49 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-89ab3e88-f1b6-4213-a31e-386fd5028287 tempest-TestServerVolumeAttachmentScenario-666866145 None] Volume 1341c917-f7a8-4cfd-8ae9-1295d879381e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1341c917-f7a8-4cfd-8ae9-1295d879381e', 'volume_size': 1} Jul 31 10:49:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-89ab3e88-f1b6-4213-a31e-386fd5028287 tempest-TestServerVolumeAttachmentScenario-666866145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:49:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-85ba4ae9-7216-4b2a-a7f9-28f8d368a78d tempest-VolumesCloneNegativeTest-54069578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71d95f8b-c28d-47f3-8e2f-501ec316aeb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9abe680d-71fc-42c2-a8cb-43dda7bf7a28', 'volume_size': 2}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-85ba4ae9-7216-4b2a-a7f9-28f8d368a78d tempest-VolumesCloneNegativeTest-54069578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a68da1a4-9e4a-4200-8bc6-bd94bc5960c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:50 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-85ba4ae9-7216-4b2a-a7f9-28f8d368a78d tempest-VolumesCloneNegativeTest-54069578 None] Volume volume-9abe680d-71fc-42c2-a8cb-43dda7bf7a28 (9abe680d-71fc-42c2-a8cb-43dda7bf7a28): created successfully Jul 31 10:49:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-85ba4ae9-7216-4b2a-a7f9-28f8d368a78d tempest-VolumesCloneNegativeTest-54069578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a68da1a4-9e4a-4200-8bc6-bd94bc5960c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-85ba4ae9-7216-4b2a-a7f9-28f8d368a78d tempest-VolumesCloneNegativeTest-54069578 None] Flow 'volume_create_manager' (7318f761-fd5d-4690-ab6f-e8adcccf26f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:49:50 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-85ba4ae9-7216-4b2a-a7f9-28f8d368a78d tempest-VolumesCloneNegativeTest-54069578 None] Created volume successfully. Jul 31 10:49:50 devstack sudo[100184]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-13dc5638-f2af-4702-93a9-8af8000741ba tempest-TestServerVolumeAttachmentScenario-666866145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5f47e99a-7f41-47b5-b27d-0fb7b9bea336 1073741824" returned: 0 in 0.709s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-13dc5638-f2af-4702-93a9-8af8000741ba tempest-TestServerVolumeAttachmentScenario-666866145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5f47e99a-7f41-47b5-b27d-0fb7b9bea336 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:50 devstack sudo[100190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5f47e99a-7f41-47b5-b27d-0fb7b9bea336 Jul 31 10:49:50 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:51 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-13dc5638-f2af-4702-93a9-8af8000741ba tempest-TestServerVolumeAttachmentScenario-666866145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5f47e99a-7f41-47b5-b27d-0fb7b9bea336" returned: 0 in 0.390s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:51 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-13dc5638-f2af-4702-93a9-8af8000741ba tempest-TestServerVolumeAttachmentScenario-666866145 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:49:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-13dc5638-f2af-4702-93a9-8af8000741ba tempest-TestServerVolumeAttachmentScenario-666866145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:49:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-89ab3e88-f1b6-4213-a31e-386fd5028287 tempest-TestServerVolumeAttachmentScenario-666866145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.098s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:49:51 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-89ab3e88-f1b6-4213-a31e-386fd5028287 tempest-TestServerVolumeAttachmentScenario-666866145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-450398083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1341c917-f7a8-4cfd-8ae9-1295d879381e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b062139c436449bba3a32d8eb48c6002',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:49:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:49:50Z,use_quota=True,user_id='9bb3a91eb7f6451d91fa45b74d821969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:49:51 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-89ab3e88-f1b6-4213-a31e-386fd5028287 tempest-TestServerVolumeAttachmentScenario-666866145 None] Creating volume 1341c917-f7a8-4cfd-8ae9-1295d879381e {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:49:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-89ab3e88-f1b6-4213-a31e-386fd5028287 tempest-TestServerVolumeAttachmentScenario-666866145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:49:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-89ab3e88-f1b6-4213-a31e-386fd5028287 tempest-TestServerVolumeAttachmentScenario-666866145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:49:51 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-89ab3e88-f1b6-4213-a31e-386fd5028287 tempest-TestServerVolumeAttachmentScenario-666866145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:49:51 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-89ab3e88-f1b6-4213-a31e-386fd5028287 tempest-TestServerVolumeAttachmentScenario-666866145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:49:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-89ab3e88-f1b6-4213-a31e-386fd5028287 tempest-TestServerVolumeAttachmentScenario-666866145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:49:51 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-89ab3e88-f1b6-4213-a31e-386fd5028287 tempest-TestServerVolumeAttachmentScenario-666866145 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:49:51 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-89ab3e88-f1b6-4213-a31e-386fd5028287 tempest-TestServerVolumeAttachmentScenario-666866145 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:49:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-89ab3e88-f1b6-4213-a31e-386fd5028287 tempest-TestServerVolumeAttachmentScenario-666866145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1341c917-f7a8-4cfd-8ae9-1295d879381e 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:51 devstack sudo[100193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1341c917-f7a8-4cfd-8ae9-1295d879381e 1073741824 Jul 31 10:49:51 devstack sudo[100193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-13dc5638-f2af-4702-93a9-8af8000741ba tempest-TestServerVolumeAttachmentScenario-666866145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6a22735-ace1-43fe-b7c4-a76ce3c71970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f47e99a-7f41-47b5-b27d-0fb7b9bea336', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-13dc5638-f2af-4702-93a9-8af8000741ba tempest-TestServerVolumeAttachmentScenario-666866145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8030c9b1-4f65-4f84-9e56-2f596215a5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:51 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-13dc5638-f2af-4702-93a9-8af8000741ba tempest-TestServerVolumeAttachmentScenario-666866145 None] Volume volume-5f47e99a-7f41-47b5-b27d-0fb7b9bea336 (5f47e99a-7f41-47b5-b27d-0fb7b9bea336): created successfully Jul 31 10:49:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-13dc5638-f2af-4702-93a9-8af8000741ba tempest-TestServerVolumeAttachmentScenario-666866145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8030c9b1-4f65-4f84-9e56-2f596215a5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-13dc5638-f2af-4702-93a9-8af8000741ba tempest-TestServerVolumeAttachmentScenario-666866145 None] Flow 'volume_create_manager' (0bceff0a-a6c9-4327-b62e-2ade9d3df767) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:49:51 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-13dc5638-f2af-4702-93a9-8af8000741ba tempest-TestServerVolumeAttachmentScenario-666866145 None] Created volume successfully. Jul 31 10:49:51 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-88077e09-755c-47c3-a7d9-a31c6af1fd9c tempest-VolumesCloneNegativeTest-54069578 None] Acquiring lock "cinder-9abe680d-71fc-42c2-a8cb-43dda7bf7a28-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:49:51 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-88077e09-755c-47c3-a7d9-a31c6af1fd9c tempest-VolumesCloneNegativeTest-54069578 None] Lock "cinder-9abe680d-71fc-42c2-a8cb-43dda7bf7a28-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:49:51 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-88077e09-755c-47c3-a7d9-a31c6af1fd9c tempest-VolumesCloneNegativeTest-54069578 None] Acquiring lock "cinder-quobyte-9abe680d-71fc-42c2-a8cb-43dda7bf7a28" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:49:51 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-88077e09-755c-47c3-a7d9-a31c6af1fd9c tempest-VolumesCloneNegativeTest-54069578 None] Lock "cinder-quobyte-9abe680d-71fc-42c2-a8cb-43dda7bf7a28" acquired by "delete_volume" :: waited 0.027s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:49:51 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2d00d2-fb9b-425d-8abf-4d4f9334fcc0]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:49:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88077e09-755c-47c3-a7d9-a31c6af1fd9c tempest-VolumesCloneNegativeTest-54069578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9abe680d-71fc-42c2-a8cb-43dda7bf7a28 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:51 devstack sudo[100197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9abe680d-71fc-42c2-a8cb-43dda7bf7a28 Jul 31 10:49:51 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:51 devstack sudo[100193]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-89ab3e88-f1b6-4213-a31e-386fd5028287 tempest-TestServerVolumeAttachmentScenario-666866145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1341c917-f7a8-4cfd-8ae9-1295d879381e 1073741824" returned: 0 in 0.739s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-89ab3e88-f1b6-4213-a31e-386fd5028287 tempest-TestServerVolumeAttachmentScenario-666866145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1341c917-f7a8-4cfd-8ae9-1295d879381e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:51 devstack sudo[100202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1341c917-f7a8-4cfd-8ae9-1295d879381e Jul 31 10:49:51 devstack sudo[100202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:52 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88077e09-755c-47c3-a7d9-a31c6af1fd9c tempest-VolumesCloneNegativeTest-54069578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9abe680d-71fc-42c2-a8cb-43dda7bf7a28" returned: 0 in 0.590s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88077e09-755c-47c3-a7d9-a31c6af1fd9c tempest-VolumesCloneNegativeTest-54069578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9abe680d-71fc-42c2-a8cb-43dda7bf7a28 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:52 devstack sudo[100206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9abe680d-71fc-42c2-a8cb-43dda7bf7a28 Jul 31 10:49:52 devstack sudo[100206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:52 devstack sudo[100202]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-89ab3e88-f1b6-4213-a31e-386fd5028287 tempest-TestServerVolumeAttachmentScenario-666866145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1341c917-f7a8-4cfd-8ae9-1295d879381e" returned: 0 in 0.393s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:52 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-89ab3e88-f1b6-4213-a31e-386fd5028287 tempest-TestServerVolumeAttachmentScenario-666866145 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:49:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-89ab3e88-f1b6-4213-a31e-386fd5028287 tempest-TestServerVolumeAttachmentScenario-666866145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:49:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-89ab3e88-f1b6-4213-a31e-386fd5028287 tempest-TestServerVolumeAttachmentScenario-666866145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cef5342-5bf7-4b73-a5ee-207b4a495153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1341c917-f7a8-4cfd-8ae9-1295d879381e', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-89ab3e88-f1b6-4213-a31e-386fd5028287 tempest-TestServerVolumeAttachmentScenario-666866145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78fbc13c-d034-44ce-a66c-70af2a7f8686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:52 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-89ab3e88-f1b6-4213-a31e-386fd5028287 tempest-TestServerVolumeAttachmentScenario-666866145 None] Volume volume-1341c917-f7a8-4cfd-8ae9-1295d879381e (1341c917-f7a8-4cfd-8ae9-1295d879381e): created successfully Jul 31 10:49:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-89ab3e88-f1b6-4213-a31e-386fd5028287 tempest-TestServerVolumeAttachmentScenario-666866145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78fbc13c-d034-44ce-a66c-70af2a7f8686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-89ab3e88-f1b6-4213-a31e-386fd5028287 tempest-TestServerVolumeAttachmentScenario-666866145 None] Flow 'volume_create_manager' (475ee456-03ca-4f28-9153-8b24bc90c8fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:49:52 devstack sudo[100206]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88077e09-755c-47c3-a7d9-a31c6af1fd9c tempest-VolumesCloneNegativeTest-54069578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9abe680d-71fc-42c2-a8cb-43dda7bf7a28" returned: 0 in 0.329s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:52 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-89ab3e88-f1b6-4213-a31e-386fd5028287 tempest-TestServerVolumeAttachmentScenario-666866145 None] Created volume successfully. Jul 31 10:49:52 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-88077e09-755c-47c3-a7d9-a31c6af1fd9c tempest-VolumesCloneNegativeTest-54069578 None] Lock "cinder-quobyte-9abe680d-71fc-42c2-a8cb-43dda7bf7a28" released by "delete_volume" :: held 0.992s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:49:52 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-88077e09-755c-47c3-a7d9-a31c6af1fd9c tempest-VolumesCloneNegativeTest-54069578 None] Created reservations ['c644631e-86f5-4804-877a-47e60e8d14e6', '15060cca-197d-4de6-80f4-81c5337441f6', '92286c2e-7aa0-4635-ab60-25368b8733f0', 'c833381e-d3ed-4b93-a8af-bafaf5af1793'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:49:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-88077e09-755c-47c3-a7d9-a31c6af1fd9c tempest-VolumesCloneNegativeTest-54069578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:49:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-88077e09-755c-47c3-a7d9-a31c6af1fd9c tempest-VolumesCloneNegativeTest-54069578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:49:52 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-88077e09-755c-47c3-a7d9-a31c6af1fd9c tempest-VolumesCloneNegativeTest-54069578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:49:52 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-88077e09-755c-47c3-a7d9-a31c6af1fd9c tempest-VolumesCloneNegativeTest-54069578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:49:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-88077e09-755c-47c3-a7d9-a31c6af1fd9c tempest-VolumesCloneNegativeTest-54069578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:49:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88077e09-755c-47c3-a7d9-a31c6af1fd9c tempest-VolumesCloneNegativeTest-54069578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:52 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:49:52 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:52 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88077e09-755c-47c3-a7d9-a31c6af1fd9c tempest-VolumesCloneNegativeTest-54069578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.304s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:52 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-88077e09-755c-47c3-a7d9-a31c6af1fd9c tempest-VolumesCloneNegativeTest-54069578 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:49:52 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-88077e09-755c-47c3-a7d9-a31c6af1fd9c tempest-VolumesCloneNegativeTest-54069578 None] Deleted volume successfully. Jul 31 10:49:52 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-88077e09-755c-47c3-a7d9-a31c6af1fd9c tempest-VolumesCloneNegativeTest-54069578 None] Lock "cinder-9abe680d-71fc-42c2-a8cb-43dda7bf7a28-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:49:58 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-72cf69dc-8862-4f22-b56f-5fae4889dfb6 tempest-GroupsTest-1276407125 None] Group tempest-Group1-604722918: creating Jul 31 10:49:58 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-72cf69dc-8862-4f22-b56f-5fae4889dfb6 tempest-GroupsTest-1276407125 None] Group tempest-Group1-604722918: created successfully Jul 31 10:49:58 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-72cf69dc-8862-4f22-b56f-5fae4889dfb6 tempest-GroupsTest-1276407125 None] Create group completed successfully. Jul 31 10:49:59 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-c356ac29-0ac6-45ad-8943-7990f18e2dac tempest-VolumesGetTest-2086150122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:49:59 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c356ac29-0ac6-45ad-8943-7990f18e2dac tempest-VolumesGetTest-2086150122 None] Flow 'volume_create_manager' (e6bfb9ca-334b-4b75-9088-2c1e433f8145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:49:59 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c356ac29-0ac6-45ad-8943-7990f18e2dac tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ae1d8df-b3e8-4319-9fac-21768a41d351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:59 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c356ac29-0ac6-45ad-8943-7990f18e2dac tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ae1d8df-b3e8-4319-9fac-21768a41d351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-416466905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b40ca65-8b98-4c75-b1b2-414925d371f6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5e83d68bd1e841808f4c9cbc3d39ac25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:50:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:50:00Z,use_quota=True,user_id='d8850379515d4edbb49086c958167c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:59 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c356ac29-0ac6-45ad-8943-7990f18e2dac tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa733056-894f-49de-ae20-104fe796fe26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:59 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c356ac29-0ac6-45ad-8943-7990f18e2dac tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa733056-894f-49de-ae20-104fe796fe26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:59 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c356ac29-0ac6-45ad-8943-7990f18e2dac tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (808f6b57-5044-42ef-bbec-107fb22cac69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:59 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c356ac29-0ac6-45ad-8943-7990f18e2dac tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (808f6b57-5044-42ef-bbec-107fb22cac69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b40ca65-8b98-4c75-b1b2-414925d371f6', 'volume_name': 'volume-8b40ca65-8b98-4c75-b1b2-414925d371f6', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:59 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c356ac29-0ac6-45ad-8943-7990f18e2dac tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48e6eb47-3721-4fcf-bdf7-747ed3223d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:59 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c356ac29-0ac6-45ad-8943-7990f18e2dac tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48e6eb47-3721-4fcf-bdf7-747ed3223d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:49:59 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c356ac29-0ac6-45ad-8943-7990f18e2dac tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8caba5a3-2aba-4739-bcbf-721ad75a8a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:49:59 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-c356ac29-0ac6-45ad-8943-7990f18e2dac tempest-VolumesGetTest-2086150122 None] Volume 8b40ca65-8b98-4c75-b1b2-414925d371f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b40ca65-8b98-4c75-b1b2-414925d371f6', 'volume_size': 1} Jul 31 10:49:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c356ac29-0ac6-45ad-8943-7990f18e2dac tempest-VolumesGetTest-2086150122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:49:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c356ac29-0ac6-45ad-8943-7990f18e2dac tempest-VolumesGetTest-2086150122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:49:59 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c356ac29-0ac6-45ad-8943-7990f18e2dac tempest-VolumesGetTest-2086150122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-416466905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b40ca65-8b98-4c75-b1b2-414925d371f6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5e83d68bd1e841808f4c9cbc3d39ac25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:50:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:50:00Z,use_quota=True,user_id='d8850379515d4edbb49086c958167c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:49:59 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-c356ac29-0ac6-45ad-8943-7990f18e2dac tempest-VolumesGetTest-2086150122 None] Creating volume 8b40ca65-8b98-4c75-b1b2-414925d371f6 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:49:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c356ac29-0ac6-45ad-8943-7990f18e2dac tempest-VolumesGetTest-2086150122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:49:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c356ac29-0ac6-45ad-8943-7990f18e2dac tempest-VolumesGetTest-2086150122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:49:59 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c356ac29-0ac6-45ad-8943-7990f18e2dac tempest-VolumesGetTest-2086150122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:49:59 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c356ac29-0ac6-45ad-8943-7990f18e2dac tempest-VolumesGetTest-2086150122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:49:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c356ac29-0ac6-45ad-8943-7990f18e2dac tempest-VolumesGetTest-2086150122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:49:59 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c356ac29-0ac6-45ad-8943-7990f18e2dac tempest-VolumesGetTest-2086150122 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:49:59 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-c356ac29-0ac6-45ad-8943-7990f18e2dac tempest-VolumesGetTest-2086150122 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:49:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c356ac29-0ac6-45ad-8943-7990f18e2dac tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b40ca65-8b98-4c75-b1b2-414925d371f6 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:59 devstack sudo[100225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b40ca65-8b98-4c75-b1b2-414925d371f6 1073741824 Jul 31 10:49:59 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:00 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a7c78e9-412d-43e4-b5f9-3669eb48684d tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:50:00 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4a7c78e9-412d-43e4-b5f9-3669eb48684d tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Flow 'volume_create_manager' (fd2c9da7-62c0-44e4-bf18-d5aef33dd631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:50:00 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4a7c78e9-412d-43e4-b5f9-3669eb48684d tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f695f73-a0fe-443b-b5b1-e58d70f7bf5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:00 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-66211eda-f604-4e16-83e3-8486917e99f1 tempest-GroupsTest-1276407125 None] Group tempest-Group2-1486488608: creating Jul 31 10:50:00 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4a7c78e9-412d-43e4-b5f9-3669eb48684d tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f695f73-a0fe-443b-b5b1-e58d70f7bf5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-833201577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40991918-028b-474a-9954-4878a3513944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2acb271248947c9a3808483a6755b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:50:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:50:00Z,use_quota=True,user_id='993a33ca7a5a41f9bd83e5de90736ead',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:00 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4a7c78e9-412d-43e4-b5f9-3669eb48684d tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bd6406b-ba19-4935-b13a-b8a63edaca6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:00 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4a7c78e9-412d-43e4-b5f9-3669eb48684d tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bd6406b-ba19-4935-b13a-b8a63edaca6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:00 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4a7c78e9-412d-43e4-b5f9-3669eb48684d tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60370ca1-f16f-41c0-9cfe-88b72a2fad53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:00 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4a7c78e9-412d-43e4-b5f9-3669eb48684d tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60370ca1-f16f-41c0-9cfe-88b72a2fad53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40991918-028b-474a-9954-4878a3513944', 'volume_name': 'volume-40991918-028b-474a-9954-4878a3513944', 'volume_size': 2}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:00 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4a7c78e9-412d-43e4-b5f9-3669eb48684d tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4aee62d-5f58-4a0f-bb1c-8e476200c8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:00 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4a7c78e9-412d-43e4-b5f9-3669eb48684d tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4aee62d-5f58-4a0f-bb1c-8e476200c8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:00 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4a7c78e9-412d-43e4-b5f9-3669eb48684d tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (850ec0d8-9aef-4060-b19c-17e3bc640f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:00 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-4a7c78e9-412d-43e4-b5f9-3669eb48684d tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Volume 40991918-028b-474a-9954-4878a3513944: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40991918-028b-474a-9954-4878a3513944', 'volume_size': 2} Jul 31 10:50:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4a7c78e9-412d-43e4-b5f9-3669eb48684d tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:00 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-66211eda-f604-4e16-83e3-8486917e99f1 tempest-GroupsTest-1276407125 None] Group tempest-Group2-1486488608: created successfully Jul 31 10:50:00 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-66211eda-f604-4e16-83e3-8486917e99f1 tempest-GroupsTest-1276407125 None] Create group completed successfully. Jul 31 10:50:00 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c356ac29-0ac6-45ad-8943-7990f18e2dac tempest-VolumesGetTest-2086150122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b40ca65-8b98-4c75-b1b2-414925d371f6 1073741824" returned: 0 in 0.757s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c356ac29-0ac6-45ad-8943-7990f18e2dac tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b40ca65-8b98-4c75-b1b2-414925d371f6 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:00 devstack sudo[100240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b40ca65-8b98-4c75-b1b2-414925d371f6 Jul 31 10:50:00 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:00 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c356ac29-0ac6-45ad-8943-7990f18e2dac tempest-VolumesGetTest-2086150122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b40ca65-8b98-4c75-b1b2-414925d371f6" returned: 0 in 0.276s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:00 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c356ac29-0ac6-45ad-8943-7990f18e2dac tempest-VolumesGetTest-2086150122 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:50:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c356ac29-0ac6-45ad-8943-7990f18e2dac tempest-VolumesGetTest-2086150122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4a7c78e9-412d-43e4-b5f9-3669eb48684d tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.521s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:00 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4a7c78e9-412d-43e4-b5f9-3669eb48684d tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-833201577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40991918-028b-474a-9954-4878a3513944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2acb271248947c9a3808483a6755b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:50:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:50:00Z,use_quota=True,user_id='993a33ca7a5a41f9bd83e5de90736ead',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:50:00 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-4a7c78e9-412d-43e4-b5f9-3669eb48684d tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Creating volume 40991918-028b-474a-9954-4878a3513944 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:50:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4a7c78e9-412d-43e4-b5f9-3669eb48684d tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4a7c78e9-412d-43e4-b5f9-3669eb48684d tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:00 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4a7c78e9-412d-43e4-b5f9-3669eb48684d tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:50:00 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4a7c78e9-412d-43e4-b5f9-3669eb48684d tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:50:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4a7c78e9-412d-43e4-b5f9-3669eb48684d tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:00 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4a7c78e9-412d-43e4-b5f9-3669eb48684d tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:50:00 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-4a7c78e9-412d-43e4-b5f9-3669eb48684d tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:50:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4a7c78e9-412d-43e4-b5f9-3669eb48684d tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944 2147483648 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:00 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c356ac29-0ac6-45ad-8943-7990f18e2dac tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8caba5a3-2aba-4739-bcbf-721ad75a8a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b40ca65-8b98-4c75-b1b2-414925d371f6', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:00 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c356ac29-0ac6-45ad-8943-7990f18e2dac tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d2d245a-68ba-4bb0-92b2-3086318fd4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:00 devstack sudo[100246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944 2147483648 Jul 31 10:50:00 devstack sudo[100246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:00 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-c356ac29-0ac6-45ad-8943-7990f18e2dac tempest-VolumesGetTest-2086150122 None] Volume volume-8b40ca65-8b98-4c75-b1b2-414925d371f6 (8b40ca65-8b98-4c75-b1b2-414925d371f6): created successfully Jul 31 10:50:00 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c356ac29-0ac6-45ad-8943-7990f18e2dac tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d2d245a-68ba-4bb0-92b2-3086318fd4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:00 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c356ac29-0ac6-45ad-8943-7990f18e2dac tempest-VolumesGetTest-2086150122 None] Flow 'volume_create_manager' (e6bfb9ca-334b-4b75-9088-2c1e433f8145) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:50:00 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-c356ac29-0ac6-45ad-8943-7990f18e2dac tempest-VolumesGetTest-2086150122 None] Created volume successfully. Jul 31 10:50:01 devstack sudo[100246]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4a7c78e9-412d-43e4-b5f9-3669eb48684d tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944 2147483648" returned: 0 in 0.747s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4a7c78e9-412d-43e4-b5f9-3669eb48684d tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:01 devstack sudo[100252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944 Jul 31 10:50:01 devstack sudo[100252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:01 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-71073406-49e3-43a4-9368-64454fce0a58 tempest-GroupsTest-1276407125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:50:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-71073406-49e3-43a4-9368-64454fce0a58 tempest-GroupsTest-1276407125 None] Flow 'volume_create_manager' (d3ff6409-0f08-455f-9920-319e54003d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:50:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-71073406-49e3-43a4-9368-64454fce0a58 tempest-GroupsTest-1276407125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7a453b1-bc4b-4009-b488-81e9426a8fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-71073406-49e3-43a4-9368-64454fce0a58 tempest-GroupsTest-1276407125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7a453b1-bc4b-4009-b488-81e9426a8fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-793632224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4ab46a07-77ee-4d0d-937e-9e06d2540377,host='devstack@QuobyteHD#QuobyteHD',id=bb9d7ae0-9e24-4873-9319-b66bf738eef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccaf4bd6a4f04364ab78245a910fd830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:50:02Z,use_quota=True,user_id='1cfcf95e152148ee8906ac0b7fed5c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(214c828a-41b0-4b9c-b315-42a3a7959136),volume_type_id=214c828a-41b0-4b9c-b315-42a3a7959136)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-71073406-49e3-43a4-9368-64454fce0a58 tempest-GroupsTest-1276407125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (455b3bec-5698-41de-b0d1-c3cd2d1404d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-71073406-49e3-43a4-9368-64454fce0a58 tempest-GroupsTest-1276407125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (455b3bec-5698-41de-b0d1-c3cd2d1404d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-71073406-49e3-43a4-9368-64454fce0a58 tempest-GroupsTest-1276407125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5474967-4f08-4ece-b95b-f378afd1959c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-71073406-49e3-43a4-9368-64454fce0a58 tempest-GroupsTest-1276407125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5474967-4f08-4ece-b95b-f378afd1959c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb9d7ae0-9e24-4873-9319-b66bf738eef3', 'volume_name': 'volume-bb9d7ae0-9e24-4873-9319-b66bf738eef3', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-71073406-49e3-43a4-9368-64454fce0a58 tempest-GroupsTest-1276407125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bec57547-58ee-41aa-b02f-64902188bf5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-71073406-49e3-43a4-9368-64454fce0a58 tempest-GroupsTest-1276407125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bec57547-58ee-41aa-b02f-64902188bf5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-71073406-49e3-43a4-9368-64454fce0a58 tempest-GroupsTest-1276407125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a57921-6d1b-4eed-ad96-e6007fc92ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:02 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-71073406-49e3-43a4-9368-64454fce0a58 tempest-GroupsTest-1276407125 None] Volume bb9d7ae0-9e24-4873-9319-b66bf738eef3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb9d7ae0-9e24-4873-9319-b66bf738eef3', 'volume_size': 1} Jul 31 10:50:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-71073406-49e3-43a4-9368-64454fce0a58 tempest-GroupsTest-1276407125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:02 devstack sudo[100252]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4a7c78e9-412d-43e4-b5f9-3669eb48684d tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944" returned: 0 in 0.581s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:02 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4a7c78e9-412d-43e4-b5f9-3669eb48684d tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] <== create_volume: return (1431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:50:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4a7c78e9-412d-43e4-b5f9-3669eb48684d tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.434s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-71073406-49e3-43a4-9368-64454fce0a58 tempest-GroupsTest-1276407125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.055s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:02 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-71073406-49e3-43a4-9368-64454fce0a58 tempest-GroupsTest-1276407125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4ab46a07-77ee-4d0d-937e-9e06d2540377,created_at=2026-07-31T08:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-793632224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4ab46a07-77ee-4d0d-937e-9e06d2540377,host='devstack@QuobyteHD#QuobyteHD',id=bb9d7ae0-9e24-4873-9319-b66bf738eef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccaf4bd6a4f04364ab78245a910fd830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:50:02Z,use_quota=True,user_id='1cfcf95e152148ee8906ac0b7fed5c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(214c828a-41b0-4b9c-b315-42a3a7959136),volume_type_id=214c828a-41b0-4b9c-b315-42a3a7959136)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:50:02 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-71073406-49e3-43a4-9368-64454fce0a58 tempest-GroupsTest-1276407125 None] Creating volume bb9d7ae0-9e24-4873-9319-b66bf738eef3 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:50:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-71073406-49e3-43a4-9368-64454fce0a58 tempest-GroupsTest-1276407125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-71073406-49e3-43a4-9368-64454fce0a58 tempest-GroupsTest-1276407125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:02 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-71073406-49e3-43a4-9368-64454fce0a58 tempest-GroupsTest-1276407125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:50:02 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-71073406-49e3-43a4-9368-64454fce0a58 tempest-GroupsTest-1276407125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:50:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-71073406-49e3-43a4-9368-64454fce0a58 tempest-GroupsTest-1276407125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:02 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-71073406-49e3-43a4-9368-64454fce0a58 tempest-GroupsTest-1276407125 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:50:02 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-71073406-49e3-43a4-9368-64454fce0a58 tempest-GroupsTest-1276407125 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:50:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-71073406-49e3-43a4-9368-64454fce0a58 tempest-GroupsTest-1276407125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bb9d7ae0-9e24-4873-9319-b66bf738eef3 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4a7c78e9-412d-43e4-b5f9-3669eb48684d tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (850ec0d8-9aef-4060-b19c-17e3bc640f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40991918-028b-474a-9954-4878a3513944', 'volume_size': 2}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:02 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bb9d7ae0-9e24-4873-9319-b66bf738eef3 1073741824 Jul 31 10:50:02 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4a7c78e9-412d-43e4-b5f9-3669eb48684d tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59b2da7c-1552-47ca-961d-95cb47d7cbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:02 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-4a7c78e9-412d-43e4-b5f9-3669eb48684d tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Volume volume-40991918-028b-474a-9954-4878a3513944 (40991918-028b-474a-9954-4878a3513944): created successfully Jul 31 10:50:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4a7c78e9-412d-43e4-b5f9-3669eb48684d tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59b2da7c-1552-47ca-961d-95cb47d7cbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4a7c78e9-412d-43e4-b5f9-3669eb48684d tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Flow 'volume_create_manager' (fd2c9da7-62c0-44e4-bf18-d5aef33dd631) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:50:02 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-4a7c78e9-412d-43e4-b5f9-3669eb48684d tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Created volume successfully. Jul 31 10:50:02 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d959dbb-dba6-4b95-bab3-8c96ff36b17c tempest-VolumesGetTest-2086150122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:50:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2d959dbb-dba6-4b95-bab3-8c96ff36b17c tempest-VolumesGetTest-2086150122 None] Flow 'volume_create_manager' (c3325905-8cad-4233-a7bb-7aa026e63f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:50:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2d959dbb-dba6-4b95-bab3-8c96ff36b17c tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba78024-be74-43c2-be85-12313d8c6edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2d959dbb-dba6-4b95-bab3-8c96ff36b17c tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba78024-be74-43c2-be85-12313d8c6edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:50:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1925285770',display_name='tempest-VolumesGetTest-Volume-1758114043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48e533fa-fad4-45be-957c-6bee090da5b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e83d68bd1e841808f4c9cbc3d39ac25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:50:03Z,use_quota=True,user_id='d8850379515d4edbb49086c958167c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2d959dbb-dba6-4b95-bab3-8c96ff36b17c tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ff611fb-298e-4daa-be6f-da30d8dc7563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2d959dbb-dba6-4b95-bab3-8c96ff36b17c tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ff611fb-298e-4daa-be6f-da30d8dc7563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2d959dbb-dba6-4b95-bab3-8c96ff36b17c tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef798939-d329-4438-865f-43dec772a881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2d959dbb-dba6-4b95-bab3-8c96ff36b17c tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef798939-d329-4438-865f-43dec772a881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48e533fa-fad4-45be-957c-6bee090da5b6', 'volume_name': 'volume-48e533fa-fad4-45be-957c-6bee090da5b6', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2d959dbb-dba6-4b95-bab3-8c96ff36b17c tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6939d1a8-4648-4850-97ea-47040f79a76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2d959dbb-dba6-4b95-bab3-8c96ff36b17c tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6939d1a8-4648-4850-97ea-47040f79a76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2d959dbb-dba6-4b95-bab3-8c96ff36b17c tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cf7ba2d-9bc4-4bbe-b23e-518ad5910ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:02 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-2d959dbb-dba6-4b95-bab3-8c96ff36b17c tempest-VolumesGetTest-2086150122 None] Volume 48e533fa-fad4-45be-957c-6bee090da5b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48e533fa-fad4-45be-957c-6bee090da5b6', 'volume_size': 1} Jul 31 10:50:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2d959dbb-dba6-4b95-bab3-8c96ff36b17c tempest-VolumesGetTest-2086150122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:03 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-71073406-49e3-43a4-9368-64454fce0a58 tempest-GroupsTest-1276407125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bb9d7ae0-9e24-4873-9319-b66bf738eef3 1073741824" returned: 0 in 0.844s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-71073406-49e3-43a4-9368-64454fce0a58 tempest-GroupsTest-1276407125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bb9d7ae0-9e24-4873-9319-b66bf738eef3 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:03 devstack sudo[100299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bb9d7ae0-9e24-4873-9319-b66bf738eef3 Jul 31 10:50:03 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:03 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-71073406-49e3-43a4-9368-64454fce0a58 tempest-GroupsTest-1276407125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bb9d7ae0-9e24-4873-9319-b66bf738eef3" returned: 0 in 0.402s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:03 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-71073406-49e3-43a4-9368-64454fce0a58 tempest-GroupsTest-1276407125 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:50:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-71073406-49e3-43a4-9368-64454fce0a58 tempest-GroupsTest-1276407125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2d959dbb-dba6-4b95-bab3-8c96ff36b17c tempest-VolumesGetTest-2086150122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.713s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:03 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2d959dbb-dba6-4b95-bab3-8c96ff36b17c tempest-VolumesGetTest-2086150122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:50:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1925285770',display_name='tempest-VolumesGetTest-Volume-1758114043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48e533fa-fad4-45be-957c-6bee090da5b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e83d68bd1e841808f4c9cbc3d39ac25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:50:03Z,use_quota=True,user_id='d8850379515d4edbb49086c958167c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:50:03 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-2d959dbb-dba6-4b95-bab3-8c96ff36b17c tempest-VolumesGetTest-2086150122 None] Creating volume 48e533fa-fad4-45be-957c-6bee090da5b6 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:50:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2d959dbb-dba6-4b95-bab3-8c96ff36b17c tempest-VolumesGetTest-2086150122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2d959dbb-dba6-4b95-bab3-8c96ff36b17c tempest-VolumesGetTest-2086150122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:03 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2d959dbb-dba6-4b95-bab3-8c96ff36b17c tempest-VolumesGetTest-2086150122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:50:03 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2d959dbb-dba6-4b95-bab3-8c96ff36b17c tempest-VolumesGetTest-2086150122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:50:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2d959dbb-dba6-4b95-bab3-8c96ff36b17c tempest-VolumesGetTest-2086150122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:03 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2d959dbb-dba6-4b95-bab3-8c96ff36b17c tempest-VolumesGetTest-2086150122 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:50:03 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-2d959dbb-dba6-4b95-bab3-8c96ff36b17c tempest-VolumesGetTest-2086150122 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:50:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2d959dbb-dba6-4b95-bab3-8c96ff36b17c tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-48e533fa-fad4-45be-957c-6bee090da5b6 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-71073406-49e3-43a4-9368-64454fce0a58 tempest-GroupsTest-1276407125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a57921-6d1b-4eed-ad96-e6007fc92ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb9d7ae0-9e24-4873-9319-b66bf738eef3', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-71073406-49e3-43a4-9368-64454fce0a58 tempest-GroupsTest-1276407125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6537fb45-33cb-4904-8c32-1afa76043729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:03 devstack sudo[100302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-48e533fa-fad4-45be-957c-6bee090da5b6 1073741824 Jul 31 10:50:03 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-826f2a8d-1e13-450d-afae-6594d4780e99 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:03 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-71073406-49e3-43a4-9368-64454fce0a58 tempest-GroupsTest-1276407125 None] Volume volume-bb9d7ae0-9e24-4873-9319-b66bf738eef3 (bb9d7ae0-9e24-4873-9319-b66bf738eef3): created successfully Jul 31 10:50:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-71073406-49e3-43a4-9368-64454fce0a58 tempest-GroupsTest-1276407125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6537fb45-33cb-4904-8c32-1afa76043729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-71073406-49e3-43a4-9368-64454fce0a58 tempest-GroupsTest-1276407125 None] Flow 'volume_create_manager' (d3ff6409-0f08-455f-9920-319e54003d25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:50:03 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-71073406-49e3-43a4-9368-64454fce0a58 tempest-GroupsTest-1276407125 None] Created volume successfully. Jul 31 10:50:04 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2d959dbb-dba6-4b95-bab3-8c96ff36b17c tempest-VolumesGetTest-2086150122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-48e533fa-fad4-45be-957c-6bee090da5b6 1073741824" returned: 0 in 0.912s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2d959dbb-dba6-4b95-bab3-8c96ff36b17c tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-48e533fa-fad4-45be-957c-6bee090da5b6 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:04 devstack sudo[100358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-48e533fa-fad4-45be-957c-6bee090da5b6 Jul 31 10:50:04 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:04 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2d959dbb-dba6-4b95-bab3-8c96ff36b17c tempest-VolumesGetTest-2086150122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-48e533fa-fad4-45be-957c-6bee090da5b6" returned: 0 in 0.454s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:05 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2d959dbb-dba6-4b95-bab3-8c96ff36b17c tempest-VolumesGetTest-2086150122 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:50:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2d959dbb-dba6-4b95-bab3-8c96ff36b17c tempest-VolumesGetTest-2086150122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-826f2a8d-1e13-450d-afae-6594d4780e99 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.348s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:05 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2d959dbb-dba6-4b95-bab3-8c96ff36b17c tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cf7ba2d-9bc4-4bbe-b23e-518ad5910ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48e533fa-fad4-45be-957c-6bee090da5b6', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:05 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2d959dbb-dba6-4b95-bab3-8c96ff36b17c tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba01761e-4c1d-4988-8762-4896cc215f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:05 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-826f2a8d-1e13-450d-afae-6594d4780e99 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Creating offline snapshot 13cffd89-b5cd-4f6a-b119-78ad0c1596b6 of volume 40991918-028b-474a-9954-4878a3513944 {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:50:05 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-2d959dbb-dba6-4b95-bab3-8c96ff36b17c tempest-VolumesGetTest-2086150122 None] Volume volume-48e533fa-fad4-45be-957c-6bee090da5b6 (48e533fa-fad4-45be-957c-6bee090da5b6): created successfully Jul 31 10:50:05 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2d959dbb-dba6-4b95-bab3-8c96ff36b17c tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba01761e-4c1d-4988-8762-4896cc215f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:05 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2d959dbb-dba6-4b95-bab3-8c96ff36b17c tempest-VolumesGetTest-2086150122 None] Flow 'volume_create_manager' (c3325905-8cad-4233-a7bb-7aa026e63f9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:50:05 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[8233724b-a48a-41db-be3b-40fa86875aa9]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:50:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-826f2a8d-1e13-450d-afae-6594d4780e99 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:05 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-2d959dbb-dba6-4b95-bab3-8c96ff36b17c tempest-VolumesGetTest-2086150122 None] Created volume successfully. Jul 31 10:50:05 devstack sudo[100375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944 Jul 31 10:50:05 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:05 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-aad72874-c8b5-4bea-bbd5-a61752b4aa26 tempest-GroupsTest-1276407125 None] Acquiring lock "cinder-quobyte-bb9d7ae0-9e24-4873-9319-b66bf738eef3" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:50:05 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-aad72874-c8b5-4bea-bbd5-a61752b4aa26 tempest-GroupsTest-1276407125 None] Lock "cinder-quobyte-bb9d7ae0-9e24-4873-9319-b66bf738eef3" acquired by "delete_volume" :: waited 0.035s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:50:05 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a82d82-026c-4d6d-8203-e199310af492]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:50:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-aad72874-c8b5-4bea-bbd5-a61752b4aa26 tempest-GroupsTest-1276407125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bb9d7ae0-9e24-4873-9319-b66bf738eef3 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:05 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-826f2a8d-1e13-450d-afae-6594d4780e99 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944" returned: 0 in 0.553s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-826f2a8d-1e13-450d-afae-6594d4780e99 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944.13cffd89-b5cd-4f6a-b119-78ad0c1596b6 2G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:05 devstack sudo[100396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944.13cffd89-b5cd-4f6a-b119-78ad0c1596b6 2G Jul 31 10:50:05 devstack sudo[100396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:05 devstack sudo[100394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bb9d7ae0-9e24-4873-9319-b66bf738eef3 Jul 31 10:50:05 devstack sudo[100394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:06 devstack sudo[100394]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-aad72874-c8b5-4bea-bbd5-a61752b4aa26 tempest-GroupsTest-1276407125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bb9d7ae0-9e24-4873-9319-b66bf738eef3" returned: 0 in 0.503s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-aad72874-c8b5-4bea-bbd5-a61752b4aa26 tempest-GroupsTest-1276407125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bb9d7ae0-9e24-4873-9319-b66bf738eef3 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:06 devstack sudo[100405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bb9d7ae0-9e24-4873-9319-b66bf738eef3 Jul 31 10:50:06 devstack sudo[100405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:06 devstack sudo[100396]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-826f2a8d-1e13-450d-afae-6594d4780e99 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944.13cffd89-b5cd-4f6a-b119-78ad0c1596b6 2G" returned: 0 in 0.630s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-826f2a8d-1e13-450d-afae-6594d4780e99 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40991918-028b-474a-9954-4878a3513944 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944.13cffd89-b5cd-4f6a-b119-78ad0c1596b6 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:06 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d83a2bba-76fe-44f8-a356-daed11463b6d tempest-VolumesGetTest-2086150122 None] Acquiring lock "cinder-48e533fa-fad4-45be-957c-6bee090da5b6-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:50:06 devstack sudo[100407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40991918-028b-474a-9954-4878a3513944 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944.13cffd89-b5cd-4f6a-b119-78ad0c1596b6 Jul 31 10:50:06 devstack sudo[100407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:06 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d83a2bba-76fe-44f8-a356-daed11463b6d tempest-VolumesGetTest-2086150122 None] Lock "cinder-48e533fa-fad4-45be-957c-6bee090da5b6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:50:06 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d83a2bba-76fe-44f8-a356-daed11463b6d tempest-VolumesGetTest-2086150122 None] Acquiring lock "cinder-quobyte-48e533fa-fad4-45be-957c-6bee090da5b6" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:50:06 devstack sudo[100405]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-aad72874-c8b5-4bea-bbd5-a61752b4aa26 tempest-GroupsTest-1276407125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bb9d7ae0-9e24-4873-9319-b66bf738eef3" returned: 0 in 0.394s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:06 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d83a2bba-76fe-44f8-a356-daed11463b6d tempest-VolumesGetTest-2086150122 None] Lock "cinder-quobyte-48e533fa-fad4-45be-957c-6bee090da5b6" acquired by "delete_volume" :: waited 0.031s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:50:06 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-aad72874-c8b5-4bea-bbd5-a61752b4aa26 tempest-GroupsTest-1276407125 None] Lock "cinder-quobyte-bb9d7ae0-9e24-4873-9319-b66bf738eef3" released by "delete_volume" :: held 0.996s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:50:06 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[23605e9b-7ce5-4bce-a99d-1c8430fff412]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:50:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d83a2bba-76fe-44f8-a356-daed11463b6d tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-48e533fa-fad4-45be-957c-6bee090da5b6 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:06 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-aad72874-c8b5-4bea-bbd5-a61752b4aa26 tempest-GroupsTest-1276407125 None] Created reservations ['2a63b81d-fc2f-4b9d-9014-eb6a93702893'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:50:06 devstack sudo[100410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-48e533fa-fad4-45be-957c-6bee090da5b6 Jul 31 10:50:06 devstack sudo[100410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:06 devstack cinder-volume[89090]: WARNING cinder.quota [None req-aad72874-c8b5-4bea-bbd5-a61752b4aa26 tempest-GroupsTest-1276407125 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-753160279 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-753160279, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:50:06 devstack cinder-volume[89090]: WARNING cinder.quota [None req-aad72874-c8b5-4bea-bbd5-a61752b4aa26 tempest-GroupsTest-1276407125 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-753160279 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-753160279, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:50:06 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-aad72874-c8b5-4bea-bbd5-a61752b4aa26 tempest-GroupsTest-1276407125 None] Created reservations ['3b81a1b3-fdd6-40ac-a023-4bac84e7b101', '5d3c929a-6720-4903-b3cb-a17a573c08aa', '4ce0e51b-4f12-4545-80ff-15ece9c0b535', '300688c5-7a05-4f82-99b4-4afeaba96db0'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:50:07 devstack sudo[100407]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-826f2a8d-1e13-450d-afae-6594d4780e99 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40991918-028b-474a-9954-4878a3513944 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944.13cffd89-b5cd-4f6a-b119-78ad0c1596b6" returned: 0 in 0.728s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:07 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-826f2a8d-1e13-450d-afae-6594d4780e99 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944.13cffd89-b5cd-4f6a-b119-78ad0c1596b6 is being set with open permissions: ugo+rw Jul 31 10:50:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-826f2a8d-1e13-450d-afae-6594d4780e99 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944.13cffd89-b5cd-4f6a-b119-78ad0c1596b6 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:07 devstack sudo[100417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944.13cffd89-b5cd-4f6a-b119-78ad0c1596b6 Jul 31 10:50:07 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-aad72874-c8b5-4bea-bbd5-a61752b4aa26 tempest-GroupsTest-1276407125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-aad72874-c8b5-4bea-bbd5-a61752b4aa26 tempest-GroupsTest-1276407125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:07 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-aad72874-c8b5-4bea-bbd5-a61752b4aa26 tempest-GroupsTest-1276407125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:50:07 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-aad72874-c8b5-4bea-bbd5-a61752b4aa26 tempest-GroupsTest-1276407125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:50:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-aad72874-c8b5-4bea-bbd5-a61752b4aa26 tempest-GroupsTest-1276407125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-aad72874-c8b5-4bea-bbd5-a61752b4aa26 tempest-GroupsTest-1276407125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:07 devstack sudo[100410]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d83a2bba-76fe-44f8-a356-daed11463b6d tempest-VolumesGetTest-2086150122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-48e533fa-fad4-45be-957c-6bee090da5b6" returned: 0 in 0.748s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d83a2bba-76fe-44f8-a356-daed11463b6d tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-48e533fa-fad4-45be-957c-6bee090da5b6 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:07 devstack sudo[100422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:50:07 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:07 devstack sudo[100424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-48e533fa-fad4-45be-957c-6bee090da5b6 Jul 31 10:50:07 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:07 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-826f2a8d-1e13-450d-afae-6594d4780e99 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944.13cffd89-b5cd-4f6a-b119-78ad0c1596b6" returned: 0 in 0.572s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:07 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-aad72874-c8b5-4bea-bbd5-a61752b4aa26 tempest-GroupsTest-1276407125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.371s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:07 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-aad72874-c8b5-4bea-bbd5-a61752b4aa26 tempest-GroupsTest-1276407125 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:50:07 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-aad72874-c8b5-4bea-bbd5-a61752b4aa26 tempest-GroupsTest-1276407125 None] Delete group completed successfully. Jul 31 10:50:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-826f2a8d-1e13-450d-afae-6594d4780e99 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:07 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d83a2bba-76fe-44f8-a356-daed11463b6d tempest-VolumesGetTest-2086150122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-48e533fa-fad4-45be-957c-6bee090da5b6" returned: 0 in 0.400s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:07 devstack sudo[100430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944.info Jul 31 10:50:07 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:07 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d83a2bba-76fe-44f8-a356-daed11463b6d tempest-VolumesGetTest-2086150122 None] Lock "cinder-quobyte-48e533fa-fad4-45be-957c-6bee090da5b6" released by "delete_volume" :: held 1.240s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:50:07 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-d83a2bba-76fe-44f8-a356-daed11463b6d tempest-VolumesGetTest-2086150122 None] Created reservations ['af22e38f-7d1f-4128-9382-8b9f6eb2ae6c', '1e0ba97c-fd0c-458d-b320-e389ffa749c2', '77b4b26d-6d24-418f-a27c-21d4740df0b0', 'df4a03a4-f033-4ec0-b12b-8ce036b8e2db'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:50:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d83a2bba-76fe-44f8-a356-daed11463b6d tempest-VolumesGetTest-2086150122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d83a2bba-76fe-44f8-a356-daed11463b6d tempest-VolumesGetTest-2086150122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:07 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d83a2bba-76fe-44f8-a356-daed11463b6d tempest-VolumesGetTest-2086150122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:50:07 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d83a2bba-76fe-44f8-a356-daed11463b6d tempest-VolumesGetTest-2086150122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:50:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d83a2bba-76fe-44f8-a356-daed11463b6d tempest-VolumesGetTest-2086150122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d83a2bba-76fe-44f8-a356-daed11463b6d tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:07 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:50:07 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:08 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-826f2a8d-1e13-450d-afae-6594d4780e99 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944.info" returned: 0 in 0.386s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:08 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-826f2a8d-1e13-450d-afae-6594d4780e99 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944.info is being set with open permissions: ugo+rw Jul 31 10:50:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-826f2a8d-1e13-450d-afae-6594d4780e99 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:08 devstack sudo[100435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944.info Jul 31 10:50:08 devstack sudo[100435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:08 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d83a2bba-76fe-44f8-a356-daed11463b6d tempest-VolumesGetTest-2086150122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.323s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:08 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-d83a2bba-76fe-44f8-a356-daed11463b6d tempest-VolumesGetTest-2086150122 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:50:08 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-d83a2bba-76fe-44f8-a356-daed11463b6d tempest-VolumesGetTest-2086150122 None] Deleted volume successfully. Jul 31 10:50:08 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d83a2bba-76fe-44f8-a356-daed11463b6d tempest-VolumesGetTest-2086150122 None] Lock "cinder-48e533fa-fad4-45be-957c-6bee090da5b6-delete_volume" released by "delete_volume" :: held 1.910s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:50:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-826f2a8d-1e13-450d-afae-6594d4780e99 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944.info" returned: 0 in 0.412s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:08 devstack sudo[100435]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-826f2a8d-1e13-450d-afae-6594d4780e99 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.497s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:08 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-826f2a8d-1e13-450d-afae-6594d4780e99 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Create snapshot completed successfully Jul 31 10:50:08 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-fe3a6077-e3dc-4a48-ae21-7b60dc4c51a4 tempest-GroupsTest-1276407125 None] Created reservations ['5a3ac5bd-e32a-4ba7-8766-254be2b4302a'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:50:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-fe3a6077-e3dc-4a48-ae21-7b60dc4c51a4 tempest-GroupsTest-1276407125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-fe3a6077-e3dc-4a48-ae21-7b60dc4c51a4 tempest-GroupsTest-1276407125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:08 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-fe3a6077-e3dc-4a48-ae21-7b60dc4c51a4 tempest-GroupsTest-1276407125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:50:08 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-fe3a6077-e3dc-4a48-ae21-7b60dc4c51a4 tempest-GroupsTest-1276407125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:50:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-fe3a6077-e3dc-4a48-ae21-7b60dc4c51a4 tempest-GroupsTest-1276407125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fe3a6077-e3dc-4a48-ae21-7b60dc4c51a4 tempest-GroupsTest-1276407125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:08 devstack sudo[100439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:50:08 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:08 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-fd65d1d8-0e05-475c-b3c7-9303358cd0f5 tempest-VolumesGetTest-2086150122 None] Acquiring lock "cinder-8b40ca65-8b98-4c75-b1b2-414925d371f6-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:50:08 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-fd65d1d8-0e05-475c-b3c7-9303358cd0f5 tempest-VolumesGetTest-2086150122 None] Lock "cinder-8b40ca65-8b98-4c75-b1b2-414925d371f6-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:50:09 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-fd65d1d8-0e05-475c-b3c7-9303358cd0f5 tempest-VolumesGetTest-2086150122 None] Acquiring lock "cinder-quobyte-8b40ca65-8b98-4c75-b1b2-414925d371f6" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:50:09 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-fd65d1d8-0e05-475c-b3c7-9303358cd0f5 tempest-VolumesGetTest-2086150122 None] Lock "cinder-quobyte-8b40ca65-8b98-4c75-b1b2-414925d371f6" acquired by "delete_volume" :: waited 0.033s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:50:09 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fe3a6077-e3dc-4a48-ae21-7b60dc4c51a4 tempest-GroupsTest-1276407125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.473s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:09 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-fe3a6077-e3dc-4a48-ae21-7b60dc4c51a4 tempest-GroupsTest-1276407125 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:50:09 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda35047-e79a-412f-9f57-c788a1342663]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:50:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fd65d1d8-0e05-475c-b3c7-9303358cd0f5 tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b40ca65-8b98-4c75-b1b2-414925d371f6 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:09 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-fe3a6077-e3dc-4a48-ae21-7b60dc4c51a4 tempest-GroupsTest-1276407125 None] Delete group completed successfully. Jul 31 10:50:09 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-25889d7d-1b65-4406-9eed-78f815daac27 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Acquiring lock "cinder-13cffd89-b5cd-4f6a-b119-78ad0c1596b6-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:50:09 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-25889d7d-1b65-4406-9eed-78f815daac27 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Lock "cinder-13cffd89-b5cd-4f6a-b119-78ad0c1596b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:50:09 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-25889d7d-1b65-4406-9eed-78f815daac27 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Acquiring lock "cinder-quobyte-40991918-028b-474a-9954-4878a3513944" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:50:09 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-25889d7d-1b65-4406-9eed-78f815daac27 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Lock "cinder-quobyte-40991918-028b-474a-9954-4878a3513944" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:50:09 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-25889d7d-1b65-4406-9eed-78f815daac27 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Acquiring lock "cinder-quobyte-13cffd89-b5cd-4f6a-b119-78ad0c1596b6" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:50:09 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-25889d7d-1b65-4406-9eed-78f815daac27 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Lock "cinder-quobyte-13cffd89-b5cd-4f6a-b119-78ad0c1596b6" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:50:09 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-25889d7d-1b65-4406-9eed-78f815daac27 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Deleting offline snapshot 13cffd89-b5cd-4f6a-b119-78ad0c1596b6 of volume 40991918-028b-474a-9954-4878a3513944 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:50:09 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-25889d7d-1b65-4406-9eed-78f815daac27 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] snapshot_file for this snap is: volume-40991918-028b-474a-9954-4878a3513944.13cffd89-b5cd-4f6a-b119-78ad0c1596b6 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:50:09 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[63441fc1-3033-41da-a697-f8b159bd5210]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:50:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-25889d7d-1b65-4406-9eed-78f815daac27 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944.13cffd89-b5cd-4f6a-b119-78ad0c1596b6 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:09 devstack sudo[100442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b40ca65-8b98-4c75-b1b2-414925d371f6 Jul 31 10:50:09 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:09 devstack sudo[100443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944.13cffd89-b5cd-4f6a-b119-78ad0c1596b6 Jul 31 10:50:09 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:09 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fd65d1d8-0e05-475c-b3c7-9303358cd0f5 tempest-VolumesGetTest-2086150122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b40ca65-8b98-4c75-b1b2-414925d371f6" returned: 0 in 0.741s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fd65d1d8-0e05-475c-b3c7-9303358cd0f5 tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b40ca65-8b98-4c75-b1b2-414925d371f6 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:10 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b40ca65-8b98-4c75-b1b2-414925d371f6 Jul 31 10:50:10 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:10 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-25889d7d-1b65-4406-9eed-78f815daac27 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944.13cffd89-b5cd-4f6a-b119-78ad0c1596b6" returned: 0 in 0.687s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:10 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-25889d7d-1b65-4406-9eed-78f815daac27 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40991918-028b-474a-9954-4878a3513944(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:50:10 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[165dced1-b1cf-4bd9-ada4-efee2dd9aa34]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:50:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-25889d7d-1b65-4406-9eed-78f815daac27 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:10 devstack sudo[100455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944 Jul 31 10:50:10 devstack sudo[100455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:10 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fd65d1d8-0e05-475c-b3c7-9303358cd0f5 tempest-VolumesGetTest-2086150122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b40ca65-8b98-4c75-b1b2-414925d371f6" returned: 0 in 0.560s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-fd65d1d8-0e05-475c-b3c7-9303358cd0f5 tempest-VolumesGetTest-2086150122 None] Lock "cinder-quobyte-8b40ca65-8b98-4c75-b1b2-414925d371f6" released by "delete_volume" :: held 1.426s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:50:10 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-fd65d1d8-0e05-475c-b3c7-9303358cd0f5 tempest-VolumesGetTest-2086150122 None] Created reservations ['c1351386-fe2b-43ee-9729-6660b457937e', '809cf84a-cbf5-4873-96dd-714445f4e8ce', '01052bf0-a451-4b1b-a766-608bbdb7ed19', '470d29b9-b81d-44be-9635-775b483a622e'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:50:10 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-d664ff4b-a72e-4f99-a16e-a13a8521dd34 tempest-GroupsTest-1276407125 None] Group tempest-GroupsTest-Group-555209463: creating Jul 31 10:50:10 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-d664ff4b-a72e-4f99-a16e-a13a8521dd34 tempest-GroupsTest-1276407125 None] Group tempest-GroupsTest-Group-555209463: created successfully Jul 31 10:50:10 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-d664ff4b-a72e-4f99-a16e-a13a8521dd34 tempest-GroupsTest-1276407125 None] Create group completed successfully. Jul 31 10:50:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-fd65d1d8-0e05-475c-b3c7-9303358cd0f5 tempest-VolumesGetTest-2086150122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-fd65d1d8-0e05-475c-b3c7-9303358cd0f5 tempest-VolumesGetTest-2086150122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:10 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-fd65d1d8-0e05-475c-b3c7-9303358cd0f5 tempest-VolumesGetTest-2086150122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:50:10 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-fd65d1d8-0e05-475c-b3c7-9303358cd0f5 tempest-VolumesGetTest-2086150122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:50:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-fd65d1d8-0e05-475c-b3c7-9303358cd0f5 tempest-VolumesGetTest-2086150122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fd65d1d8-0e05-475c-b3c7-9303358cd0f5 tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:10 devstack sudo[100455]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-25889d7d-1b65-4406-9eed-78f815daac27 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944" returned: 0 in 0.757s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-25889d7d-1b65-4406-9eed-78f815daac27 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944.13cffd89-b5cd-4f6a-b119-78ad0c1596b6 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:10 devstack sudo[100469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:50:10 devstack sudo[100469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:10 devstack sudo[100470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944.13cffd89-b5cd-4f6a-b119-78ad0c1596b6 Jul 31 10:50:10 devstack sudo[100470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:11 devstack sudo[100469]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fd65d1d8-0e05-475c-b3c7-9303358cd0f5 tempest-VolumesGetTest-2086150122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.416s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:11 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-fd65d1d8-0e05-475c-b3c7-9303358cd0f5 tempest-VolumesGetTest-2086150122 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:50:11 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-fd65d1d8-0e05-475c-b3c7-9303358cd0f5 tempest-VolumesGetTest-2086150122 None] Deleted volume successfully. Jul 31 10:50:11 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-fd65d1d8-0e05-475c-b3c7-9303358cd0f5 tempest-VolumesGetTest-2086150122 None] Lock "cinder-8b40ca65-8b98-4c75-b1b2-414925d371f6-delete_volume" released by "delete_volume" :: held 2.367s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:50:11 devstack sudo[100470]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-25889d7d-1b65-4406-9eed-78f815daac27 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944.13cffd89-b5cd-4f6a-b119-78ad0c1596b6" returned: 0 in 0.481s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-25889d7d-1b65-4406-9eed-78f815daac27 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944.13cffd89-b5cd-4f6a-b119-78ad0c1596b6 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:11 devstack sudo[100479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944.13cffd89-b5cd-4f6a-b119-78ad0c1596b6 Jul 31 10:50:11 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:11 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-25889d7d-1b65-4406-9eed-78f815daac27 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944.13cffd89-b5cd-4f6a-b119-78ad0c1596b6" returned: 0 in 0.356s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:11 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-25889d7d-1b65-4406-9eed-78f815daac27 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Lock "cinder-quobyte-13cffd89-b5cd-4f6a-b119-78ad0c1596b6" released by "_delete_snapshot" :: held 2.463s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:50:11 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-25889d7d-1b65-4406-9eed-78f815daac27 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Lock "cinder-quobyte-40991918-028b-474a-9954-4878a3513944" released by "delete_snapshot" :: held 2.514s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:50:11 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-25889d7d-1b65-4406-9eed-78f815daac27 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Created reservations ['7e673550-db8e-40b6-86b7-875713417228', '20b870f4-626a-4f87-85d6-9cdc9b514055', '020f5f0f-fbc5-4e00-89ff-a6b8b6f2cfbf', 'c84d921b-6aa9-4319-89a1-4af39757110c'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0719072-19ca-4cf8-b644-cfb67d7a25de tempest-VolumesGetTest-2086150122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0719072-19ca-4cf8-b644-cfb67d7a25de tempest-VolumesGetTest-2086150122 None] Flow 'volume_create_manager' (2d9bdd98-109b-4de7-bdec-0d135718af63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0719072-19ca-4cf8-b644-cfb67d7a25de tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3e13fea-c7d7-4ca6-b481-5f380ff319ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0719072-19ca-4cf8-b644-cfb67d7a25de tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3e13fea-c7d7-4ca6-b481-5f380ff319ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1490441416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d775dd6a-0634-44ab-bcdb-32961adc4cb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e83d68bd1e841808f4c9cbc3d39ac25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:50:12Z,use_quota=True,user_id='d8850379515d4edbb49086c958167c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0719072-19ca-4cf8-b644-cfb67d7a25de tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5a9d37d-fa97-49dd-92b9-be19dd599e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0719072-19ca-4cf8-b644-cfb67d7a25de tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5a9d37d-fa97-49dd-92b9-be19dd599e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0719072-19ca-4cf8-b644-cfb67d7a25de tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a116754-de89-43d2-af05-827f9ac14e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0719072-19ca-4cf8-b644-cfb67d7a25de tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a116754-de89-43d2-af05-827f9ac14e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd775dd6a-0634-44ab-bcdb-32961adc4cb4', 'volume_name': 'volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0719072-19ca-4cf8-b644-cfb67d7a25de tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a15ff7b2-b48c-4975-b876-4c2ee6f383b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0719072-19ca-4cf8-b644-cfb67d7a25de tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a15ff7b2-b48c-4975-b876-4c2ee6f383b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0719072-19ca-4cf8-b644-cfb67d7a25de tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f6e758b-a048-409b-9269-b3a1d9d699fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:12 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-c0719072-19ca-4cf8-b644-cfb67d7a25de tempest-VolumesGetTest-2086150122 None] Volume d775dd6a-0634-44ab-bcdb-32961adc4cb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4', 'volume_size': 1} Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c0719072-19ca-4cf8-b644-cfb67d7a25de tempest-VolumesGetTest-2086150122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c0719072-19ca-4cf8-b644-cfb67d7a25de tempest-VolumesGetTest-2086150122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c0719072-19ca-4cf8-b644-cfb67d7a25de tempest-VolumesGetTest-2086150122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1490441416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d775dd6a-0634-44ab-bcdb-32961adc4cb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e83d68bd1e841808f4c9cbc3d39ac25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:50:12Z,use_quota=True,user_id='d8850379515d4edbb49086c958167c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-c0719072-19ca-4cf8-b644-cfb67d7a25de tempest-VolumesGetTest-2086150122 None] Creating volume d775dd6a-0634-44ab-bcdb-32961adc4cb4 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c0719072-19ca-4cf8-b644-cfb67d7a25de tempest-VolumesGetTest-2086150122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c0719072-19ca-4cf8-b644-cfb67d7a25de tempest-VolumesGetTest-2086150122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c0719072-19ca-4cf8-b644-cfb67d7a25de tempest-VolumesGetTest-2086150122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c0719072-19ca-4cf8-b644-cfb67d7a25de tempest-VolumesGetTest-2086150122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c0719072-19ca-4cf8-b644-cfb67d7a25de tempest-VolumesGetTest-2086150122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c0719072-19ca-4cf8-b644-cfb67d7a25de tempest-VolumesGetTest-2086150122 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:50:12 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-c0719072-19ca-4cf8-b644-cfb67d7a25de tempest-VolumesGetTest-2086150122 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c0719072-19ca-4cf8-b644-cfb67d7a25de tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:12 devstack sudo[100482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4 1073741824 Jul 31 10:50:12 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:12 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-25889d7d-1b65-4406-9eed-78f815daac27 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Delete snapshot completed successfully. Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-25889d7d-1b65-4406-9eed-78f815daac27 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Lock "cinder-13cffd89-b5cd-4f6a-b119-78ad0c1596b6-delete_snapshot" released by "delete_snapshot" :: held 2.913s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-86a9ae3a-1062-4c8c-8ef9-8b5f676ffc47 tempest-GroupsTest-1276407125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:50:12 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-86a9ae3a-1062-4c8c-8ef9-8b5f676ffc47 tempest-GroupsTest-1276407125 None] Flow 'volume_create_manager' (30184cfc-dd20-4a05-ba94-76f9c396887e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-86a9ae3a-1062-4c8c-8ef9-8b5f676ffc47 tempest-GroupsTest-1276407125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5300aed1-6537-4952-ac57-45ad523778a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-05ea5165-6355-4ea6-927a-fced2efaf322 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Acquiring lock "cinder-40991918-028b-474a-9954-4878a3513944-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c0719072-19ca-4cf8-b644-cfb67d7a25de tempest-VolumesGetTest-2086150122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4 1073741824" returned: 0 in 0.652s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-86a9ae3a-1062-4c8c-8ef9-8b5f676ffc47 tempest-GroupsTest-1276407125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5300aed1-6537-4952-ac57-45ad523778a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1640585238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c679eeed-a190-499a-977a-bcbb67e6a2fb,host='devstack@QuobyteHD#QuobyteHD',id=bcef5ab3-682e-4c6d-8f77-a4eb71df4543,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccaf4bd6a4f04364ab78245a910fd830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:50:13Z,use_quota=True,user_id='1cfcf95e152148ee8906ac0b7fed5c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21bef501-5da4-4b6d-b72c-6a479c0e0f2f),volume_type_id=21bef501-5da4-4b6d-b72c-6a479c0e0f2f)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-86a9ae3a-1062-4c8c-8ef9-8b5f676ffc47 tempest-GroupsTest-1276407125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c5f518-8dfd-4dd3-826b-1c9c051421b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-86a9ae3a-1062-4c8c-8ef9-8b5f676ffc47 tempest-GroupsTest-1276407125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c5f518-8dfd-4dd3-826b-1c9c051421b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-86a9ae3a-1062-4c8c-8ef9-8b5f676ffc47 tempest-GroupsTest-1276407125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92fcbda1-5eb6-4e4c-80dc-f626713636ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-86a9ae3a-1062-4c8c-8ef9-8b5f676ffc47 tempest-GroupsTest-1276407125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92fcbda1-5eb6-4e4c-80dc-f626713636ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcef5ab3-682e-4c6d-8f77-a4eb71df4543', 'volume_name': 'volume-bcef5ab3-682e-4c6d-8f77-a4eb71df4543', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-86a9ae3a-1062-4c8c-8ef9-8b5f676ffc47 tempest-GroupsTest-1276407125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee826bfd-8f6f-4809-8bd2-7ded1e7df723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-86a9ae3a-1062-4c8c-8ef9-8b5f676ffc47 tempest-GroupsTest-1276407125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee826bfd-8f6f-4809-8bd2-7ded1e7df723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-86a9ae3a-1062-4c8c-8ef9-8b5f676ffc47 tempest-GroupsTest-1276407125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2232d22a-9a47-46f4-ab81-fab4fc62b2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:12 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-86a9ae3a-1062-4c8c-8ef9-8b5f676ffc47 tempest-GroupsTest-1276407125 None] Volume bcef5ab3-682e-4c6d-8f77-a4eb71df4543: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcef5ab3-682e-4c6d-8f77-a4eb71df4543', 'volume_size': 1} Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-86a9ae3a-1062-4c8c-8ef9-8b5f676ffc47 tempest-GroupsTest-1276407125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-05ea5165-6355-4ea6-927a-fced2efaf322 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Lock "cinder-40991918-028b-474a-9954-4878a3513944-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c0719072-19ca-4cf8-b644-cfb67d7a25de tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-05ea5165-6355-4ea6-927a-fced2efaf322 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Acquiring lock "cinder-quobyte-40991918-028b-474a-9954-4878a3513944" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:50:12 devstack sudo[100488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4 Jul 31 10:50:12 devstack sudo[100488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-05ea5165-6355-4ea6-927a-fced2efaf322 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Lock "cinder-quobyte-40991918-028b-474a-9954-4878a3513944" acquired by "delete_volume" :: waited 0.023s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[696214ca-cb1d-4400-8008-1c0e83829ede]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:50:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-05ea5165-6355-4ea6-927a-fced2efaf322 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:13 devstack sudo[100490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944 Jul 31 10:50:13 devstack sudo[100490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:13 devstack sudo[100488]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c0719072-19ca-4cf8-b644-cfb67d7a25de tempest-VolumesGetTest-2086150122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4" returned: 0 in 0.313s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:13 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c0719072-19ca-4cf8-b644-cfb67d7a25de tempest-VolumesGetTest-2086150122 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:50:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c0719072-19ca-4cf8-b644-cfb67d7a25de tempest-VolumesGetTest-2086150122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-86a9ae3a-1062-4c8c-8ef9-8b5f676ffc47 tempest-GroupsTest-1276407125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.355s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:13 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-86a9ae3a-1062-4c8c-8ef9-8b5f676ffc47 tempest-GroupsTest-1276407125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c679eeed-a190-499a-977a-bcbb67e6a2fb,created_at=2026-07-31T08:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1640585238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c679eeed-a190-499a-977a-bcbb67e6a2fb,host='devstack@QuobyteHD#QuobyteHD',id=bcef5ab3-682e-4c6d-8f77-a4eb71df4543,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccaf4bd6a4f04364ab78245a910fd830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:50:13Z,use_quota=True,user_id='1cfcf95e152148ee8906ac0b7fed5c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21bef501-5da4-4b6d-b72c-6a479c0e0f2f),volume_type_id=21bef501-5da4-4b6d-b72c-6a479c0e0f2f)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:50:13 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-86a9ae3a-1062-4c8c-8ef9-8b5f676ffc47 tempest-GroupsTest-1276407125 None] Creating volume bcef5ab3-682e-4c6d-8f77-a4eb71df4543 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:50:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-86a9ae3a-1062-4c8c-8ef9-8b5f676ffc47 tempest-GroupsTest-1276407125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-86a9ae3a-1062-4c8c-8ef9-8b5f676ffc47 tempest-GroupsTest-1276407125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:13 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-86a9ae3a-1062-4c8c-8ef9-8b5f676ffc47 tempest-GroupsTest-1276407125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:50:13 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-86a9ae3a-1062-4c8c-8ef9-8b5f676ffc47 tempest-GroupsTest-1276407125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:50:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-86a9ae3a-1062-4c8c-8ef9-8b5f676ffc47 tempest-GroupsTest-1276407125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:13 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-86a9ae3a-1062-4c8c-8ef9-8b5f676ffc47 tempest-GroupsTest-1276407125 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:50:13 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-86a9ae3a-1062-4c8c-8ef9-8b5f676ffc47 tempest-GroupsTest-1276407125 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:50:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-86a9ae3a-1062-4c8c-8ef9-8b5f676ffc47 tempest-GroupsTest-1276407125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bcef5ab3-682e-4c6d-8f77-a4eb71df4543 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:13 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0719072-19ca-4cf8-b644-cfb67d7a25de tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f6e758b-a048-409b-9269-b3a1d9d699fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:13 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0719072-19ca-4cf8-b644-cfb67d7a25de tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55b27f9d-fe41-4d0d-ad5e-3327e094de55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:13 devstack sudo[100493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bcef5ab3-682e-4c6d-8f77-a4eb71df4543 1073741824 Jul 31 10:50:13 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:13 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-c0719072-19ca-4cf8-b644-cfb67d7a25de tempest-VolumesGetTest-2086150122 None] Volume volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4 (d775dd6a-0634-44ab-bcdb-32961adc4cb4): created successfully Jul 31 10:50:13 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0719072-19ca-4cf8-b644-cfb67d7a25de tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55b27f9d-fe41-4d0d-ad5e-3327e094de55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:13 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0719072-19ca-4cf8-b644-cfb67d7a25de tempest-VolumesGetTest-2086150122 None] Flow 'volume_create_manager' (2d9bdd98-109b-4de7-bdec-0d135718af63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:50:13 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-c0719072-19ca-4cf8-b644-cfb67d7a25de tempest-VolumesGetTest-2086150122 None] Created volume successfully. Jul 31 10:50:13 devstack sudo[100490]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-05ea5165-6355-4ea6-927a-fced2efaf322 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944" returned: 0 in 0.437s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-05ea5165-6355-4ea6-927a-fced2efaf322 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:13 devstack sudo[100498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944 Jul 31 10:50:13 devstack sudo[100498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:13 devstack sudo[100498]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-05ea5165-6355-4ea6-927a-fced2efaf322 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-40991918-028b-474a-9954-4878a3513944" returned: 0 in 0.296s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:13 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-05ea5165-6355-4ea6-927a-fced2efaf322 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Lock "cinder-quobyte-40991918-028b-474a-9954-4878a3513944" released by "delete_volume" :: held 0.807s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:50:13 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-86a9ae3a-1062-4c8c-8ef9-8b5f676ffc47 tempest-GroupsTest-1276407125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bcef5ab3-682e-4c6d-8f77-a4eb71df4543 1073741824" returned: 0 in 0.531s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-86a9ae3a-1062-4c8c-8ef9-8b5f676ffc47 tempest-GroupsTest-1276407125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bcef5ab3-682e-4c6d-8f77-a4eb71df4543 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:13 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-05ea5165-6355-4ea6-927a-fced2efaf322 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Created reservations ['34d5a5ef-7d63-420d-b783-dcd3948f1402', '3d3e0ed8-94dd-48df-96e8-3d1a7cabdb76', '929a6ef8-0f16-4108-a918-54a4c3570345', 'bfc557b1-dcd2-4ea7-a6ee-8d8cd56b14bf'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:50:13 devstack sudo[100505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bcef5ab3-682e-4c6d-8f77-a4eb71df4543 Jul 31 10:50:13 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-05ea5165-6355-4ea6-927a-fced2efaf322 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-05ea5165-6355-4ea6-927a-fced2efaf322 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:13 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-05ea5165-6355-4ea6-927a-fced2efaf322 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:50:13 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-05ea5165-6355-4ea6-927a-fced2efaf322 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:50:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-05ea5165-6355-4ea6-927a-fced2efaf322 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-05ea5165-6355-4ea6-927a-fced2efaf322 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:14 devstack sudo[100507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:50:14 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:14 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-86a9ae3a-1062-4c8c-8ef9-8b5f676ffc47 tempest-GroupsTest-1276407125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bcef5ab3-682e-4c6d-8f77-a4eb71df4543" returned: 0 in 0.402s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:14 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-86a9ae3a-1062-4c8c-8ef9-8b5f676ffc47 tempest-GroupsTest-1276407125 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:50:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-86a9ae3a-1062-4c8c-8ef9-8b5f676ffc47 tempest-GroupsTest-1276407125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-86a9ae3a-1062-4c8c-8ef9-8b5f676ffc47 tempest-GroupsTest-1276407125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2232d22a-9a47-46f4-ab81-fab4fc62b2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcef5ab3-682e-4c6d-8f77-a4eb71df4543', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-86a9ae3a-1062-4c8c-8ef9-8b5f676ffc47 tempest-GroupsTest-1276407125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f3823f5-14c8-4984-9c8b-555bfb2eb7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:14 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-86a9ae3a-1062-4c8c-8ef9-8b5f676ffc47 tempest-GroupsTest-1276407125 None] Volume volume-bcef5ab3-682e-4c6d-8f77-a4eb71df4543 (bcef5ab3-682e-4c6d-8f77-a4eb71df4543): created successfully Jul 31 10:50:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-86a9ae3a-1062-4c8c-8ef9-8b5f676ffc47 tempest-GroupsTest-1276407125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f3823f5-14c8-4984-9c8b-555bfb2eb7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-86a9ae3a-1062-4c8c-8ef9-8b5f676ffc47 tempest-GroupsTest-1276407125 None] Flow 'volume_create_manager' (30184cfc-dd20-4a05-ba94-76f9c396887e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:50:14 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-86a9ae3a-1062-4c8c-8ef9-8b5f676ffc47 tempest-GroupsTest-1276407125 None] Created volume successfully. Jul 31 10:50:14 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-05ea5165-6355-4ea6-927a-fced2efaf322 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.369s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:14 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-05ea5165-6355-4ea6-927a-fced2efaf322 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:50:14 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-05ea5165-6355-4ea6-927a-fced2efaf322 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Deleted volume successfully. Jul 31 10:50:14 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-05ea5165-6355-4ea6-927a-fced2efaf322 tempest-VolumesSnapshotNegativeTestJSON-2050684443 None] Lock "cinder-40991918-028b-474a-9954-4878a3513944-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:50:14 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:50:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Flow 'volume_create_manager' (28d7cfbc-1cf9-4ca6-a92a-018a8ca69c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:50:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51012710-f50d-4d5c-bca3-18b20344aa88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51012710-f50d-4d5c-bca3-18b20344aa88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-914279646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d2f5313-4bc1-4b43-a815-160485feace4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5e83d68bd1e841808f4c9cbc3d39ac25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=d775dd6a-0634-44ab-bcdb-32961adc4cb4,status='creating',terminated_at=None,updated_at=2026-07-31T08:50:15Z,use_quota=True,user_id='d8850379515d4edbb49086c958167c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b513568-8369-487c-95ca-7fddb2844753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b513568-8369-487c-95ca-7fddb2844753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5866c1d-105c-42b1-9b05-2c23f49477ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5866c1d-105c-42b1-9b05-2c23f49477ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6d2f5313-4bc1-4b43-a815-160485feace4', 'volume_name': 'volume-6d2f5313-4bc1-4b43-a815-160485feace4', 'volume_size': 1, 'source_volid': 'd775dd6a-0634-44ab-bcdb-32961adc4cb4', 'source_volstatus': 'available'}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b79f469-c9a0-459f-af09-cea99816f6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b79f469-c9a0-459f-af09-cea99816f6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afbfd7be-4958-4eb4-8f4b-0c4accd95d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:14 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Volume 6d2f5313-4bc1-4b43-a815-160485feace4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6d2f5313-4bc1-4b43-a815-160485feace4', 'volume_size': 1, 'source_volid': 'd775dd6a-0634-44ab-bcdb-32961adc4cb4', 'source_volstatus': 'available'} Jul 31 10:50:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:14 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Cloning volume d775dd6a-0634-44ab-bcdb-32961adc4cb4 to volume 6d2f5313-4bc1-4b43-a815-160485feace4 Jul 31 10:50:14 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Creating offline snapshot 4cfa8e51-5e09-486c-af06-c685f64b6db9 of volume d775dd6a-0634-44ab-bcdb-32961adc4cb4 {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:50:15 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c8d218-8454-46a8-8be7-34a39fc1c64c]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:50:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:15 devstack sudo[100511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4 Jul 31 10:50:15 devstack sudo[100511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:15 devstack sudo[100511]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4" returned: 0 in 0.493s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4.4cfa8e51-5e09-486c-af06-c685f64b6db9 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:15 devstack sudo[100517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4.4cfa8e51-5e09-486c-af06-c685f64b6db9 1G Jul 31 10:50:15 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:16 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-455c9f57-8f06-4ab4-a510-78512058d0db tempest-GroupsTest-1276407125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:50:16 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-455c9f57-8f06-4ab4-a510-78512058d0db tempest-GroupsTest-1276407125 None] Flow 'volume_create_manager' (ec6eccb9-b08f-4b5f-a57e-7fbb737a7b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:50:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-455c9f57-8f06-4ab4-a510-78512058d0db tempest-GroupsTest-1276407125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe7303d-86f6-4866-b08a-60e26250cfc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4.4cfa8e51-5e09-486c-af06-c685f64b6db9 1G" returned: 0 in 0.788s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4.4cfa8e51-5e09-486c-af06-c685f64b6db9 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:16 devstack sudo[100522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4.4cfa8e51-5e09-486c-af06-c685f64b6db9 Jul 31 10:50:16 devstack sudo[100522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-455c9f57-8f06-4ab4-a510-78512058d0db tempest-GroupsTest-1276407125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe7303d-86f6-4866-b08a-60e26250cfc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-28556467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c679eeed-a190-499a-977a-bcbb67e6a2fb,host='devstack@QuobyteHD#QuobyteHD',id=a0441cfd-8a1f-4d0a-bcff-c9e381858dd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccaf4bd6a4f04364ab78245a910fd830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:50:16Z,use_quota=True,user_id='1cfcf95e152148ee8906ac0b7fed5c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21bef501-5da4-4b6d-b72c-6a479c0e0f2f),volume_type_id=21bef501-5da4-4b6d-b72c-6a479c0e0f2f)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-455c9f57-8f06-4ab4-a510-78512058d0db tempest-GroupsTest-1276407125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0773205-5697-4954-8009-df95b5030c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-455c9f57-8f06-4ab4-a510-78512058d0db tempest-GroupsTest-1276407125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0773205-5697-4954-8009-df95b5030c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-455c9f57-8f06-4ab4-a510-78512058d0db tempest-GroupsTest-1276407125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8fc1cc1-74fa-4271-a9ec-d6243d3ba637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-455c9f57-8f06-4ab4-a510-78512058d0db tempest-GroupsTest-1276407125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8fc1cc1-74fa-4271-a9ec-d6243d3ba637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0441cfd-8a1f-4d0a-bcff-c9e381858dd9', 'volume_name': 'volume-a0441cfd-8a1f-4d0a-bcff-c9e381858dd9', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-455c9f57-8f06-4ab4-a510-78512058d0db tempest-GroupsTest-1276407125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea6e4509-eab9-4f62-b5d7-c069d5d865d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-455c9f57-8f06-4ab4-a510-78512058d0db tempest-GroupsTest-1276407125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea6e4509-eab9-4f62-b5d7-c069d5d865d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-455c9f57-8f06-4ab4-a510-78512058d0db tempest-GroupsTest-1276407125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b4124a4-84e9-4101-a494-1da088f0303a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:16 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-455c9f57-8f06-4ab4-a510-78512058d0db tempest-GroupsTest-1276407125 None] Volume a0441cfd-8a1f-4d0a-bcff-c9e381858dd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0441cfd-8a1f-4d0a-bcff-c9e381858dd9', 'volume_size': 1} Jul 31 10:50:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-455c9f57-8f06-4ab4-a510-78512058d0db tempest-GroupsTest-1276407125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:16 devstack sudo[100522]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4.4cfa8e51-5e09-486c-af06-c685f64b6db9" returned: 0 in 0.397s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:16 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4.4cfa8e51-5e09-486c-af06-c685f64b6db9 is being set with open permissions: ugo+rw Jul 31 10:50:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4.4cfa8e51-5e09-486c-af06-c685f64b6db9 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:16 devstack sudo[100528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4.4cfa8e51-5e09-486c-af06-c685f64b6db9 Jul 31 10:50:16 devstack sudo[100528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:17 devstack sudo[100528]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4.4cfa8e51-5e09-486c-af06-c685f64b6db9" returned: 0 in 0.380s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:17 devstack sudo[100531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4.info Jul 31 10:50:17 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:17 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4.info" returned: 0 in 0.340s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:17 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4.info is being set with open permissions: ugo+rw Jul 31 10:50:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:17 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4.info Jul 31 10:50:17 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:17 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4.info" returned: 0 in 0.306s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:17 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Acquiring lock "cinder-quobyte-6d2f5313-4bc1-4b43-a815-160485feace4" by "_copy_volume_from_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:50:17 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Lock "cinder-quobyte-6d2f5313-4bc1-4b43-a815-160485feace4" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:50:17 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] snapshot: 4cfa8e51-5e09-486c-af06-c685f64b6db9, volume: 6d2f5313-4bc1-4b43-a815-160485feace4, {{(pid=89090) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 10:50:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:17 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:50:17 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:50:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:17 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac6b79a-5b6d-4fbc-8bed-01288cfbe1d6]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:50:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4.4cfa8e51-5e09-486c-af06-c685f64b6db9 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:18 devstack sudo[100538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4.4cfa8e51-5e09-486c-af06-c685f64b6db9 Jul 31 10:50:18 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:18 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4.4cfa8e51-5e09-486c-af06-c685f64b6db9" returned: 0 in 0.479s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:50:18 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[8802fd94-0727-46d3-95a4-dee017b5e3fa]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:50:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:18 devstack sudo[100543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4 Jul 31 10:50:18 devstack sudo[100543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:18 devstack sudo[100543]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4" returned: 0 in 0.532s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4 {{(pid=89090) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 10:50:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Creating direct copy from snapshot {{(pid=89090) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 10:50:18 devstack cinder-volume[89090]: DEBUG cinder.utils [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Path /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6d2f5313-4bc1-4b43-a815-160485feace4 not found in is_blk_device check {{(pid=89090) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 10:50:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6d2f5313-4bc1-4b43-a815-160485feace4 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:18 devstack sudo[100549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6d2f5313-4bc1-4b43-a815-160485feace4 Jul 31 10:50:18 devstack sudo[100549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:24 devstack sudo[100549]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6d2f5313-4bc1-4b43-a815-160485feace4" returned: 0 in 5.492s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:24 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Image conversion details: src /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4, size 1024.00 MB, duration 5.49 sec, destination /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6d2f5313-4bc1-4b43-a815-160485feace4 {{(pid=89090) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 10:50:24 devstack cinder-volume[89090]: INFO cinder.image.image_utils [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Converted 1024.00 MB image at 186.39 MB/s Jul 31 10:50:24 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6d2f5313-4bc1-4b43-a815-160485feace4 is being set with open permissions: ugo+rw Jul 31 10:50:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6d2f5313-4bc1-4b43-a815-160485feace4 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:24 devstack sudo[100579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6d2f5313-4bc1-4b43-a815-160485feace4 Jul 31 10:50:24 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:24 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6d2f5313-4bc1-4b43-a815-160485feace4" returned: 0 in 0.264s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:24 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Lock "cinder-quobyte-6d2f5313-4bc1-4b43-a815-160485feace4" released by "_copy_volume_from_snapshot" :: held 6.866s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:50:24 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Acquiring lock "cinder-quobyte-4cfa8e51-5e09-486c-af06-c685f64b6db9" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:50:24 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Lock "cinder-quobyte-4cfa8e51-5e09-486c-af06-c685f64b6db9" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:50:24 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Deleting offline snapshot 4cfa8e51-5e09-486c-af06-c685f64b6db9 of volume d775dd6a-0634-44ab-bcdb-32961adc4cb4 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:50:24 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] snapshot_file for this snap is: volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4.4cfa8e51-5e09-486c-af06-c685f64b6db9 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:50:24 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3215eb2-11c7-4a77-abd3-d785d16acd9e]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:50:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4.4cfa8e51-5e09-486c-af06-c685f64b6db9 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:24 devstack sudo[100582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4.4cfa8e51-5e09-486c-af06-c685f64b6db9 Jul 31 10:50:24 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:25 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4.4cfa8e51-5e09-486c-af06-c685f64b6db9" returned: 0 in 0.445s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:25 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:50:25 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ce9238-08b3-467d-b6ef-5edf8fd082a0]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:50:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:25 devstack sudo[100587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4 Jul 31 10:50:25 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:25 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4" returned: 0 in 0.646s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4.4cfa8e51-5e09-486c-af06-c685f64b6db9 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:25 devstack sudo[100592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4.4cfa8e51-5e09-486c-af06-c685f64b6db9 Jul 31 10:50:25 devstack sudo[100592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:26 devstack sudo[100592]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4.4cfa8e51-5e09-486c-af06-c685f64b6db9" returned: 0 in 0.389s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4.4cfa8e51-5e09-486c-af06-c685f64b6db9 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:26 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4.4cfa8e51-5e09-486c-af06-c685f64b6db9 Jul 31 10:50:26 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:26 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4.4cfa8e51-5e09-486c-af06-c685f64b6db9" returned: 0 in 0.264s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:26 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Lock "cinder-quobyte-4cfa8e51-5e09-486c-af06-c685f64b6db9" released by "_delete_snapshot" :: held 1.860s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:50:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.703s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-455c9f57-8f06-4ab4-a510-78512058d0db tempest-GroupsTest-1276407125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.219s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-455c9f57-8f06-4ab4-a510-78512058d0db tempest-GroupsTest-1276407125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c679eeed-a190-499a-977a-bcbb67e6a2fb,created_at=2026-07-31T08:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-28556467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c679eeed-a190-499a-977a-bcbb67e6a2fb,host='devstack@QuobyteHD#QuobyteHD',id=a0441cfd-8a1f-4d0a-bcff-c9e381858dd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccaf4bd6a4f04364ab78245a910fd830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:50:16Z,use_quota=True,user_id='1cfcf95e152148ee8906ac0b7fed5c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21bef501-5da4-4b6d-b72c-6a479c0e0f2f),volume_type_id=21bef501-5da4-4b6d-b72c-6a479c0e0f2f)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:50:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-455c9f57-8f06-4ab4-a510-78512058d0db tempest-GroupsTest-1276407125 None] Creating volume a0441cfd-8a1f-4d0a-bcff-c9e381858dd9 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:50:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-455c9f57-8f06-4ab4-a510-78512058d0db tempest-GroupsTest-1276407125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-455c9f57-8f06-4ab4-a510-78512058d0db tempest-GroupsTest-1276407125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-455c9f57-8f06-4ab4-a510-78512058d0db tempest-GroupsTest-1276407125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:50:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-455c9f57-8f06-4ab4-a510-78512058d0db tempest-GroupsTest-1276407125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:50:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-455c9f57-8f06-4ab4-a510-78512058d0db tempest-GroupsTest-1276407125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-455c9f57-8f06-4ab4-a510-78512058d0db tempest-GroupsTest-1276407125 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:50:26 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-455c9f57-8f06-4ab4-a510-78512058d0db tempest-GroupsTest-1276407125 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:50:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-455c9f57-8f06-4ab4-a510-78512058d0db tempest-GroupsTest-1276407125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a0441cfd-8a1f-4d0a-bcff-c9e381858dd9 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:26 devstack sudo[100601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a0441cfd-8a1f-4d0a-bcff-c9e381858dd9 1073741824 Jul 31 10:50:26 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afbfd7be-4958-4eb4-8f4b-0c4accd95d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d2f5313-4bc1-4b43-a815-160485feace4', 'volume_size': 1, 'source_volid': 'd775dd6a-0634-44ab-bcdb-32961adc4cb4', 'source_volstatus': 'available'}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (084970e3-edca-4684-8ca9-170455b4d2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:26 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Volume volume-6d2f5313-4bc1-4b43-a815-160485feace4 (6d2f5313-4bc1-4b43-a815-160485feace4): created successfully Jul 31 10:50:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (084970e3-edca-4684-8ca9-170455b4d2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Flow 'volume_create_manager' (28d7cfbc-1cf9-4ca6-a92a-018a8ca69c85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:50:26 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-d0d6d182-bd8e-4730-ba28-ed6629031c8e tempest-VolumesGetTest-2086150122 None] Created volume successfully. Jul 31 10:50:27 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-455c9f57-8f06-4ab4-a510-78512058d0db tempest-GroupsTest-1276407125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a0441cfd-8a1f-4d0a-bcff-c9e381858dd9 1073741824" returned: 0 in 0.663s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-455c9f57-8f06-4ab4-a510-78512058d0db tempest-GroupsTest-1276407125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a0441cfd-8a1f-4d0a-bcff-c9e381858dd9 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:27 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a0441cfd-8a1f-4d0a-bcff-c9e381858dd9 Jul 31 10:50:27 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:27 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-455c9f57-8f06-4ab4-a510-78512058d0db tempest-GroupsTest-1276407125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a0441cfd-8a1f-4d0a-bcff-c9e381858dd9" returned: 0 in 0.377s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:27 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-455c9f57-8f06-4ab4-a510-78512058d0db tempest-GroupsTest-1276407125 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:50:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-455c9f57-8f06-4ab4-a510-78512058d0db tempest-GroupsTest-1276407125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-455c9f57-8f06-4ab4-a510-78512058d0db tempest-GroupsTest-1276407125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b4124a4-84e9-4101-a494-1da088f0303a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0441cfd-8a1f-4d0a-bcff-c9e381858dd9', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-455c9f57-8f06-4ab4-a510-78512058d0db tempest-GroupsTest-1276407125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfac35d6-3264-438b-b549-8a4e868dd534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:27 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-455c9f57-8f06-4ab4-a510-78512058d0db tempest-GroupsTest-1276407125 None] Volume volume-a0441cfd-8a1f-4d0a-bcff-c9e381858dd9 (a0441cfd-8a1f-4d0a-bcff-c9e381858dd9): created successfully Jul 31 10:50:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-455c9f57-8f06-4ab4-a510-78512058d0db tempest-GroupsTest-1276407125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfac35d6-3264-438b-b549-8a4e868dd534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-455c9f57-8f06-4ab4-a510-78512058d0db tempest-GroupsTest-1276407125 None] Flow 'volume_create_manager' (ec6eccb9-b08f-4b5f-a57e-7fbb737a7b67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:50:27 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-455c9f57-8f06-4ab4-a510-78512058d0db tempest-GroupsTest-1276407125 None] Created volume successfully. Jul 31 10:50:28 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c2e4650-d125-4446-917a-a3140b1f426b tempest-VolumesGetTest-2086150122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:50:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2c2e4650-d125-4446-917a-a3140b1f426b tempest-VolumesGetTest-2086150122 None] Flow 'volume_create_manager' (a977b837-d979-4d78-b8fd-777c6e603113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:50:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2c2e4650-d125-4446-917a-a3140b1f426b tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6201a82b-051a-43cf-ad56-73e281f902d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:28 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:DELETE=12,cinder:UPDATE=150,cinder:SELECT=115,cinder:INSERT=34 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:50:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2c2e4650-d125-4446-917a-a3140b1f426b tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6201a82b-051a-43cf-ad56-73e281f902d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:50:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2124632478',display_name='tempest-VolumesGetTest-Volume-1463619608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e83b3c96-bd42-4214-b952-e45ac8ebe69f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e83d68bd1e841808f4c9cbc3d39ac25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:50:28Z,use_quota=True,user_id='d8850379515d4edbb49086c958167c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2c2e4650-d125-4446-917a-a3140b1f426b tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dd1e2cc-5f27-4189-9583-42b4c871c981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2c2e4650-d125-4446-917a-a3140b1f426b tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dd1e2cc-5f27-4189-9583-42b4c871c981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2c2e4650-d125-4446-917a-a3140b1f426b tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4def058-28f8-4787-903a-36aa2167d7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2c2e4650-d125-4446-917a-a3140b1f426b tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4def058-28f8-4787-903a-36aa2167d7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e83b3c96-bd42-4214-b952-e45ac8ebe69f', 'volume_name': 'volume-e83b3c96-bd42-4214-b952-e45ac8ebe69f', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2c2e4650-d125-4446-917a-a3140b1f426b tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ca4a1f2-14c4-4e5b-881d-9b3f9cedaf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2c2e4650-d125-4446-917a-a3140b1f426b tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ca4a1f2-14c4-4e5b-881d-9b3f9cedaf79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2c2e4650-d125-4446-917a-a3140b1f426b tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9ef4dc6-e7d0-43af-8c89-71e3c87185b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:28 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-2c2e4650-d125-4446-917a-a3140b1f426b tempest-VolumesGetTest-2086150122 None] Volume e83b3c96-bd42-4214-b952-e45ac8ebe69f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e83b3c96-bd42-4214-b952-e45ac8ebe69f', 'volume_size': 1} Jul 31 10:50:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2c2e4650-d125-4446-917a-a3140b1f426b tempest-VolumesGetTest-2086150122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2c2e4650-d125-4446-917a-a3140b1f426b tempest-VolumesGetTest-2086150122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:28 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2c2e4650-d125-4446-917a-a3140b1f426b tempest-VolumesGetTest-2086150122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:50:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2124632478',display_name='tempest-VolumesGetTest-Volume-1463619608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e83b3c96-bd42-4214-b952-e45ac8ebe69f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e83d68bd1e841808f4c9cbc3d39ac25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:50:28Z,use_quota=True,user_id='d8850379515d4edbb49086c958167c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:50:28 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-2c2e4650-d125-4446-917a-a3140b1f426b tempest-VolumesGetTest-2086150122 None] Creating volume e83b3c96-bd42-4214-b952-e45ac8ebe69f {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:50:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2c2e4650-d125-4446-917a-a3140b1f426b tempest-VolumesGetTest-2086150122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2c2e4650-d125-4446-917a-a3140b1f426b tempest-VolumesGetTest-2086150122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:28 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2c2e4650-d125-4446-917a-a3140b1f426b tempest-VolumesGetTest-2086150122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:50:28 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2c2e4650-d125-4446-917a-a3140b1f426b tempest-VolumesGetTest-2086150122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:50:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2c2e4650-d125-4446-917a-a3140b1f426b tempest-VolumesGetTest-2086150122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:28 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2c2e4650-d125-4446-917a-a3140b1f426b tempest-VolumesGetTest-2086150122 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:50:28 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-2c2e4650-d125-4446-917a-a3140b1f426b tempest-VolumesGetTest-2086150122 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:50:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2c2e4650-d125-4446-917a-a3140b1f426b tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e83b3c96-bd42-4214-b952-e45ac8ebe69f 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:28 devstack sudo[100611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e83b3c96-bd42-4214-b952-e45ac8ebe69f 1073741824 Jul 31 10:50:28 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:28 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=113,cinder:UPDATE=132,cinder:INSERT=33,cinder:DELETE=12 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:50:28 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-53e7a9ee-68f7-40f1-aeb0-f81808db25c0 tempest-GroupsTest-1276407125 None] Update group completed successfully. Jul 31 10:50:29 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2c2e4650-d125-4446-917a-a3140b1f426b tempest-VolumesGetTest-2086150122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e83b3c96-bd42-4214-b952-e45ac8ebe69f 1073741824" returned: 0 in 0.804s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2c2e4650-d125-4446-917a-a3140b1f426b tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e83b3c96-bd42-4214-b952-e45ac8ebe69f {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:29 devstack sudo[100617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e83b3c96-bd42-4214-b952-e45ac8ebe69f Jul 31 10:50:29 devstack sudo[100617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:29 devstack sudo[100617]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2c2e4650-d125-4446-917a-a3140b1f426b tempest-VolumesGetTest-2086150122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e83b3c96-bd42-4214-b952-e45ac8ebe69f" returned: 0 in 0.350s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:29 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2c2e4650-d125-4446-917a-a3140b1f426b tempest-VolumesGetTest-2086150122 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:50:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2c2e4650-d125-4446-917a-a3140b1f426b tempest-VolumesGetTest-2086150122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2c2e4650-d125-4446-917a-a3140b1f426b tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9ef4dc6-e7d0-43af-8c89-71e3c87185b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e83b3c96-bd42-4214-b952-e45ac8ebe69f', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2c2e4650-d125-4446-917a-a3140b1f426b tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (246abf77-8333-44b5-9cde-ea1f1cbea9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:29 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-2c2e4650-d125-4446-917a-a3140b1f426b tempest-VolumesGetTest-2086150122 None] Volume volume-e83b3c96-bd42-4214-b952-e45ac8ebe69f (e83b3c96-bd42-4214-b952-e45ac8ebe69f): created successfully Jul 31 10:50:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2c2e4650-d125-4446-917a-a3140b1f426b tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (246abf77-8333-44b5-9cde-ea1f1cbea9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2c2e4650-d125-4446-917a-a3140b1f426b tempest-VolumesGetTest-2086150122 None] Flow 'volume_create_manager' (a977b837-d979-4d78-b8fd-777c6e603113) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:50:29 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-2c2e4650-d125-4446-917a-a3140b1f426b tempest-VolumesGetTest-2086150122 None] Created volume successfully. Jul 31 10:50:30 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-60d04cf4-dd74-41a7-bdbe-9311268ddd73 tempest-GroupsTest-1276407125 None] Update group completed successfully. Jul 31 10:50:30 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-94cfc4c0-c690-4439-a7ff-9efdde0fda2f tempest-VolumesGetTest-2086150122 None] Acquiring lock "cinder-e83b3c96-bd42-4214-b952-e45ac8ebe69f-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:50:30 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-94cfc4c0-c690-4439-a7ff-9efdde0fda2f tempest-VolumesGetTest-2086150122 None] Lock "cinder-e83b3c96-bd42-4214-b952-e45ac8ebe69f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:50:30 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-94cfc4c0-c690-4439-a7ff-9efdde0fda2f tempest-VolumesGetTest-2086150122 None] Acquiring lock "cinder-quobyte-e83b3c96-bd42-4214-b952-e45ac8ebe69f" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:50:30 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-94cfc4c0-c690-4439-a7ff-9efdde0fda2f tempest-VolumesGetTest-2086150122 None] Lock "cinder-quobyte-e83b3c96-bd42-4214-b952-e45ac8ebe69f" acquired by "delete_volume" :: waited 0.020s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:50:30 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9aa5c2-d499-4dc9-9b2d-c274e7f50c6b]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:50:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-94cfc4c0-c690-4439-a7ff-9efdde0fda2f tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e83b3c96-bd42-4214-b952-e45ac8ebe69f {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:30 devstack sudo[100622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e83b3c96-bd42-4214-b952-e45ac8ebe69f Jul 31 10:50:30 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:31 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-94cfc4c0-c690-4439-a7ff-9efdde0fda2f tempest-VolumesGetTest-2086150122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e83b3c96-bd42-4214-b952-e45ac8ebe69f" returned: 0 in 0.541s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-94cfc4c0-c690-4439-a7ff-9efdde0fda2f tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e83b3c96-bd42-4214-b952-e45ac8ebe69f {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:31 devstack sudo[100627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e83b3c96-bd42-4214-b952-e45ac8ebe69f Jul 31 10:50:31 devstack sudo[100627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:31 devstack sudo[100627]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-94cfc4c0-c690-4439-a7ff-9efdde0fda2f tempest-VolumesGetTest-2086150122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e83b3c96-bd42-4214-b952-e45ac8ebe69f" returned: 0 in 0.386s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:31 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-94cfc4c0-c690-4439-a7ff-9efdde0fda2f tempest-VolumesGetTest-2086150122 None] Lock "cinder-quobyte-e83b3c96-bd42-4214-b952-e45ac8ebe69f" released by "delete_volume" :: held 0.997s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:50:31 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-94cfc4c0-c690-4439-a7ff-9efdde0fda2f tempest-VolumesGetTest-2086150122 None] Created reservations ['1ac46a98-46a6-482e-91a8-f2feb05fb874', 'a073d0a8-2ff6-41c3-9c67-801f8ce85481', 'd8e520a7-1bf0-412b-9a8e-a2f7781648bd', 'db27b239-41ad-4feb-b8ec-b8eb738df486'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:50:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-94cfc4c0-c690-4439-a7ff-9efdde0fda2f tempest-VolumesGetTest-2086150122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-94cfc4c0-c690-4439-a7ff-9efdde0fda2f tempest-VolumesGetTest-2086150122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:31 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-94cfc4c0-c690-4439-a7ff-9efdde0fda2f tempest-VolumesGetTest-2086150122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:50:32 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-94cfc4c0-c690-4439-a7ff-9efdde0fda2f tempest-VolumesGetTest-2086150122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:50:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-94cfc4c0-c690-4439-a7ff-9efdde0fda2f tempest-VolumesGetTest-2086150122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-94cfc4c0-c690-4439-a7ff-9efdde0fda2f tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:32 devstack sudo[100633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:50:32 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:32 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2320ff66-2740-4e7b-9b28-a93d802dc9dd tempest-GroupsTest-1276407125 None] Acquiring lock "cinder-quobyte-a0441cfd-8a1f-4d0a-bcff-c9e381858dd9" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:50:32 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2320ff66-2740-4e7b-9b28-a93d802dc9dd tempest-GroupsTest-1276407125 None] Lock "cinder-quobyte-a0441cfd-8a1f-4d0a-bcff-c9e381858dd9" acquired by "delete_volume" :: waited 0.030s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:50:32 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[50989b6c-9ca3-49d0-aaee-02bf80c9249d]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:50:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2320ff66-2740-4e7b-9b28-a93d802dc9dd tempest-GroupsTest-1276407125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a0441cfd-8a1f-4d0a-bcff-c9e381858dd9 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:32 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-77a1c3dd-d456-493d-ad54-223cc2dc6aae req-eb6f2ae5-f558-4997-be08-94eea9664354 tempest-TestServerVolumeAttachmentScenario-666866145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-77a1c3dd-d456-493d-ad54-223cc2dc6aae req-eb6f2ae5-f558-4997-be08-94eea9664354 tempest-TestServerVolumeAttachmentScenario-666866145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:32 devstack sudo[100643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a0441cfd-8a1f-4d0a-bcff-c9e381858dd9 Jul 31 10:50:32 devstack sudo[100643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-94cfc4c0-c690-4439-a7ff-9efdde0fda2f tempest-VolumesGetTest-2086150122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.422s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:32 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-94cfc4c0-c690-4439-a7ff-9efdde0fda2f tempest-VolumesGetTest-2086150122 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:50:32 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-94cfc4c0-c690-4439-a7ff-9efdde0fda2f tempest-VolumesGetTest-2086150122 None] Deleted volume successfully. Jul 31 10:50:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-77a1c3dd-d456-493d-ad54-223cc2dc6aae req-eb6f2ae5-f558-4997-be08-94eea9664354 tempest-TestServerVolumeAttachmentScenario-666866145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:32 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-94cfc4c0-c690-4439-a7ff-9efdde0fda2f tempest-VolumesGetTest-2086150122 None] Lock "cinder-e83b3c96-bd42-4214-b952-e45ac8ebe69f-delete_volume" released by "delete_volume" :: held 1.828s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:50:32 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-77a1c3dd-d456-493d-ad54-223cc2dc6aae req-eb6f2ae5-f558-4997-be08-94eea9664354 tempest-TestServerVolumeAttachmentScenario-666866145 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c', 'name': 'volume-5f47e99a-7f41-47b5-b27d-0fb7b9bea336', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a8ffc260-14b2-4060-9e31-65f45b86cf16', 'enforce_multipath': True} {{(pid=89090) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:50:32 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-77a1c3dd-d456-493d-ad54-223cc2dc6aae req-eb6f2ae5-f558-4997-be08-94eea9664354 tempest-TestServerVolumeAttachmentScenario-666866145 None] attachment_update completed successfully. Jul 31 10:50:32 devstack sudo[100643]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2320ff66-2740-4e7b-9b28-a93d802dc9dd tempest-GroupsTest-1276407125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a0441cfd-8a1f-4d0a-bcff-c9e381858dd9" returned: 0 in 0.612s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2320ff66-2740-4e7b-9b28-a93d802dc9dd tempest-GroupsTest-1276407125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a0441cfd-8a1f-4d0a-bcff-c9e381858dd9 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:32 devstack sudo[100712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a0441cfd-8a1f-4d0a-bcff-c9e381858dd9 Jul 31 10:50:32 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:33 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d7ea13ca-22fe-490b-9054-4af28122f58b tempest-VolumesGetTest-2086150122 None] Acquiring lock "cinder-6d2f5313-4bc1-4b43-a815-160485feace4-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:50:33 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d7ea13ca-22fe-490b-9054-4af28122f58b tempest-VolumesGetTest-2086150122 None] Lock "cinder-6d2f5313-4bc1-4b43-a815-160485feace4-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:50:33 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d7ea13ca-22fe-490b-9054-4af28122f58b tempest-VolumesGetTest-2086150122 None] Acquiring lock "cinder-quobyte-6d2f5313-4bc1-4b43-a815-160485feace4" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:50:33 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d7ea13ca-22fe-490b-9054-4af28122f58b tempest-VolumesGetTest-2086150122 None] Lock "cinder-quobyte-6d2f5313-4bc1-4b43-a815-160485feace4" acquired by "delete_volume" :: waited 0.023s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:50:33 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e21a49-6a7e-4b28-aa70-826ca5047825]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:50:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d7ea13ca-22fe-490b-9054-4af28122f58b tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6d2f5313-4bc1-4b43-a815-160485feace4 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:33 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2320ff66-2740-4e7b-9b28-a93d802dc9dd tempest-GroupsTest-1276407125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a0441cfd-8a1f-4d0a-bcff-c9e381858dd9" returned: 0 in 0.460s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:33 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2320ff66-2740-4e7b-9b28-a93d802dc9dd tempest-GroupsTest-1276407125 None] Lock "cinder-quobyte-a0441cfd-8a1f-4d0a-bcff-c9e381858dd9" released by "delete_volume" :: held 1.168s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:50:33 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2320ff66-2740-4e7b-9b28-a93d802dc9dd tempest-GroupsTest-1276407125 None] Acquiring lock "cinder-quobyte-bcef5ab3-682e-4c6d-8f77-a4eb71df4543" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:50:33 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2320ff66-2740-4e7b-9b28-a93d802dc9dd tempest-GroupsTest-1276407125 None] Lock "cinder-quobyte-bcef5ab3-682e-4c6d-8f77-a4eb71df4543" acquired by "delete_volume" :: waited 0.031s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:50:33 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb366893-b581-4c38-ad62-a010d38b0559]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:50:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2320ff66-2740-4e7b-9b28-a93d802dc9dd tempest-GroupsTest-1276407125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bcef5ab3-682e-4c6d-8f77-a4eb71df4543 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:33 devstack sudo[101036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6d2f5313-4bc1-4b43-a815-160485feace4 Jul 31 10:50:33 devstack sudo[101036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:33 devstack sudo[101039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bcef5ab3-682e-4c6d-8f77-a4eb71df4543 Jul 31 10:50:33 devstack sudo[101039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:33 devstack sudo[101036]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d7ea13ca-22fe-490b-9054-4af28122f58b tempest-VolumesGetTest-2086150122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6d2f5313-4bc1-4b43-a815-160485feace4" returned: 0 in 0.582s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d7ea13ca-22fe-490b-9054-4af28122f58b tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6d2f5313-4bc1-4b43-a815-160485feace4 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:33 devstack sudo[101046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6d2f5313-4bc1-4b43-a815-160485feace4 Jul 31 10:50:33 devstack sudo[101046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:33 devstack sudo[101039]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2320ff66-2740-4e7b-9b28-a93d802dc9dd tempest-GroupsTest-1276407125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bcef5ab3-682e-4c6d-8f77-a4eb71df4543" returned: 0 in 0.547s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2320ff66-2740-4e7b-9b28-a93d802dc9dd tempest-GroupsTest-1276407125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bcef5ab3-682e-4c6d-8f77-a4eb71df4543 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:34 devstack sudo[101051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bcef5ab3-682e-4c6d-8f77-a4eb71df4543 Jul 31 10:50:34 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:34 devstack sudo[101046]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d7ea13ca-22fe-490b-9054-4af28122f58b tempest-VolumesGetTest-2086150122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6d2f5313-4bc1-4b43-a815-160485feace4" returned: 0 in 0.351s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:34 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d7ea13ca-22fe-490b-9054-4af28122f58b tempest-VolumesGetTest-2086150122 None] Lock "cinder-quobyte-6d2f5313-4bc1-4b43-a815-160485feace4" released by "delete_volume" :: held 1.022s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:50:34 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-d7ea13ca-22fe-490b-9054-4af28122f58b tempest-VolumesGetTest-2086150122 None] Created reservations ['e7784da1-c241-4e2b-82d9-54d3f09228d2', 'c4bcb04b-8638-476c-b9d0-d37ae2bf0668', '8a1deb4e-e64c-47fa-a145-d5edb7527940', 'd674d098-0f9f-40f4-9c60-1fdcb5cf8fa4'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:50:34 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2320ff66-2740-4e7b-9b28-a93d802dc9dd tempest-GroupsTest-1276407125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-bcef5ab3-682e-4c6d-8f77-a4eb71df4543" returned: 0 in 0.399s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:34 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2320ff66-2740-4e7b-9b28-a93d802dc9dd tempest-GroupsTest-1276407125 None] Lock "cinder-quobyte-bcef5ab3-682e-4c6d-8f77-a4eb71df4543" released by "delete_volume" :: held 1.020s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:50:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d7ea13ca-22fe-490b-9054-4af28122f58b tempest-VolumesGetTest-2086150122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d7ea13ca-22fe-490b-9054-4af28122f58b tempest-VolumesGetTest-2086150122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:34 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d7ea13ca-22fe-490b-9054-4af28122f58b tempest-VolumesGetTest-2086150122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:50:34 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d7ea13ca-22fe-490b-9054-4af28122f58b tempest-VolumesGetTest-2086150122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:50:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d7ea13ca-22fe-490b-9054-4af28122f58b tempest-VolumesGetTest-2086150122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d7ea13ca-22fe-490b-9054-4af28122f58b tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:34 devstack sudo[101055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:50:34 devstack sudo[101055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:34 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-2320ff66-2740-4e7b-9b28-a93d802dc9dd tempest-GroupsTest-1276407125 None] Created reservations ['edb714f3-7bbb-4b36-83ee-eadef7424bb8'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:50:34 devstack cinder-volume[89090]: WARNING cinder.quota [None req-2320ff66-2740-4e7b-9b28-a93d802dc9dd tempest-GroupsTest-1276407125 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1250576568 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1250576568, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:50:34 devstack cinder-volume[89090]: WARNING cinder.quota [None req-2320ff66-2740-4e7b-9b28-a93d802dc9dd tempest-GroupsTest-1276407125 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1250576568 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1250576568, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:50:34 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-2320ff66-2740-4e7b-9b28-a93d802dc9dd tempest-GroupsTest-1276407125 None] Created reservations ['36cfac74-9078-4e91-8832-7afa3ebf2dde', 'c900b8c9-8d24-42a8-8773-bce62b0b1b23', 'f356730c-29c4-44c9-b0a3-11bbf6264051', 'f556d6e6-7d61-4e90-85d3-c82a02ac04ec'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:50:34 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-2320ff66-2740-4e7b-9b28-a93d802dc9dd tempest-GroupsTest-1276407125 None] Created reservations ['32efb1bd-8e92-4998-9325-c7e0efe8aaf4', '067c6084-5df0-44c8-aa09-5a5647a42c5c', 'e9cc7549-e57f-4acc-8bfa-9a153549d41a', '0f11a366-f9fe-4bb6-847f-9ef1080e0048'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:50:34 devstack sudo[101055]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d7ea13ca-22fe-490b-9054-4af28122f58b tempest-VolumesGetTest-2086150122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.470s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:34 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-d7ea13ca-22fe-490b-9054-4af28122f58b tempest-VolumesGetTest-2086150122 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:50:34 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-d7ea13ca-22fe-490b-9054-4af28122f58b tempest-VolumesGetTest-2086150122 None] Deleted volume successfully. Jul 31 10:50:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2320ff66-2740-4e7b-9b28-a93d802dc9dd tempest-GroupsTest-1276407125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2320ff66-2740-4e7b-9b28-a93d802dc9dd tempest-GroupsTest-1276407125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:35 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2320ff66-2740-4e7b-9b28-a93d802dc9dd tempest-GroupsTest-1276407125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:50:35 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2320ff66-2740-4e7b-9b28-a93d802dc9dd tempest-GroupsTest-1276407125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:50:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2320ff66-2740-4e7b-9b28-a93d802dc9dd tempest-GroupsTest-1276407125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2320ff66-2740-4e7b-9b28-a93d802dc9dd tempest-GroupsTest-1276407125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:35 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d7ea13ca-22fe-490b-9054-4af28122f58b tempest-VolumesGetTest-2086150122 None] Lock "cinder-6d2f5313-4bc1-4b43-a815-160485feace4-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:50:35 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:50:35 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:35 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2320ff66-2740-4e7b-9b28-a93d802dc9dd tempest-GroupsTest-1276407125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.380s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:35 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-2320ff66-2740-4e7b-9b28-a93d802dc9dd tempest-GroupsTest-1276407125 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:50:35 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-2320ff66-2740-4e7b-9b28-a93d802dc9dd tempest-GroupsTest-1276407125 None] Delete group completed successfully. Jul 31 10:50:35 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9474cccc-22a9-46ab-a42a-9638ae027096 tempest-VolumesGetTest-2086150122 None] Acquiring lock "cinder-d775dd6a-0634-44ab-bcdb-32961adc4cb4-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:50:35 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9474cccc-22a9-46ab-a42a-9638ae027096 tempest-VolumesGetTest-2086150122 None] Lock "cinder-d775dd6a-0634-44ab-bcdb-32961adc4cb4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:50:35 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9474cccc-22a9-46ab-a42a-9638ae027096 tempest-VolumesGetTest-2086150122 None] Acquiring lock "cinder-quobyte-d775dd6a-0634-44ab-bcdb-32961adc4cb4" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:50:35 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9474cccc-22a9-46ab-a42a-9638ae027096 tempest-VolumesGetTest-2086150122 None] Lock "cinder-quobyte-d775dd6a-0634-44ab-bcdb-32961adc4cb4" acquired by "delete_volume" :: waited 0.028s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:50:35 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3abc4e6-18f4-45d3-af96-0ca6f155f7f6]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:50:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9474cccc-22a9-46ab-a42a-9638ae027096 tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:35 devstack sudo[101062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4 Jul 31 10:50:35 devstack sudo[101062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:36 devstack sudo[101062]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9474cccc-22a9-46ab-a42a-9638ae027096 tempest-VolumesGetTest-2086150122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4" returned: 0 in 0.529s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9474cccc-22a9-46ab-a42a-9638ae027096 tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:36 devstack sudo[101067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4 Jul 31 10:50:36 devstack sudo[101067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:36 devstack sudo[101067]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9474cccc-22a9-46ab-a42a-9638ae027096 tempest-VolumesGetTest-2086150122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d775dd6a-0634-44ab-bcdb-32961adc4cb4" returned: 0 in 0.366s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:36 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9474cccc-22a9-46ab-a42a-9638ae027096 tempest-VolumesGetTest-2086150122 None] Lock "cinder-quobyte-d775dd6a-0634-44ab-bcdb-32961adc4cb4" released by "delete_volume" :: held 0.979s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:50:36 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-9474cccc-22a9-46ab-a42a-9638ae027096 tempest-VolumesGetTest-2086150122 None] Created reservations ['1da4c5ad-8b2d-4f94-ade2-62fd209742b4', '81c11ae2-4303-4891-8e65-bc6570ba2163', 'dfd7b334-9c41-4482-9473-76924ec512bd', 'eaf32e92-df96-4dfa-9c91-79534f0c9a9d'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:50:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9474cccc-22a9-46ab-a42a-9638ae027096 tempest-VolumesGetTest-2086150122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9474cccc-22a9-46ab-a42a-9638ae027096 tempest-VolumesGetTest-2086150122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:36 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-9474cccc-22a9-46ab-a42a-9638ae027096 tempest-VolumesGetTest-2086150122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:50:36 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-9474cccc-22a9-46ab-a42a-9638ae027096 tempest-VolumesGetTest-2086150122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:50:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9474cccc-22a9-46ab-a42a-9638ae027096 tempest-VolumesGetTest-2086150122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9474cccc-22a9-46ab-a42a-9638ae027096 tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:36 devstack sudo[101072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:50:36 devstack sudo[101072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:37 devstack sudo[101072]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9474cccc-22a9-46ab-a42a-9638ae027096 tempest-VolumesGetTest-2086150122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.370s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:37 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-9474cccc-22a9-46ab-a42a-9638ae027096 tempest-VolumesGetTest-2086150122 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:50:37 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-9474cccc-22a9-46ab-a42a-9638ae027096 tempest-VolumesGetTest-2086150122 None] Deleted volume successfully. Jul 31 10:50:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9474cccc-22a9-46ab-a42a-9638ae027096 tempest-VolumesGetTest-2086150122 None] Lock "cinder-d775dd6a-0634-44ab-bcdb-32961adc4cb4-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:50:39 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:50:39 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Flow 'volume_create_manager' (01373ac1-20ff-40ba-aef6-5bb89b677b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:50:39 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dffd564e-65ba-4068-944e-56ee87029da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:39 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dffd564e-65ba-4068-944e-56ee87029da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1496934944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57c096b8-19f4-4fe1-8e93-660ded33f0eb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5e83d68bd1e841808f4c9cbc3d39ac25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:50:39Z,use_quota=True,user_id='d8850379515d4edbb49086c958167c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:39 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce0351b3-6bc8-4c38-a39c-c1e1bedd24ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:39 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce0351b3-6bc8-4c38-a39c-c1e1bedd24ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:39 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c0987b5-407f-419d-99aa-2caa44ac4006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:39 devstack cinder-volume[89090]: DEBUG cinder.image.glance [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Creating Keystone auth plugin from conf {{(pid=89090) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 10:50:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-bc680aca-5443-450b-8014-fa250f55ef17 req-abc7254f-462f-4e0e-a05b-69ce95128036 tempest-TestServerVolumeAttachmentScenario-666866145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-bc680aca-5443-450b-8014-fa250f55ef17 req-abc7254f-462f-4e0e-a05b-69ce95128036 tempest-TestServerVolumeAttachmentScenario-666866145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-bc680aca-5443-450b-8014-fa250f55ef17 req-abc7254f-462f-4e0e-a05b-69ce95128036 tempest-TestServerVolumeAttachmentScenario-666866145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:39 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-bc680aca-5443-450b-8014-fa250f55ef17 req-abc7254f-462f-4e0e-a05b-69ce95128036 tempest-TestServerVolumeAttachmentScenario-666866145 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c', 'name': 'volume-1341c917-f7a8-4cfd-8ae9-1295d879381e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fbb0b457-4d30-4bf6-9152-91619d09ef0c', 'enforce_multipath': True} {{(pid=89090) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:50:39 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-bc680aca-5443-450b-8014-fa250f55ef17 req-abc7254f-462f-4e0e-a05b-69ce95128036 tempest-TestServerVolumeAttachmentScenario-666866145 None] attachment_update completed successfully. Jul 31 10:50:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c0987b5-407f-419d-99aa-2caa44ac4006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '57c096b8-19f4-4fe1-8e93-660ded33f0eb', 'volume_name': 'volume-57c096b8-19f4-4fe1-8e93-660ded33f0eb', 'volume_size': 1, 'image_id': 'b429196b-9072-49ce-b54e-9693a9fd5306', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b429196b-9072-49ce-b54e-9693a9fd5306', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c7e7a60bc5b640caa5ec5fc5df1bd573', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b429196b-9072-49ce-b54e-9693a9fd5306', 'created_at': datetime.datetime(2026, 7, 31, 8, 33, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 33, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b429196b-9072-49ce-b54e-9693a9fd5306/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4a6ed94-617d-40f8-bbbe-b27c09b28920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4a6ed94-617d-40f8-bbbe-b27c09b28920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c520fde8-5bc7-43d4-9a7e-729be65fef23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:40 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Volume 57c096b8-19f4-4fe1-8e93-660ded33f0eb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-57c096b8-19f4-4fe1-8e93-660ded33f0eb', 'volume_size': 1, 'image_id': 'b429196b-9072-49ce-b54e-9693a9fd5306', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b429196b-9072-49ce-b54e-9693a9fd5306', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c7e7a60bc5b640caa5ec5fc5df1bd573', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b429196b-9072-49ce-b54e-9693a9fd5306', 'created_at': datetime.datetime(2026, 7, 31, 8, 33, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 33, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b429196b-9072-49ce-b54e-9693a9fd5306/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 31 10:50:40 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Trying to clone 57c096b8-19f4-4fe1-8e93-660ded33f0eb from image b429196b-9072-49ce-b54e-9693a9fd5306 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b429196b-9072-49ce-b54e-9693a9fd5306', 'metadata': {}}]). {{(pid=89090) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 10:50:40 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_576hl458devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89090) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 10:50:40 devstack cinder-volume[89090]: INFO cinder.image.image_utils [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Image download 20.69 MB at 20.69 MB/s Jul 31 10:50:40 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e56e6f9-5dcb-4a88-9f8b-bf198b2714d0]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:50:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_576hl458devstack@QuobyteHD {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:40 devstack sudo[101094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_576hl458devstack@QuobyteHD Jul 31 10:50:40 devstack sudo[101094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:41 devstack sudo[101094]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_576hl458devstack@QuobyteHD" returned: 0 in 0.482s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:41 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Temporary image b429196b-9072-49ce-b54e-9693a9fd5306 is fetched for user d8850379515d4edbb49086c958167c7b. {{(pid=89090) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 10:50:41 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53335e0-f900-41a1-a122-d88e080b3b83]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:50:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_576hl458devstack@QuobyteHD {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:41 devstack sudo[101100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_576hl458devstack@QuobyteHD Jul 31 10:50:41 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:41 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_576hl458devstack@QuobyteHD" returned: 0 in 0.415s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:41 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1496934944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57c096b8-19f4-4fe1-8e93-660ded33f0eb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5e83d68bd1e841808f4c9cbc3d39ac25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:50:39Z,use_quota=True,user_id='d8850379515d4edbb49086c958167c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:50:41 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Creating volume 57c096b8-19f4-4fe1-8e93-660ded33f0eb {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:50:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:41 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:50:41 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:50:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:41 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:50:41 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:50:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-57c096b8-19f4-4fe1-8e93-660ded33f0eb 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:41 devstack sudo[101105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-57c096b8-19f4-4fe1-8e93-660ded33f0eb 1073741824 Jul 31 10:50:41 devstack sudo[101105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:42 devstack sudo[101105]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-57c096b8-19f4-4fe1-8e93-660ded33f0eb 1073741824" returned: 0 in 0.913s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-57c096b8-19f4-4fe1-8e93-660ded33f0eb {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:42 devstack sudo[101111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-57c096b8-19f4-4fe1-8e93-660ded33f0eb Jul 31 10:50:42 devstack sudo[101111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:43 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-eea28d9b-0709-4960-a4e7-13d1cc378405 req-6c6ff6f7-ddc9-43e1-be36-af5a8234d852 tempest-TestServerVolumeAttachmentScenario-666866145 None] Terminate volume connection completed successfully. Jul 31 10:50:43 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-eea28d9b-0709-4960-a4e7-13d1cc378405 req-6c6ff6f7-ddc9-43e1-be36-af5a8234d852 tempest-TestServerVolumeAttachmentScenario-666866145 None] Deleting attachment fbb0b457-4d30-4bf6-9152-91619d09ef0c. {{(pid=89090) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:50:43 devstack sudo[101111]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-57c096b8-19f4-4fe1-8e93-660ded33f0eb" returned: 0 in 0.423s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:43 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] <== create_volume: return (1425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:50:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.429s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:43 devstack cinder-volume[89090]: DEBUG cinder.volume.volume_utils [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Attempting download of b429196b-9072-49ce-b54e-9693a9fd5306 ((None, [{'url': 'file:///opt/stack/data/glance/images/b429196b-9072-49ce-b54e-9693a9fd5306', 'metadata': {}}])) to volume 57c096b8-19f4-4fe1-8e93-660ded33f0eb. {{(pid=89090) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 10:50:43 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96d0d08-0ed1-4a59-a583-c7f06fe80021]: (4, 'raw') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:50:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b429196b-9072-49ce-b54e-9693a9fd5306_efvm30pe {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:43 devstack sudo[101118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b429196b-9072-49ce-b54e-9693a9fd5306_efvm30pe Jul 31 10:50:43 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:43 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b429196b-9072-49ce-b54e-9693a9fd5306_efvm30pe" returned: 0 in 0.449s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b429196b-9072-49ce-b54e-9693a9fd5306_efvm30pe {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:43 devstack sudo[101122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b429196b-9072-49ce-b54e-9693a9fd5306_efvm30pe Jul 31 10:50:43 devstack sudo[101122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:44 devstack sudo[101122]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b429196b-9072-49ce-b54e-9693a9fd5306_efvm30pe" returned: 1 in 0.485s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b429196b-9072-49ce-b54e-9693a9fd5306_efvm30pe' failed. Not Retrying. {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 10:50:44 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02b63a8-a25b-461c-b31b-352368a48ee1]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:50:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_576hl458devstack@QuobyteHD {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:44 devstack sudo[101126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_576hl458devstack@QuobyteHD Jul 31 10:50:44 devstack sudo[101126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:44 devstack sudo[101126]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_576hl458devstack@QuobyteHD" returned: 0 in 0.470s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:44 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] b429196b-9072-49ce-b54e-9693a9fd5306 was qcow2, converting to qcow2 {{(pid=89090) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 10:50:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_576hl458devstack@QuobyteHD /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-57c096b8-19f4-4fe1-8e93-660ded33f0eb {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:44 devstack sudo[101135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_576hl458devstack@QuobyteHD /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-57c096b8-19f4-4fe1-8e93-660ded33f0eb Jul 31 10:50:44 devstack sudo[101135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:44 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-0d69f21b-c75d-407b-b683-c908173eb63c tempest-GroupsV320Test-73141790 None] Group tempest-GroupsV320Test-Group-724117975: creating Jul 31 10:50:44 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-0d69f21b-c75d-407b-b683-c908173eb63c tempest-GroupsV320Test-73141790 None] Group tempest-GroupsV320Test-Group-724117975: created successfully Jul 31 10:50:44 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-0d69f21b-c75d-407b-b683-c908173eb63c tempest-GroupsV320Test-73141790 None] Create group completed successfully. Jul 31 10:50:45 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-ad70397a-daf5-4a9e-b7d2-6cbec8930d48 req-2e88695b-7e7a-4a45-8f7f-b56b3bd04d46 tempest-TestServerVolumeAttachmentScenario-666866145 None] Terminate volume connection completed successfully. Jul 31 10:50:45 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-ad70397a-daf5-4a9e-b7d2-6cbec8930d48 req-2e88695b-7e7a-4a45-8f7f-b56b3bd04d46 tempest-TestServerVolumeAttachmentScenario-666866145 None] Deleting attachment a8ffc260-14b2-4060-9e31-65f45b86cf16. {{(pid=89090) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:50:45 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:50:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:50:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:50:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:45 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:50:46 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:46 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.530s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:46 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:50:46 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager._thread_info {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:50:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread count: 28 {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:50:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread info: [<_MainThread(MainThread, started 134005426110592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:50:47 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-8c05c917-7f7f-4ff6-8df4-aba1f1dbda38 tempest-GroupsV320Test-73141790 None] Created reservations ['3b1e159c-809f-45b4-bf34-f7de472115e4'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:50:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8c05c917-7f7f-4ff6-8df4-aba1f1dbda38 tempest-GroupsV320Test-73141790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8c05c917-7f7f-4ff6-8df4-aba1f1dbda38 tempest-GroupsV320Test-73141790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:47 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-8c05c917-7f7f-4ff6-8df4-aba1f1dbda38 tempest-GroupsV320Test-73141790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:50:47 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-8c05c917-7f7f-4ff6-8df4-aba1f1dbda38 tempest-GroupsV320Test-73141790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:50:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8c05c917-7f7f-4ff6-8df4-aba1f1dbda38 tempest-GroupsV320Test-73141790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8c05c917-7f7f-4ff6-8df4-aba1f1dbda38 tempest-GroupsV320Test-73141790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:47 devstack sudo[101197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:50:47 devstack sudo[101197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:47 devstack sudo[101197]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8c05c917-7f7f-4ff6-8df4-aba1f1dbda38 tempest-GroupsV320Test-73141790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.376s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:47 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-8c05c917-7f7f-4ff6-8df4-aba1f1dbda38 tempest-GroupsV320Test-73141790 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:50:47 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-8c05c917-7f7f-4ff6-8df4-aba1f1dbda38 tempest-GroupsV320Test-73141790 None] Delete group completed successfully. Jul 31 10:50:47 devstack sudo[101135]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_576hl458devstack@QuobyteHD /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-57c096b8-19f4-4fe1-8e93-660ded33f0eb" returned: 0 in 3.111s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:47 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_576hl458devstack@QuobyteHD, size 112.00 MB, duration 3.11 sec, destination /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-57c096b8-19f4-4fe1-8e93-660ded33f0eb {{(pid=89090) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 10:50:47 devstack cinder-volume[89090]: INFO cinder.image.image_utils [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Converted 112.00 MB image at 35.99 MB/s Jul 31 10:50:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-57c096b8-19f4-4fe1-8e93-660ded33f0eb 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:47 devstack sudo[101201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-57c096b8-19f4-4fe1-8e93-660ded33f0eb 1G Jul 31 10:50:47 devstack sudo[101201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:48 devstack sudo[101201]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-57c096b8-19f4-4fe1-8e93-660ded33f0eb 1G" returned: 0 in 0.488s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:48 devstack cinder-volume[89090]: DEBUG cinder.volume.volume_utils [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Downloaded image b429196b-9072-49ce-b54e-9693a9fd5306 ((None, [{'url': 'file:///opt/stack/data/glance/images/b429196b-9072-49ce-b54e-9693a9fd5306', 'metadata': {}}])) to volume 57c096b8-19f4-4fe1-8e93-660ded33f0eb successfully. {{(pid=89090) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 10:50:48 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Temporary image b429196b-9072-49ce-b54e-9693a9fd5306 for user d8850379515d4edbb49086c958167c7b is deleted. {{(pid=89090) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 10:50:48 devstack cinder-volume[89090]: DEBUG cinder.volume.volume_utils [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Marking volume 57c096b8-19f4-4fe1-8e93-660ded33f0eb as bootable. {{(pid=89090) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 10:50:48 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Copying metadata from image b429196b-9072-49ce-b54e-9693a9fd5306 to 57c096b8-19f4-4fe1-8e93-660ded33f0eb. {{(pid=89090) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 10:50:48 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Creating volume glance metadata for volume 57c096b8-19f4-4fe1-8e93-660ded33f0eb backed by image b429196b-9072-49ce-b54e-9693a9fd5306 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b429196b-9072-49ce-b54e-9693a9fd5306', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89090) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 10:50:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c520fde8-5bc7-43d4-9a7e-729be65fef23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57c096b8-19f4-4fe1-8e93-660ded33f0eb', 'volume_size': 1, 'image_id': 'b429196b-9072-49ce-b54e-9693a9fd5306', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b429196b-9072-49ce-b54e-9693a9fd5306', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c7e7a60bc5b640caa5ec5fc5df1bd573', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b429196b-9072-49ce-b54e-9693a9fd5306', 'created_at': datetime.datetime(2026, 7, 31, 8, 33, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 33, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b429196b-9072-49ce-b54e-9693a9fd5306/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (233b6edd-27cc-433c-be09-158344cabd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:48 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Volume volume-57c096b8-19f4-4fe1-8e93-660ded33f0eb (57c096b8-19f4-4fe1-8e93-660ded33f0eb): created successfully Jul 31 10:50:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (233b6edd-27cc-433c-be09-158344cabd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Flow 'volume_create_manager' (01373ac1-20ff-40ba-aef6-5bb89b677b05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:50:48 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-9a639d21-1843-47c6-a35e-c7c0281c4001 tempest-VolumesGetTest-2086150122 None] Created volume successfully. Jul 31 10:50:50 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c51101e-f0ba-4c02-bb27-e55ce543c34b tempest-VolumesGetTest-2086150122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:50:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0c51101e-f0ba-4c02-bb27-e55ce543c34b tempest-VolumesGetTest-2086150122 None] Flow 'volume_create_manager' (141d0fd3-5f60-4241-be71-749a33f727a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:50:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0c51101e-f0ba-4c02-bb27-e55ce543c34b tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46566922-6d6f-4193-8259-0622ee9f4c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0c51101e-f0ba-4c02-bb27-e55ce543c34b tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46566922-6d6f-4193-8259-0622ee9f4c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:50:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1891670395',display_name='tempest-VolumesGetTest-Volume-1414783709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a37111f7-40bd-44cb-ba4f-6f4615a794f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e83d68bd1e841808f4c9cbc3d39ac25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:50:50Z,use_quota=True,user_id='d8850379515d4edbb49086c958167c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0c51101e-f0ba-4c02-bb27-e55ce543c34b tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92fd7eba-4e21-4f13-ade2-f860eb96000b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0c51101e-f0ba-4c02-bb27-e55ce543c34b tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92fd7eba-4e21-4f13-ade2-f860eb96000b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0c51101e-f0ba-4c02-bb27-e55ce543c34b tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85beafe8-007f-4a95-b386-9e1ad022e657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0c51101e-f0ba-4c02-bb27-e55ce543c34b tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85beafe8-007f-4a95-b386-9e1ad022e657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a37111f7-40bd-44cb-ba4f-6f4615a794f0', 'volume_name': 'volume-a37111f7-40bd-44cb-ba4f-6f4615a794f0', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0c51101e-f0ba-4c02-bb27-e55ce543c34b tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41b820bd-8ea1-4ba2-ad31-e7ab4199ade2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0c51101e-f0ba-4c02-bb27-e55ce543c34b tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41b820bd-8ea1-4ba2-ad31-e7ab4199ade2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0c51101e-f0ba-4c02-bb27-e55ce543c34b tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7fae678-392c-48db-8537-f7212fec8ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:50 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-0c51101e-f0ba-4c02-bb27-e55ce543c34b tempest-VolumesGetTest-2086150122 None] Volume a37111f7-40bd-44cb-ba4f-6f4615a794f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a37111f7-40bd-44cb-ba4f-6f4615a794f0', 'volume_size': 1} Jul 31 10:50:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0c51101e-f0ba-4c02-bb27-e55ce543c34b tempest-VolumesGetTest-2086150122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0c51101e-f0ba-4c02-bb27-e55ce543c34b tempest-VolumesGetTest-2086150122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:50 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0c51101e-f0ba-4c02-bb27-e55ce543c34b tempest-VolumesGetTest-2086150122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:50:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1891670395',display_name='tempest-VolumesGetTest-Volume-1414783709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a37111f7-40bd-44cb-ba4f-6f4615a794f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e83d68bd1e841808f4c9cbc3d39ac25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:50:50Z,use_quota=True,user_id='d8850379515d4edbb49086c958167c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:50:50 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-0c51101e-f0ba-4c02-bb27-e55ce543c34b tempest-VolumesGetTest-2086150122 None] Creating volume a37111f7-40bd-44cb-ba4f-6f4615a794f0 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:50:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0c51101e-f0ba-4c02-bb27-e55ce543c34b tempest-VolumesGetTest-2086150122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0c51101e-f0ba-4c02-bb27-e55ce543c34b tempest-VolumesGetTest-2086150122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:50 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0c51101e-f0ba-4c02-bb27-e55ce543c34b tempest-VolumesGetTest-2086150122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:50:50 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0c51101e-f0ba-4c02-bb27-e55ce543c34b tempest-VolumesGetTest-2086150122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:50:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0c51101e-f0ba-4c02-bb27-e55ce543c34b tempest-VolumesGetTest-2086150122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:50 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0c51101e-f0ba-4c02-bb27-e55ce543c34b tempest-VolumesGetTest-2086150122 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:50:50 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-0c51101e-f0ba-4c02-bb27-e55ce543c34b tempest-VolumesGetTest-2086150122 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:50:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0c51101e-f0ba-4c02-bb27-e55ce543c34b tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a37111f7-40bd-44cb-ba4f-6f4615a794f0 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:50 devstack sudo[101209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a37111f7-40bd-44cb-ba4f-6f4615a794f0 1073741824 Jul 31 10:50:50 devstack sudo[101209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:51 devstack sudo[101209]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0c51101e-f0ba-4c02-bb27-e55ce543c34b tempest-VolumesGetTest-2086150122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a37111f7-40bd-44cb-ba4f-6f4615a794f0 1073741824" returned: 0 in 0.623s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0c51101e-f0ba-4c02-bb27-e55ce543c34b tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a37111f7-40bd-44cb-ba4f-6f4615a794f0 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:51 devstack sudo[101215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a37111f7-40bd-44cb-ba4f-6f4615a794f0 Jul 31 10:50:51 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:51 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0c51101e-f0ba-4c02-bb27-e55ce543c34b tempest-VolumesGetTest-2086150122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a37111f7-40bd-44cb-ba4f-6f4615a794f0" returned: 0 in 0.411s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:51 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0c51101e-f0ba-4c02-bb27-e55ce543c34b tempest-VolumesGetTest-2086150122 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:50:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0c51101e-f0ba-4c02-bb27-e55ce543c34b tempest-VolumesGetTest-2086150122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0c51101e-f0ba-4c02-bb27-e55ce543c34b tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7fae678-392c-48db-8537-f7212fec8ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a37111f7-40bd-44cb-ba4f-6f4615a794f0', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0c51101e-f0ba-4c02-bb27-e55ce543c34b tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df497619-708c-419d-a518-abbfef76adc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:51 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-0c51101e-f0ba-4c02-bb27-e55ce543c34b tempest-VolumesGetTest-2086150122 None] Volume volume-a37111f7-40bd-44cb-ba4f-6f4615a794f0 (a37111f7-40bd-44cb-ba4f-6f4615a794f0): created successfully Jul 31 10:50:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0c51101e-f0ba-4c02-bb27-e55ce543c34b tempest-VolumesGetTest-2086150122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df497619-708c-419d-a518-abbfef76adc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0c51101e-f0ba-4c02-bb27-e55ce543c34b tempest-VolumesGetTest-2086150122 None] Flow 'volume_create_manager' (141d0fd3-5f60-4241-be71-749a33f727a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:50:51 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-0c51101e-f0ba-4c02-bb27-e55ce543c34b tempest-VolumesGetTest-2086150122 None] Created volume successfully. Jul 31 10:50:52 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-3819cacd-31c1-44f1-bc61-2bd13ff3cc1c tempest-TestServerVolumeAttachmentScenario-666866145 None] Acquiring lock "cinder-1341c917-f7a8-4cfd-8ae9-1295d879381e-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:50:52 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-3819cacd-31c1-44f1-bc61-2bd13ff3cc1c tempest-TestServerVolumeAttachmentScenario-666866145 None] Lock "cinder-1341c917-f7a8-4cfd-8ae9-1295d879381e-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:50:52 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-3819cacd-31c1-44f1-bc61-2bd13ff3cc1c tempest-TestServerVolumeAttachmentScenario-666866145 None] Acquiring lock "cinder-quobyte-1341c917-f7a8-4cfd-8ae9-1295d879381e" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:50:52 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-3819cacd-31c1-44f1-bc61-2bd13ff3cc1c tempest-TestServerVolumeAttachmentScenario-666866145 None] Lock "cinder-quobyte-1341c917-f7a8-4cfd-8ae9-1295d879381e" acquired by "delete_volume" :: waited 0.034s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:50:52 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a76c60b-7ca1-4bb4-84b3-c374c27bd83f]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:50:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3819cacd-31c1-44f1-bc61-2bd13ff3cc1c tempest-TestServerVolumeAttachmentScenario-666866145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1341c917-f7a8-4cfd-8ae9-1295d879381e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:52 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6b4292b7-8ef0-4671-8802-fe228d618215 tempest-VolumesGetTest-2086150122 None] Acquiring lock "cinder-a37111f7-40bd-44cb-ba4f-6f4615a794f0-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:50:52 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6b4292b7-8ef0-4671-8802-fe228d618215 tempest-VolumesGetTest-2086150122 None] Lock "cinder-a37111f7-40bd-44cb-ba4f-6f4615a794f0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:50:52 devstack sudo[101218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1341c917-f7a8-4cfd-8ae9-1295d879381e Jul 31 10:50:52 devstack sudo[101218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:52 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6b4292b7-8ef0-4671-8802-fe228d618215 tempest-VolumesGetTest-2086150122 None] Acquiring lock "cinder-quobyte-a37111f7-40bd-44cb-ba4f-6f4615a794f0" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:50:52 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6b4292b7-8ef0-4671-8802-fe228d618215 tempest-VolumesGetTest-2086150122 None] Lock "cinder-quobyte-a37111f7-40bd-44cb-ba4f-6f4615a794f0" acquired by "delete_volume" :: waited 0.022s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:50:52 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f56caf-4a9b-4ca9-b702-c8dfb0587297]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:50:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6b4292b7-8ef0-4671-8802-fe228d618215 tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a37111f7-40bd-44cb-ba4f-6f4615a794f0 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:52 devstack sudo[101220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a37111f7-40bd-44cb-ba4f-6f4615a794f0 Jul 31 10:50:52 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:53 devstack sudo[101218]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3819cacd-31c1-44f1-bc61-2bd13ff3cc1c tempest-TestServerVolumeAttachmentScenario-666866145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1341c917-f7a8-4cfd-8ae9-1295d879381e" returned: 0 in 0.658s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3819cacd-31c1-44f1-bc61-2bd13ff3cc1c tempest-TestServerVolumeAttachmentScenario-666866145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1341c917-f7a8-4cfd-8ae9-1295d879381e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:53 devstack sudo[101225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1341c917-f7a8-4cfd-8ae9-1295d879381e Jul 31 10:50:53 devstack sudo[101225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:53 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6b4292b7-8ef0-4671-8802-fe228d618215 tempest-VolumesGetTest-2086150122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a37111f7-40bd-44cb-ba4f-6f4615a794f0" returned: 0 in 0.498s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6b4292b7-8ef0-4671-8802-fe228d618215 tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a37111f7-40bd-44cb-ba4f-6f4615a794f0 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:53 devstack sudo[101230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a37111f7-40bd-44cb-ba4f-6f4615a794f0 Jul 31 10:50:53 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:53 devstack sudo[101225]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3819cacd-31c1-44f1-bc61-2bd13ff3cc1c tempest-TestServerVolumeAttachmentScenario-666866145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1341c917-f7a8-4cfd-8ae9-1295d879381e" returned: 0 in 0.403s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:53 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-3819cacd-31c1-44f1-bc61-2bd13ff3cc1c tempest-TestServerVolumeAttachmentScenario-666866145 None] Lock "cinder-quobyte-1341c917-f7a8-4cfd-8ae9-1295d879381e" released by "delete_volume" :: held 1.168s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:50:53 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6b4292b7-8ef0-4671-8802-fe228d618215 tempest-VolumesGetTest-2086150122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a37111f7-40bd-44cb-ba4f-6f4615a794f0" returned: 0 in 0.346s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:53 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-3819cacd-31c1-44f1-bc61-2bd13ff3cc1c tempest-TestServerVolumeAttachmentScenario-666866145 None] Created reservations ['0b0f26c0-b0e9-4a6b-a817-113420e72721', '627d5f13-a5b7-4812-8ebf-3ccd15367b80', '36c03c4b-e10b-46d0-af86-081409437a8d', '21fbfd1c-dd4f-442e-890f-c1a7ef4dbe5d'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:50:53 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6b4292b7-8ef0-4671-8802-fe228d618215 tempest-VolumesGetTest-2086150122 None] Lock "cinder-quobyte-a37111f7-40bd-44cb-ba4f-6f4615a794f0" released by "delete_volume" :: held 0.910s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:50:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3819cacd-31c1-44f1-bc61-2bd13ff3cc1c tempest-TestServerVolumeAttachmentScenario-666866145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3819cacd-31c1-44f1-bc61-2bd13ff3cc1c tempest-TestServerVolumeAttachmentScenario-666866145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:53 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-3819cacd-31c1-44f1-bc61-2bd13ff3cc1c tempest-TestServerVolumeAttachmentScenario-666866145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:50:53 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-3819cacd-31c1-44f1-bc61-2bd13ff3cc1c tempest-TestServerVolumeAttachmentScenario-666866145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:50:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3819cacd-31c1-44f1-bc61-2bd13ff3cc1c tempest-TestServerVolumeAttachmentScenario-666866145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3819cacd-31c1-44f1-bc61-2bd13ff3cc1c tempest-TestServerVolumeAttachmentScenario-666866145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:53 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-6b4292b7-8ef0-4671-8802-fe228d618215 tempest-VolumesGetTest-2086150122 None] Created reservations ['96de6fbd-884c-466d-9ad5-7bd2069562cc', '110afb44-b05f-4e8d-a256-a79c7b01a3b0', 'c9933f86-e9b2-4444-a8c7-eeb4202fd71b', '685f5839-15ce-4e81-9c19-ea9499d08828'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:50:53 devstack sudo[101234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:50:53 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6b4292b7-8ef0-4671-8802-fe228d618215 tempest-VolumesGetTest-2086150122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6b4292b7-8ef0-4671-8802-fe228d618215 tempest-VolumesGetTest-2086150122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:53 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-6b4292b7-8ef0-4671-8802-fe228d618215 tempest-VolumesGetTest-2086150122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:50:53 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-6b4292b7-8ef0-4671-8802-fe228d618215 tempest-VolumesGetTest-2086150122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:50:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6b4292b7-8ef0-4671-8802-fe228d618215 tempest-VolumesGetTest-2086150122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6b4292b7-8ef0-4671-8802-fe228d618215 tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:53 devstack sudo[101236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:50:53 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:54 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3819cacd-31c1-44f1-bc61-2bd13ff3cc1c tempest-TestServerVolumeAttachmentScenario-666866145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.428s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:54 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-3819cacd-31c1-44f1-bc61-2bd13ff3cc1c tempest-TestServerVolumeAttachmentScenario-666866145 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:50:54 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-3819cacd-31c1-44f1-bc61-2bd13ff3cc1c tempest-TestServerVolumeAttachmentScenario-666866145 None] Deleted volume successfully. Jul 31 10:50:54 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-3819cacd-31c1-44f1-bc61-2bd13ff3cc1c tempest-TestServerVolumeAttachmentScenario-666866145 None] Lock "cinder-1341c917-f7a8-4cfd-8ae9-1295d879381e-delete_volume" released by "delete_volume" :: held 2.001s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:50:54 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6b4292b7-8ef0-4671-8802-fe228d618215 tempest-VolumesGetTest-2086150122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.412s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:54 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-6b4292b7-8ef0-4671-8802-fe228d618215 tempest-VolumesGetTest-2086150122 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:50:54 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-6b4292b7-8ef0-4671-8802-fe228d618215 tempest-VolumesGetTest-2086150122 None] Deleted volume successfully. Jul 31 10:50:54 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6b4292b7-8ef0-4671-8802-fe228d618215 tempest-VolumesGetTest-2086150122 None] Lock "cinder-a37111f7-40bd-44cb-ba4f-6f4615a794f0-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:50:54 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-93cf3750-3871-4b53-8169-657b416bfb2e tempest-TestServerVolumeAttachmentScenario-666866145 None] Acquiring lock "cinder-5f47e99a-7f41-47b5-b27d-0fb7b9bea336-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:50:54 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-93cf3750-3871-4b53-8169-657b416bfb2e tempest-TestServerVolumeAttachmentScenario-666866145 None] Lock "cinder-5f47e99a-7f41-47b5-b27d-0fb7b9bea336-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:50:54 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-93cf3750-3871-4b53-8169-657b416bfb2e tempest-TestServerVolumeAttachmentScenario-666866145 None] Acquiring lock "cinder-quobyte-5f47e99a-7f41-47b5-b27d-0fb7b9bea336" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:50:54 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-93cf3750-3871-4b53-8169-657b416bfb2e tempest-TestServerVolumeAttachmentScenario-666866145 None] Lock "cinder-quobyte-5f47e99a-7f41-47b5-b27d-0fb7b9bea336" acquired by "delete_volume" :: waited 0.023s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:50:54 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[af312dc7-b596-4b4a-84fe-6325a7d532e0]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:50:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-93cf3750-3871-4b53-8169-657b416bfb2e tempest-TestServerVolumeAttachmentScenario-666866145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5f47e99a-7f41-47b5-b27d-0fb7b9bea336 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:54 devstack sudo[101240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5f47e99a-7f41-47b5-b27d-0fb7b9bea336 Jul 31 10:50:54 devstack sudo[101240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:55 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-eb8a9b9e-67f0-4ea4-88e4-e4dd75f299df tempest-VolumesGetTest-2086150122 None] Acquiring lock "cinder-57c096b8-19f4-4fe1-8e93-660ded33f0eb-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:50:55 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-eb8a9b9e-67f0-4ea4-88e4-e4dd75f299df tempest-VolumesGetTest-2086150122 None] Lock "cinder-57c096b8-19f4-4fe1-8e93-660ded33f0eb-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:50:55 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-eb8a9b9e-67f0-4ea4-88e4-e4dd75f299df tempest-VolumesGetTest-2086150122 None] Acquiring lock "cinder-quobyte-57c096b8-19f4-4fe1-8e93-660ded33f0eb" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:50:55 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-eb8a9b9e-67f0-4ea4-88e4-e4dd75f299df tempest-VolumesGetTest-2086150122 None] Lock "cinder-quobyte-57c096b8-19f4-4fe1-8e93-660ded33f0eb" acquired by "delete_volume" :: waited 0.033s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:50:55 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[6005b6af-33ec-4e96-bf43-ab7de8180e95]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:50:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-eb8a9b9e-67f0-4ea4-88e4-e4dd75f299df tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-57c096b8-19f4-4fe1-8e93-660ded33f0eb {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:55 devstack sudo[101240]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-93cf3750-3871-4b53-8169-657b416bfb2e tempest-TestServerVolumeAttachmentScenario-666866145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5f47e99a-7f41-47b5-b27d-0fb7b9bea336" returned: 0 in 0.648s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-93cf3750-3871-4b53-8169-657b416bfb2e tempest-TestServerVolumeAttachmentScenario-666866145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5f47e99a-7f41-47b5-b27d-0fb7b9bea336 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:55 devstack sudo[101246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5f47e99a-7f41-47b5-b27d-0fb7b9bea336 Jul 31 10:50:55 devstack sudo[101246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:55 devstack sudo[101245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-57c096b8-19f4-4fe1-8e93-660ded33f0eb Jul 31 10:50:55 devstack sudo[101245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:55 devstack sudo[101246]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-93cf3750-3871-4b53-8169-657b416bfb2e tempest-TestServerVolumeAttachmentScenario-666866145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5f47e99a-7f41-47b5-b27d-0fb7b9bea336" returned: 0 in 0.383s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:55 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-93cf3750-3871-4b53-8169-657b416bfb2e tempest-TestServerVolumeAttachmentScenario-666866145 None] Lock "cinder-quobyte-5f47e99a-7f41-47b5-b27d-0fb7b9bea336" released by "delete_volume" :: held 1.107s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:50:55 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-93cf3750-3871-4b53-8169-657b416bfb2e tempest-TestServerVolumeAttachmentScenario-666866145 None] Created reservations ['a409edb1-9c93-4522-9850-2cbb09cc9cb3', '589e1853-c685-474b-8fb6-91ec6087a747', 'd90ee6c5-aa62-4623-8bc2-0a2784be68d0', '99c87dda-110a-44bc-872d-70e050d1dc02'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:50:55 devstack sudo[101245]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-eb8a9b9e-67f0-4ea4-88e4-e4dd75f299df tempest-VolumesGetTest-2086150122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-57c096b8-19f4-4fe1-8e93-660ded33f0eb" returned: 0 in 0.649s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-eb8a9b9e-67f0-4ea4-88e4-e4dd75f299df tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-57c096b8-19f4-4fe1-8e93-660ded33f0eb {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:55 devstack sudo[101254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-57c096b8-19f4-4fe1-8e93-660ded33f0eb Jul 31 10:50:55 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-93cf3750-3871-4b53-8169-657b416bfb2e tempest-TestServerVolumeAttachmentScenario-666866145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-93cf3750-3871-4b53-8169-657b416bfb2e tempest-TestServerVolumeAttachmentScenario-666866145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:55 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-93cf3750-3871-4b53-8169-657b416bfb2e tempest-TestServerVolumeAttachmentScenario-666866145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:50:56 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-93cf3750-3871-4b53-8169-657b416bfb2e tempest-TestServerVolumeAttachmentScenario-666866145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:50:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-93cf3750-3871-4b53-8169-657b416bfb2e tempest-TestServerVolumeAttachmentScenario-666866145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-93cf3750-3871-4b53-8169-657b416bfb2e tempest-TestServerVolumeAttachmentScenario-666866145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:56 devstack sudo[101256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:50:56 devstack sudo[101256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:56 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-eb8a9b9e-67f0-4ea4-88e4-e4dd75f299df tempest-VolumesGetTest-2086150122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-57c096b8-19f4-4fe1-8e93-660ded33f0eb" returned: 0 in 0.393s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:56 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-eb8a9b9e-67f0-4ea4-88e4-e4dd75f299df tempest-VolumesGetTest-2086150122 None] Lock "cinder-quobyte-57c096b8-19f4-4fe1-8e93-660ded33f0eb" released by "delete_volume" :: held 1.109s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:50:56 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-eb8a9b9e-67f0-4ea4-88e4-e4dd75f299df tempest-VolumesGetTest-2086150122 None] Created reservations ['de920d3a-7751-40e5-b9c2-e6568be94b0f', 'b4e8deb7-3d53-4ef4-9550-5355a0c34464', '42685cbe-4a61-4194-8ef7-0d7fa03474ac', '43186ffd-2fb4-4ac5-879f-27fc9f15a432'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:50:56 devstack sudo[101256]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-93cf3750-3871-4b53-8169-657b416bfb2e tempest-TestServerVolumeAttachmentScenario-666866145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.409s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:56 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-93cf3750-3871-4b53-8169-657b416bfb2e tempest-TestServerVolumeAttachmentScenario-666866145 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:50:56 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-93cf3750-3871-4b53-8169-657b416bfb2e tempest-TestServerVolumeAttachmentScenario-666866145 None] Deleted volume successfully. Jul 31 10:50:56 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-93cf3750-3871-4b53-8169-657b416bfb2e tempest-TestServerVolumeAttachmentScenario-666866145 None] Lock "cinder-5f47e99a-7f41-47b5-b27d-0fb7b9bea336-delete_volume" released by "delete_volume" :: held 1.901s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:50:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-eb8a9b9e-67f0-4ea4-88e4-e4dd75f299df tempest-VolumesGetTest-2086150122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-eb8a9b9e-67f0-4ea4-88e4-e4dd75f299df tempest-VolumesGetTest-2086150122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:56 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-eb8a9b9e-67f0-4ea4-88e4-e4dd75f299df tempest-VolumesGetTest-2086150122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:50:56 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-eb8a9b9e-67f0-4ea4-88e4-e4dd75f299df tempest-VolumesGetTest-2086150122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:50:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-eb8a9b9e-67f0-4ea4-88e4-e4dd75f299df tempest-VolumesGetTest-2086150122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-eb8a9b9e-67f0-4ea4-88e4-e4dd75f299df tempest-VolumesGetTest-2086150122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:56 devstack sudo[101260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:50:56 devstack sudo[101260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:56 devstack sudo[101260]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-eb8a9b9e-67f0-4ea4-88e4-e4dd75f299df tempest-VolumesGetTest-2086150122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.360s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:56 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-eb8a9b9e-67f0-4ea4-88e4-e4dd75f299df tempest-VolumesGetTest-2086150122 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:50:56 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-eb8a9b9e-67f0-4ea4-88e4-e4dd75f299df tempest-VolumesGetTest-2086150122 None] Deleted volume successfully. Jul 31 10:50:56 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-eb8a9b9e-67f0-4ea4-88e4-e4dd75f299df tempest-VolumesGetTest-2086150122 None] Lock "cinder-57c096b8-19f4-4fe1-8e93-660ded33f0eb-delete_volume" released by "delete_volume" :: held 1.862s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:50:57 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-87fe49dc-74d2-43b4-9ab3-74cc381f32dc tempest-TestStampPattern-862817097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:50:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-87fe49dc-74d2-43b4-9ab3-74cc381f32dc tempest-TestStampPattern-862817097 None] Flow 'volume_create_manager' (11a3d002-477d-426b-82bb-3f6dff1b8f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:50:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-87fe49dc-74d2-43b4-9ab3-74cc381f32dc tempest-TestStampPattern-862817097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2da73561-e28a-4be5-ad99-6105751a506f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-87fe49dc-74d2-43b4-9ab3-74cc381f32dc tempest-TestStampPattern-862817097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2da73561-e28a-4be5-ad99-6105751a506f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1227680045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd9a48ef-b8f0-44b8-b07e-dde0069cc670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afa88751cdf94cfe98cb502548e491fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:50:57Z,use_quota=True,user_id='ab6d51c6def14ae8869826b5ff5432d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-87fe49dc-74d2-43b4-9ab3-74cc381f32dc tempest-TestStampPattern-862817097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1ce2a9e-16db-486c-bba0-f8c4c158dda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-87fe49dc-74d2-43b4-9ab3-74cc381f32dc tempest-TestStampPattern-862817097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1ce2a9e-16db-486c-bba0-f8c4c158dda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-87fe49dc-74d2-43b4-9ab3-74cc381f32dc tempest-TestStampPattern-862817097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e64314eb-585d-40d3-826d-24e0e1be7df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-87fe49dc-74d2-43b4-9ab3-74cc381f32dc tempest-TestStampPattern-862817097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e64314eb-585d-40d3-826d-24e0e1be7df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd9a48ef-b8f0-44b8-b07e-dde0069cc670', 'volume_name': 'volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-87fe49dc-74d2-43b4-9ab3-74cc381f32dc tempest-TestStampPattern-862817097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a791e91-58c1-44f4-b64f-9b67bf24e842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-87fe49dc-74d2-43b4-9ab3-74cc381f32dc tempest-TestStampPattern-862817097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a791e91-58c1-44f4-b64f-9b67bf24e842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-87fe49dc-74d2-43b4-9ab3-74cc381f32dc tempest-TestStampPattern-862817097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c98e54ca-1062-433d-90f9-f4956d2573f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:57 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-87fe49dc-74d2-43b4-9ab3-74cc381f32dc tempest-TestStampPattern-862817097 None] Volume fd9a48ef-b8f0-44b8-b07e-dde0069cc670: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670', 'volume_size': 1} Jul 31 10:50:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-87fe49dc-74d2-43b4-9ab3-74cc381f32dc tempest-TestStampPattern-862817097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-87fe49dc-74d2-43b4-9ab3-74cc381f32dc tempest-TestStampPattern-862817097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:57 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-87fe49dc-74d2-43b4-9ab3-74cc381f32dc tempest-TestStampPattern-862817097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1227680045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd9a48ef-b8f0-44b8-b07e-dde0069cc670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afa88751cdf94cfe98cb502548e491fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:50:57Z,use_quota=True,user_id='ab6d51c6def14ae8869826b5ff5432d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:50:57 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-87fe49dc-74d2-43b4-9ab3-74cc381f32dc tempest-TestStampPattern-862817097 None] Creating volume fd9a48ef-b8f0-44b8-b07e-dde0069cc670 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:50:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-87fe49dc-74d2-43b4-9ab3-74cc381f32dc tempest-TestStampPattern-862817097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-87fe49dc-74d2-43b4-9ab3-74cc381f32dc tempest-TestStampPattern-862817097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:57 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-87fe49dc-74d2-43b4-9ab3-74cc381f32dc tempest-TestStampPattern-862817097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:50:57 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-87fe49dc-74d2-43b4-9ab3-74cc381f32dc tempest-TestStampPattern-862817097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:50:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-87fe49dc-74d2-43b4-9ab3-74cc381f32dc tempest-TestStampPattern-862817097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:57 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-87fe49dc-74d2-43b4-9ab3-74cc381f32dc tempest-TestStampPattern-862817097 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:50:57 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-87fe49dc-74d2-43b4-9ab3-74cc381f32dc tempest-TestStampPattern-862817097 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:50:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-87fe49dc-74d2-43b4-9ab3-74cc381f32dc tempest-TestStampPattern-862817097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:57 devstack sudo[101263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670 1073741824 Jul 31 10:50:57 devstack sudo[101263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:58 devstack sudo[101263]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-87fe49dc-74d2-43b4-9ab3-74cc381f32dc tempest-TestStampPattern-862817097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670 1073741824" returned: 0 in 0.716s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-87fe49dc-74d2-43b4-9ab3-74cc381f32dc tempest-TestStampPattern-862817097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:58 devstack sudo[101274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670 Jul 31 10:50:58 devstack sudo[101274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:58 devstack sudo[101274]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-87fe49dc-74d2-43b4-9ab3-74cc381f32dc tempest-TestStampPattern-862817097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670" returned: 0 in 0.349s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:58 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-87fe49dc-74d2-43b4-9ab3-74cc381f32dc tempest-TestStampPattern-862817097 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:50:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-87fe49dc-74d2-43b4-9ab3-74cc381f32dc tempest-TestStampPattern-862817097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-87fe49dc-74d2-43b4-9ab3-74cc381f32dc tempest-TestStampPattern-862817097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c98e54ca-1062-433d-90f9-f4956d2573f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-87fe49dc-74d2-43b4-9ab3-74cc381f32dc tempest-TestStampPattern-862817097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9184e3c0-75ee-4517-b86e-de61bbd5ab7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:58 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-87fe49dc-74d2-43b4-9ab3-74cc381f32dc tempest-TestStampPattern-862817097 None] Volume volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670 (fd9a48ef-b8f0-44b8-b07e-dde0069cc670): created successfully Jul 31 10:50:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-87fe49dc-74d2-43b4-9ab3-74cc381f32dc tempest-TestStampPattern-862817097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9184e3c0-75ee-4517-b86e-de61bbd5ab7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-87fe49dc-74d2-43b4-9ab3-74cc381f32dc tempest-TestStampPattern-862817097 None] Flow 'volume_create_manager' (11a3d002-477d-426b-82bb-3f6dff1b8f2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:50:58 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-87fe49dc-74d2-43b4-9ab3-74cc381f32dc tempest-TestStampPattern-862817097 None] Created volume successfully. Jul 31 10:51:00 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e59e287-93f6-49ba-b5f3-5baf364b49bc tempest-VolumeQuotasAdminTestJSON-685363903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:51:00 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4e59e287-93f6-49ba-b5f3-5baf364b49bc tempest-VolumeQuotasAdminTestJSON-685363903 None] Flow 'volume_create_manager' (a8966464-c590-4d72-b18e-f2356bcb5e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:51:00 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4e59e287-93f6-49ba-b5f3-5baf364b49bc tempest-VolumeQuotasAdminTestJSON-685363903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f03987b-13e6-4d0b-9ae0-68a24fc25519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:00 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4e59e287-93f6-49ba-b5f3-5baf364b49bc tempest-VolumeQuotasAdminTestJSON-685363903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f03987b-13e6-4d0b-9ae0-68a24fc25519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1425539178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b34c7aaf-1ca4-4000-aa6d-c6e98ad9227d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5e8e94d8a547ac9523eb00e2269965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:51:00Z,use_quota=True,user_id='c253de17f90c4b95bfe7314b440fe3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:00 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4e59e287-93f6-49ba-b5f3-5baf364b49bc tempest-VolumeQuotasAdminTestJSON-685363903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (824f8b1c-51cf-4624-9a31-154271193af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:00 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4e59e287-93f6-49ba-b5f3-5baf364b49bc tempest-VolumeQuotasAdminTestJSON-685363903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (824f8b1c-51cf-4624-9a31-154271193af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:00 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4e59e287-93f6-49ba-b5f3-5baf364b49bc tempest-VolumeQuotasAdminTestJSON-685363903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40f563df-63f5-400e-8b5c-91776187f546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:00 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4e59e287-93f6-49ba-b5f3-5baf364b49bc tempest-VolumeQuotasAdminTestJSON-685363903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40f563df-63f5-400e-8b5c-91776187f546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b34c7aaf-1ca4-4000-aa6d-c6e98ad9227d', 'volume_name': 'volume-b34c7aaf-1ca4-4000-aa6d-c6e98ad9227d', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:00 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4e59e287-93f6-49ba-b5f3-5baf364b49bc tempest-VolumeQuotasAdminTestJSON-685363903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f4e8b1-a4b1-4279-9fbd-ab3c3bc028f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:00 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4e59e287-93f6-49ba-b5f3-5baf364b49bc tempest-VolumeQuotasAdminTestJSON-685363903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f4e8b1-a4b1-4279-9fbd-ab3c3bc028f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:00 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4e59e287-93f6-49ba-b5f3-5baf364b49bc tempest-VolumeQuotasAdminTestJSON-685363903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dcca411-d951-450a-92d4-fc62dce4a4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:00 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-4e59e287-93f6-49ba-b5f3-5baf364b49bc tempest-VolumeQuotasAdminTestJSON-685363903 None] Volume b34c7aaf-1ca4-4000-aa6d-c6e98ad9227d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b34c7aaf-1ca4-4000-aa6d-c6e98ad9227d', 'volume_size': 1} Jul 31 10:51:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4e59e287-93f6-49ba-b5f3-5baf364b49bc tempest-VolumeQuotasAdminTestJSON-685363903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:51:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4e59e287-93f6-49ba-b5f3-5baf364b49bc tempest-VolumeQuotasAdminTestJSON-685363903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:51:00 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4e59e287-93f6-49ba-b5f3-5baf364b49bc tempest-VolumeQuotasAdminTestJSON-685363903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1425539178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b34c7aaf-1ca4-4000-aa6d-c6e98ad9227d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5e8e94d8a547ac9523eb00e2269965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:51:00Z,use_quota=True,user_id='c253de17f90c4b95bfe7314b440fe3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:51:00 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-4e59e287-93f6-49ba-b5f3-5baf364b49bc tempest-VolumeQuotasAdminTestJSON-685363903 None] Creating volume b34c7aaf-1ca4-4000-aa6d-c6e98ad9227d {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:51:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4e59e287-93f6-49ba-b5f3-5baf364b49bc tempest-VolumeQuotasAdminTestJSON-685363903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:51:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4e59e287-93f6-49ba-b5f3-5baf364b49bc tempest-VolumeQuotasAdminTestJSON-685363903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:51:00 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4e59e287-93f6-49ba-b5f3-5baf364b49bc tempest-VolumeQuotasAdminTestJSON-685363903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:51:00 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4e59e287-93f6-49ba-b5f3-5baf364b49bc tempest-VolumeQuotasAdminTestJSON-685363903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:51:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4e59e287-93f6-49ba-b5f3-5baf364b49bc tempest-VolumeQuotasAdminTestJSON-685363903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:51:00 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4e59e287-93f6-49ba-b5f3-5baf364b49bc tempest-VolumeQuotasAdminTestJSON-685363903 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:51:00 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-4e59e287-93f6-49ba-b5f3-5baf364b49bc tempest-VolumeQuotasAdminTestJSON-685363903 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:51:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4e59e287-93f6-49ba-b5f3-5baf364b49bc tempest-VolumeQuotasAdminTestJSON-685363903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b34c7aaf-1ca4-4000-aa6d-c6e98ad9227d 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:00 devstack sudo[101281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b34c7aaf-1ca4-4000-aa6d-c6e98ad9227d 1073741824 Jul 31 10:51:00 devstack sudo[101281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:01 devstack sudo[101281]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4e59e287-93f6-49ba-b5f3-5baf364b49bc tempest-VolumeQuotasAdminTestJSON-685363903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b34c7aaf-1ca4-4000-aa6d-c6e98ad9227d 1073741824" returned: 0 in 0.745s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4e59e287-93f6-49ba-b5f3-5baf364b49bc tempest-VolumeQuotasAdminTestJSON-685363903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b34c7aaf-1ca4-4000-aa6d-c6e98ad9227d {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:01 devstack sudo[101287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b34c7aaf-1ca4-4000-aa6d-c6e98ad9227d Jul 31 10:51:01 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:02 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4e59e287-93f6-49ba-b5f3-5baf364b49bc tempest-VolumeQuotasAdminTestJSON-685363903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b34c7aaf-1ca4-4000-aa6d-c6e98ad9227d" returned: 0 in 0.659s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:02 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4e59e287-93f6-49ba-b5f3-5baf364b49bc tempest-VolumeQuotasAdminTestJSON-685363903 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:51:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4e59e287-93f6-49ba-b5f3-5baf364b49bc tempest-VolumeQuotasAdminTestJSON-685363903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:51:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4e59e287-93f6-49ba-b5f3-5baf364b49bc tempest-VolumeQuotasAdminTestJSON-685363903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dcca411-d951-450a-92d4-fc62dce4a4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b34c7aaf-1ca4-4000-aa6d-c6e98ad9227d', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4e59e287-93f6-49ba-b5f3-5baf364b49bc tempest-VolumeQuotasAdminTestJSON-685363903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2823bf72-72c3-40ca-a996-9bd5fe9e2d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:02 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-4e59e287-93f6-49ba-b5f3-5baf364b49bc tempest-VolumeQuotasAdminTestJSON-685363903 None] Volume volume-b34c7aaf-1ca4-4000-aa6d-c6e98ad9227d (b34c7aaf-1ca4-4000-aa6d-c6e98ad9227d): created successfully Jul 31 10:51:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4e59e287-93f6-49ba-b5f3-5baf364b49bc tempest-VolumeQuotasAdminTestJSON-685363903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2823bf72-72c3-40ca-a996-9bd5fe9e2d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4e59e287-93f6-49ba-b5f3-5baf364b49bc tempest-VolumeQuotasAdminTestJSON-685363903 None] Flow 'volume_create_manager' (a8966464-c590-4d72-b18e-f2356bcb5e87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:51:02 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-4e59e287-93f6-49ba-b5f3-5baf364b49bc tempest-VolumeQuotasAdminTestJSON-685363903 None] Created volume successfully. Jul 31 10:51:02 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-38b5f2c1-9918-4ce1-8eed-301c18d1c8c0 tempest-VolumeQuotasAdminTestJSON-685363903 None] Acquiring lock "cinder-b34c7aaf-1ca4-4000-aa6d-c6e98ad9227d-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:51:02 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-38b5f2c1-9918-4ce1-8eed-301c18d1c8c0 tempest-VolumeQuotasAdminTestJSON-685363903 None] Lock "cinder-b34c7aaf-1ca4-4000-aa6d-c6e98ad9227d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:51:02 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-38b5f2c1-9918-4ce1-8eed-301c18d1c8c0 tempest-VolumeQuotasAdminTestJSON-685363903 None] Acquiring lock "cinder-quobyte-b34c7aaf-1ca4-4000-aa6d-c6e98ad9227d" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:51:02 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-38b5f2c1-9918-4ce1-8eed-301c18d1c8c0 tempest-VolumeQuotasAdminTestJSON-685363903 None] Lock "cinder-quobyte-b34c7aaf-1ca4-4000-aa6d-c6e98ad9227d" acquired by "delete_volume" :: waited 0.033s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:51:02 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cddb71-7561-4522-baad-b426c09802e4]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:51:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-38b5f2c1-9918-4ce1-8eed-301c18d1c8c0 tempest-VolumeQuotasAdminTestJSON-685363903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b34c7aaf-1ca4-4000-aa6d-c6e98ad9227d {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:03 devstack sudo[101310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b34c7aaf-1ca4-4000-aa6d-c6e98ad9227d Jul 31 10:51:03 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:03 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-583739be-d000-4904-a34d-3c51161becd6 tempest-VolumesNegativeTest-879817117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:51:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-583739be-d000-4904-a34d-3c51161becd6 tempest-VolumesNegativeTest-879817117 None] Flow 'volume_create_manager' (43493704-08d5-4a6f-9f4c-bf409114ace2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:51:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-583739be-d000-4904-a34d-3c51161becd6 tempest-VolumesNegativeTest-879817117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1948623c-037c-4fb0-a0f6-eb9b9fb159c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:04 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-583739be-d000-4904-a34d-3c51161becd6 tempest-VolumesNegativeTest-879817117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1948623c-037c-4fb0-a0f6-eb9b9fb159c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-905344573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5ae72d4-23f6-4366-ba91-209914fa222c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7611b18e10aa4539920dd2bbc7ee4c4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:51:04Z,use_quota=True,user_id='9be920cfd3bc49368ad2742bb958b4d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:04 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:04 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-583739be-d000-4904-a34d-3c51161becd6 tempest-VolumesNegativeTest-879817117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88278333-a2f0-4d75-be17-2981e7147806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:04 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-583739be-d000-4904-a34d-3c51161becd6 tempest-VolumesNegativeTest-879817117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88278333-a2f0-4d75-be17-2981e7147806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:04 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-583739be-d000-4904-a34d-3c51161becd6 tempest-VolumesNegativeTest-879817117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d736c4a-168e-4262-b2d0-85703b9d43ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:04 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-583739be-d000-4904-a34d-3c51161becd6 tempest-VolumesNegativeTest-879817117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d736c4a-168e-4262-b2d0-85703b9d43ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5ae72d4-23f6-4366-ba91-209914fa222c', 'volume_name': 'volume-f5ae72d4-23f6-4366-ba91-209914fa222c', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:04 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-583739be-d000-4904-a34d-3c51161becd6 tempest-VolumesNegativeTest-879817117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (110f1f2a-5bc1-4b2c-aaf3-6747ff4aed4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:04 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-583739be-d000-4904-a34d-3c51161becd6 tempest-VolumesNegativeTest-879817117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (110f1f2a-5bc1-4b2c-aaf3-6747ff4aed4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:04 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-583739be-d000-4904-a34d-3c51161becd6 tempest-VolumesNegativeTest-879817117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9adfec9-3805-4473-8a41-72f6f7c45d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:04 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-583739be-d000-4904-a34d-3c51161becd6 tempest-VolumesNegativeTest-879817117 None] Volume f5ae72d4-23f6-4366-ba91-209914fa222c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5ae72d4-23f6-4366-ba91-209914fa222c', 'volume_size': 1} Jul 31 10:51:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-583739be-d000-4904-a34d-3c51161becd6 tempest-VolumesNegativeTest-879817117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:51:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-583739be-d000-4904-a34d-3c51161becd6 tempest-VolumesNegativeTest-879817117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:51:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-583739be-d000-4904-a34d-3c51161becd6 tempest-VolumesNegativeTest-879817117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-905344573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5ae72d4-23f6-4366-ba91-209914fa222c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7611b18e10aa4539920dd2bbc7ee4c4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:51:04Z,use_quota=True,user_id='9be920cfd3bc49368ad2742bb958b4d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:51:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-583739be-d000-4904-a34d-3c51161becd6 tempest-VolumesNegativeTest-879817117 None] Creating volume f5ae72d4-23f6-4366-ba91-209914fa222c {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:51:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-583739be-d000-4904-a34d-3c51161becd6 tempest-VolumesNegativeTest-879817117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:51:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-583739be-d000-4904-a34d-3c51161becd6 tempest-VolumesNegativeTest-879817117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:51:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-583739be-d000-4904-a34d-3c51161becd6 tempest-VolumesNegativeTest-879817117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:51:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-583739be-d000-4904-a34d-3c51161becd6 tempest-VolumesNegativeTest-879817117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:51:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-583739be-d000-4904-a34d-3c51161becd6 tempest-VolumesNegativeTest-879817117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:51:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-583739be-d000-4904-a34d-3c51161becd6 tempest-VolumesNegativeTest-879817117 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:51:04 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-583739be-d000-4904-a34d-3c51161becd6 tempest-VolumesNegativeTest-879817117 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:51:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-583739be-d000-4904-a34d-3c51161becd6 tempest-VolumesNegativeTest-879817117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5ae72d4-23f6-4366-ba91-209914fa222c 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-38b5f2c1-9918-4ce1-8eed-301c18d1c8c0 tempest-VolumeQuotasAdminTestJSON-685363903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b34c7aaf-1ca4-4000-aa6d-c6e98ad9227d" returned: 0 in 1.165s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-38b5f2c1-9918-4ce1-8eed-301c18d1c8c0 tempest-VolumeQuotasAdminTestJSON-685363903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b34c7aaf-1ca4-4000-aa6d-c6e98ad9227d {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:04 devstack sudo[101354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b34c7aaf-1ca4-4000-aa6d-c6e98ad9227d Jul 31 10:51:04 devstack sudo[101354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:04 devstack sudo[101353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5ae72d4-23f6-4366-ba91-209914fa222c 1073741824 Jul 31 10:51:04 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:04 devstack sudo[101354]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-38b5f2c1-9918-4ce1-8eed-301c18d1c8c0 tempest-VolumeQuotasAdminTestJSON-685363903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b34c7aaf-1ca4-4000-aa6d-c6e98ad9227d" returned: 0 in 0.397s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:04 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-38b5f2c1-9918-4ce1-8eed-301c18d1c8c0 tempest-VolumeQuotasAdminTestJSON-685363903 None] Lock "cinder-quobyte-b34c7aaf-1ca4-4000-aa6d-c6e98ad9227d" released by "delete_volume" :: held 1.637s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:51:04 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-38b5f2c1-9918-4ce1-8eed-301c18d1c8c0 tempest-VolumeQuotasAdminTestJSON-685363903 None] Created reservations ['774d0e15-a3f1-4536-ab94-c644d1b46a42', '6ebd90e7-d37d-4d94-8e00-ebe4e8a5ada2', '9578862f-1aee-4fca-802b-bcde197fa913', '76ceaf12-e63e-4d92-bcd4-dd0049c86772'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:51:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-38b5f2c1-9918-4ce1-8eed-301c18d1c8c0 tempest-VolumeQuotasAdminTestJSON-685363903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:51:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-38b5f2c1-9918-4ce1-8eed-301c18d1c8c0 tempest-VolumeQuotasAdminTestJSON-685363903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:51:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-38b5f2c1-9918-4ce1-8eed-301c18d1c8c0 tempest-VolumeQuotasAdminTestJSON-685363903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:51:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-38b5f2c1-9918-4ce1-8eed-301c18d1c8c0 tempest-VolumeQuotasAdminTestJSON-685363903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:51:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-38b5f2c1-9918-4ce1-8eed-301c18d1c8c0 tempest-VolumeQuotasAdminTestJSON-685363903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:51:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-38b5f2c1-9918-4ce1-8eed-301c18d1c8c0 tempest-VolumeQuotasAdminTestJSON-685363903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:04 devstack sudo[101363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:51:04 devstack sudo[101363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:05 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-583739be-d000-4904-a34d-3c51161becd6 tempest-VolumesNegativeTest-879817117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5ae72d4-23f6-4366-ba91-209914fa222c 1073741824" returned: 0 in 0.870s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-583739be-d000-4904-a34d-3c51161becd6 tempest-VolumesNegativeTest-879817117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5ae72d4-23f6-4366-ba91-209914fa222c {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:05 devstack sudo[101366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5ae72d4-23f6-4366-ba91-209914fa222c Jul 31 10:51:05 devstack sudo[101366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:05 devstack sudo[101363]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-38b5f2c1-9918-4ce1-8eed-301c18d1c8c0 tempest-VolumeQuotasAdminTestJSON-685363903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.431s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:05 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-38b5f2c1-9918-4ce1-8eed-301c18d1c8c0 tempest-VolumeQuotasAdminTestJSON-685363903 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:51:05 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-38b5f2c1-9918-4ce1-8eed-301c18d1c8c0 tempest-VolumeQuotasAdminTestJSON-685363903 None] Deleted volume successfully. Jul 31 10:51:05 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-38b5f2c1-9918-4ce1-8eed-301c18d1c8c0 tempest-VolumeQuotasAdminTestJSON-685363903 None] Lock "cinder-b34c7aaf-1ca4-4000-aa6d-c6e98ad9227d-delete_volume" released by "delete_volume" :: held 2.460s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:51:05 devstack sudo[101366]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-583739be-d000-4904-a34d-3c51161becd6 tempest-VolumesNegativeTest-879817117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5ae72d4-23f6-4366-ba91-209914fa222c" returned: 0 in 0.420s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:05 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-583739be-d000-4904-a34d-3c51161becd6 tempest-VolumesNegativeTest-879817117 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:51:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-583739be-d000-4904-a34d-3c51161becd6 tempest-VolumesNegativeTest-879817117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.411s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:51:05 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-583739be-d000-4904-a34d-3c51161becd6 tempest-VolumesNegativeTest-879817117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9adfec9-3805-4473-8a41-72f6f7c45d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5ae72d4-23f6-4366-ba91-209914fa222c', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:05 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-583739be-d000-4904-a34d-3c51161becd6 tempest-VolumesNegativeTest-879817117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a78a43c-4b29-4627-a47b-ad4041205780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:05 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-583739be-d000-4904-a34d-3c51161becd6 tempest-VolumesNegativeTest-879817117 None] Volume volume-f5ae72d4-23f6-4366-ba91-209914fa222c (f5ae72d4-23f6-4366-ba91-209914fa222c): created successfully Jul 31 10:51:05 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-583739be-d000-4904-a34d-3c51161becd6 tempest-VolumesNegativeTest-879817117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a78a43c-4b29-4627-a47b-ad4041205780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:05 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-583739be-d000-4904-a34d-3c51161becd6 tempest-VolumesNegativeTest-879817117 None] Flow 'volume_create_manager' (43493704-08d5-4a6f-9f4c-bf409114ace2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:51:05 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-583739be-d000-4904-a34d-3c51161becd6 tempest-VolumesNegativeTest-879817117 None] Created volume successfully. Jul 31 10:51:06 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3f38686-1b95-409e-9668-90cfea06f29a tempest-VolumeQuotasAdminTestJSON-685363903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:51:06 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c3f38686-1b95-409e-9668-90cfea06f29a tempest-VolumeQuotasAdminTestJSON-685363903 None] Flow 'volume_create_manager' (71b8bad8-52c2-4e82-8b20-805aef422b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:51:06 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c3f38686-1b95-409e-9668-90cfea06f29a tempest-VolumeQuotasAdminTestJSON-685363903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bdaa8b8-2c29-46f4-a862-c436853eceb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:06 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c3f38686-1b95-409e-9668-90cfea06f29a tempest-VolumeQuotasAdminTestJSON-685363903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bdaa8b8-2c29-46f4-a862-c436853eceb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-881720491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f661e98e-08ee-4d48-b8e8-9ab3b4634b25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5e8e94d8a547ac9523eb00e2269965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:51:06Z,use_quota=True,user_id='c253de17f90c4b95bfe7314b440fe3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:06 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c3f38686-1b95-409e-9668-90cfea06f29a tempest-VolumeQuotasAdminTestJSON-685363903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e418e34-3d64-4d19-97c1-e83e3d1fedff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:06 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c3f38686-1b95-409e-9668-90cfea06f29a tempest-VolumeQuotasAdminTestJSON-685363903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e418e34-3d64-4d19-97c1-e83e3d1fedff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:06 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c3f38686-1b95-409e-9668-90cfea06f29a tempest-VolumeQuotasAdminTestJSON-685363903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4924478-5e8a-4a83-bc77-e65b801b385a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:06 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c3f38686-1b95-409e-9668-90cfea06f29a tempest-VolumeQuotasAdminTestJSON-685363903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4924478-5e8a-4a83-bc77-e65b801b385a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f661e98e-08ee-4d48-b8e8-9ab3b4634b25', 'volume_name': 'volume-f661e98e-08ee-4d48-b8e8-9ab3b4634b25', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:06 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c3f38686-1b95-409e-9668-90cfea06f29a tempest-VolumeQuotasAdminTestJSON-685363903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02f295f3-9333-4d75-815c-21ed13ee0bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:06 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c3f38686-1b95-409e-9668-90cfea06f29a tempest-VolumeQuotasAdminTestJSON-685363903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02f295f3-9333-4d75-815c-21ed13ee0bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:06 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c3f38686-1b95-409e-9668-90cfea06f29a tempest-VolumeQuotasAdminTestJSON-685363903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b8398b-15c8-48b9-aeef-67f69b153edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:06 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-c3f38686-1b95-409e-9668-90cfea06f29a tempest-VolumeQuotasAdminTestJSON-685363903 None] Volume f661e98e-08ee-4d48-b8e8-9ab3b4634b25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f661e98e-08ee-4d48-b8e8-9ab3b4634b25', 'volume_size': 1} Jul 31 10:51:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c3f38686-1b95-409e-9668-90cfea06f29a tempest-VolumeQuotasAdminTestJSON-685363903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:51:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c3f38686-1b95-409e-9668-90cfea06f29a tempest-VolumeQuotasAdminTestJSON-685363903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:51:06 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c3f38686-1b95-409e-9668-90cfea06f29a tempest-VolumeQuotasAdminTestJSON-685363903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-881720491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f661e98e-08ee-4d48-b8e8-9ab3b4634b25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5e8e94d8a547ac9523eb00e2269965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:51:06Z,use_quota=True,user_id='c253de17f90c4b95bfe7314b440fe3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:51:06 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-c3f38686-1b95-409e-9668-90cfea06f29a tempest-VolumeQuotasAdminTestJSON-685363903 None] Creating volume f661e98e-08ee-4d48-b8e8-9ab3b4634b25 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:51:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c3f38686-1b95-409e-9668-90cfea06f29a tempest-VolumeQuotasAdminTestJSON-685363903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:51:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c3f38686-1b95-409e-9668-90cfea06f29a tempest-VolumeQuotasAdminTestJSON-685363903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:51:06 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c3f38686-1b95-409e-9668-90cfea06f29a tempest-VolumeQuotasAdminTestJSON-685363903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:51:06 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c3f38686-1b95-409e-9668-90cfea06f29a tempest-VolumeQuotasAdminTestJSON-685363903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:51:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c3f38686-1b95-409e-9668-90cfea06f29a tempest-VolumeQuotasAdminTestJSON-685363903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:51:06 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c3f38686-1b95-409e-9668-90cfea06f29a tempest-VolumeQuotasAdminTestJSON-685363903 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:51:06 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-c3f38686-1b95-409e-9668-90cfea06f29a tempest-VolumeQuotasAdminTestJSON-685363903 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:51:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c3f38686-1b95-409e-9668-90cfea06f29a tempest-VolumeQuotasAdminTestJSON-685363903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f661e98e-08ee-4d48-b8e8-9ab3b4634b25 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:06 devstack sudo[101370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f661e98e-08ee-4d48-b8e8-9ab3b4634b25 1073741824 Jul 31 10:51:06 devstack sudo[101370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:07 devstack sudo[101370]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c3f38686-1b95-409e-9668-90cfea06f29a tempest-VolumeQuotasAdminTestJSON-685363903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f661e98e-08ee-4d48-b8e8-9ab3b4634b25 1073741824" returned: 0 in 1.086s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c3f38686-1b95-409e-9668-90cfea06f29a tempest-VolumeQuotasAdminTestJSON-685363903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f661e98e-08ee-4d48-b8e8-9ab3b4634b25 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:07 devstack sudo[101418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f661e98e-08ee-4d48-b8e8-9ab3b4634b25 Jul 31 10:51:07 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:08 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c3f38686-1b95-409e-9668-90cfea06f29a tempest-VolumeQuotasAdminTestJSON-685363903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f661e98e-08ee-4d48-b8e8-9ab3b4634b25" returned: 0 in 0.691s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:08 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c3f38686-1b95-409e-9668-90cfea06f29a tempest-VolumeQuotasAdminTestJSON-685363903 None] <== create_volume: return (1872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:51:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c3f38686-1b95-409e-9668-90cfea06f29a tempest-VolumeQuotasAdminTestJSON-685363903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.882s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:51:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c3f38686-1b95-409e-9668-90cfea06f29a tempest-VolumeQuotasAdminTestJSON-685363903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b8398b-15c8-48b9-aeef-67f69b153edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f661e98e-08ee-4d48-b8e8-9ab3b4634b25', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c3f38686-1b95-409e-9668-90cfea06f29a tempest-VolumeQuotasAdminTestJSON-685363903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b2f5ffd-f1d2-4b30-9d04-a545bedae9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:08 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-c3f38686-1b95-409e-9668-90cfea06f29a tempest-VolumeQuotasAdminTestJSON-685363903 None] Volume volume-f661e98e-08ee-4d48-b8e8-9ab3b4634b25 (f661e98e-08ee-4d48-b8e8-9ab3b4634b25): created successfully Jul 31 10:51:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c3f38686-1b95-409e-9668-90cfea06f29a tempest-VolumeQuotasAdminTestJSON-685363903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b2f5ffd-f1d2-4b30-9d04-a545bedae9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c3f38686-1b95-409e-9668-90cfea06f29a tempest-VolumeQuotasAdminTestJSON-685363903 None] Flow 'volume_create_manager' (71b8bad8-52c2-4e82-8b20-805aef422b7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:51:08 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-c3f38686-1b95-409e-9668-90cfea06f29a tempest-VolumeQuotasAdminTestJSON-685363903 None] Created volume successfully. Jul 31 10:51:11 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-2948ed6a-4a8f-4c57-b5ad-59e785037ef0 tempest-VolumeQuotasAdminTestJSON-1367152559 None] Transfer volume completed successfully. Jul 31 10:51:12 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-15e86cdf-138f-4cbf-923a-8056b1cc53a2 tempest-VolumeQuotasAdminTestJSON-673716815 None] Acquiring lock "cinder-f661e98e-08ee-4d48-b8e8-9ab3b4634b25-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:51:12 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-15e86cdf-138f-4cbf-923a-8056b1cc53a2 tempest-VolumeQuotasAdminTestJSON-673716815 None] Lock "cinder-f661e98e-08ee-4d48-b8e8-9ab3b4634b25-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:51:12 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-15e86cdf-138f-4cbf-923a-8056b1cc53a2 tempest-VolumeQuotasAdminTestJSON-673716815 None] Acquiring lock "cinder-quobyte-f661e98e-08ee-4d48-b8e8-9ab3b4634b25" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:51:12 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-15e86cdf-138f-4cbf-923a-8056b1cc53a2 tempest-VolumeQuotasAdminTestJSON-673716815 None] Lock "cinder-quobyte-f661e98e-08ee-4d48-b8e8-9ab3b4634b25" acquired by "delete_volume" :: waited 0.024s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:51:12 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc05ed6-94b2-41c2-9402-b36ad5bee293]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:51:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-15e86cdf-138f-4cbf-923a-8056b1cc53a2 tempest-VolumeQuotasAdminTestJSON-673716815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f661e98e-08ee-4d48-b8e8-9ab3b4634b25 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:12 devstack sudo[101490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f661e98e-08ee-4d48-b8e8-9ab3b4634b25 Jul 31 10:51:12 devstack sudo[101490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:13 devstack sudo[101490]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-15e86cdf-138f-4cbf-923a-8056b1cc53a2 tempest-VolumeQuotasAdminTestJSON-673716815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f661e98e-08ee-4d48-b8e8-9ab3b4634b25" returned: 0 in 1.004s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-15e86cdf-138f-4cbf-923a-8056b1cc53a2 tempest-VolumeQuotasAdminTestJSON-673716815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f661e98e-08ee-4d48-b8e8-9ab3b4634b25 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:13 devstack sudo[101496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f661e98e-08ee-4d48-b8e8-9ab3b4634b25 Jul 31 10:51:13 devstack sudo[101496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:14 devstack sudo[101496]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-15e86cdf-138f-4cbf-923a-8056b1cc53a2 tempest-VolumeQuotasAdminTestJSON-673716815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f661e98e-08ee-4d48-b8e8-9ab3b4634b25" returned: 0 in 0.667s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:14 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-15e86cdf-138f-4cbf-923a-8056b1cc53a2 tempest-VolumeQuotasAdminTestJSON-673716815 None] Lock "cinder-quobyte-f661e98e-08ee-4d48-b8e8-9ab3b4634b25" released by "delete_volume" :: held 1.764s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:51:14 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-15e86cdf-138f-4cbf-923a-8056b1cc53a2 tempest-VolumeQuotasAdminTestJSON-673716815 None] Created reservations ['72c94ff4-41a0-4f22-a47a-348fe5e0656a', 'e74892fb-51ad-4b88-99c9-ca90d40c9093', '1f79550a-f296-464b-8e86-21b9bcef3f63', '567896ff-039d-4ba5-96a2-09e05441dd58'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:51:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-15e86cdf-138f-4cbf-923a-8056b1cc53a2 tempest-VolumeQuotasAdminTestJSON-673716815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:51:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-15e86cdf-138f-4cbf-923a-8056b1cc53a2 tempest-VolumeQuotasAdminTestJSON-673716815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:51:14 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-15e86cdf-138f-4cbf-923a-8056b1cc53a2 tempest-VolumeQuotasAdminTestJSON-673716815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:51:14 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-15e86cdf-138f-4cbf-923a-8056b1cc53a2 tempest-VolumeQuotasAdminTestJSON-673716815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:51:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-15e86cdf-138f-4cbf-923a-8056b1cc53a2 tempest-VolumeQuotasAdminTestJSON-673716815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:51:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-15e86cdf-138f-4cbf-923a-8056b1cc53a2 tempest-VolumeQuotasAdminTestJSON-673716815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:14 devstack sudo[101499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:51:14 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:14 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-15e86cdf-138f-4cbf-923a-8056b1cc53a2 tempest-VolumeQuotasAdminTestJSON-673716815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.499s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:15 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-15e86cdf-138f-4cbf-923a-8056b1cc53a2 tempest-VolumeQuotasAdminTestJSON-673716815 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:51:15 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-15e86cdf-138f-4cbf-923a-8056b1cc53a2 tempest-VolumeQuotasAdminTestJSON-673716815 None] Deleted volume successfully. Jul 31 10:51:15 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-15e86cdf-138f-4cbf-923a-8056b1cc53a2 tempest-VolumeQuotasAdminTestJSON-673716815 None] Lock "cinder-f661e98e-08ee-4d48-b8e8-9ab3b4634b25-delete_volume" released by "delete_volume" :: held 2.758s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:51:24 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=98,cinder:UPDATE=125,cinder:DELETE=9,cinder:INSERT=33 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:51:25 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=110,cinder:UPDATE=117,cinder:INSERT=33,cinder:DELETE=7 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:51:31 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-b68bea25-6545-4c7e-8496-9ec055efda84 tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:51:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b68bea25-6545-4c7e-8496-9ec055efda84 tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Flow 'volume_create_manager' (e4a4cbe5-ab56-47d0-8210-1425280caf22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:51:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b68bea25-6545-4c7e-8496-9ec055efda84 tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a9ee068-a4b1-41e4-94ae-15803dad46d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b68bea25-6545-4c7e-8496-9ec055efda84 tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a9ee068-a4b1-41e4-94ae-15803dad46d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-526578515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66d6d34b-6b1e-4f78-9b5a-7dc120a203dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5d773db1c0d4e7cb26474c63968a0f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:51:32Z,use_quota=True,user_id='d347e747690741478ed1c9a885d4c6b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b68bea25-6545-4c7e-8496-9ec055efda84 tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ef78407-8fe9-4386-8105-b4db7a974035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b68bea25-6545-4c7e-8496-9ec055efda84 tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ef78407-8fe9-4386-8105-b4db7a974035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b68bea25-6545-4c7e-8496-9ec055efda84 tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70e48ba1-4958-40cf-b529-7923de0ba60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b68bea25-6545-4c7e-8496-9ec055efda84 tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70e48ba1-4958-40cf-b529-7923de0ba60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66d6d34b-6b1e-4f78-9b5a-7dc120a203dc', 'volume_name': 'volume-66d6d34b-6b1e-4f78-9b5a-7dc120a203dc', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b68bea25-6545-4c7e-8496-9ec055efda84 tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cb2255e-2d25-4137-98c9-415063e14c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:31 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b68bea25-6545-4c7e-8496-9ec055efda84 tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cb2255e-2d25-4137-98c9-415063e14c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:32 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b68bea25-6545-4c7e-8496-9ec055efda84 tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e604be8-96af-4f98-914b-4f1f3767a3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:32 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-b68bea25-6545-4c7e-8496-9ec055efda84 tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Volume 66d6d34b-6b1e-4f78-9b5a-7dc120a203dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66d6d34b-6b1e-4f78-9b5a-7dc120a203dc', 'volume_size': 1} Jul 31 10:51:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b68bea25-6545-4c7e-8496-9ec055efda84 tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:51:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b68bea25-6545-4c7e-8496-9ec055efda84 tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:51:32 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-b68bea25-6545-4c7e-8496-9ec055efda84 tempest-VolumeQuotasNegativeTestJSON-1338186560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-526578515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66d6d34b-6b1e-4f78-9b5a-7dc120a203dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5d773db1c0d4e7cb26474c63968a0f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:51:32Z,use_quota=True,user_id='d347e747690741478ed1c9a885d4c6b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:51:32 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-b68bea25-6545-4c7e-8496-9ec055efda84 tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Creating volume 66d6d34b-6b1e-4f78-9b5a-7dc120a203dc {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:51:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b68bea25-6545-4c7e-8496-9ec055efda84 tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:51:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b68bea25-6545-4c7e-8496-9ec055efda84 tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:51:32 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-b68bea25-6545-4c7e-8496-9ec055efda84 tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:51:32 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-b68bea25-6545-4c7e-8496-9ec055efda84 tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:51:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b68bea25-6545-4c7e-8496-9ec055efda84 tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:51:32 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-b68bea25-6545-4c7e-8496-9ec055efda84 tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:51:32 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-b68bea25-6545-4c7e-8496-9ec055efda84 tempest-VolumeQuotasNegativeTestJSON-1338186560 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:51:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b68bea25-6545-4c7e-8496-9ec055efda84 tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-66d6d34b-6b1e-4f78-9b5a-7dc120a203dc 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:32 devstack sudo[101650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-66d6d34b-6b1e-4f78-9b5a-7dc120a203dc 1073741824 Jul 31 10:51:32 devstack sudo[101650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:32 devstack sudo[101650]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b68bea25-6545-4c7e-8496-9ec055efda84 tempest-VolumeQuotasNegativeTestJSON-1338186560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-66d6d34b-6b1e-4f78-9b5a-7dc120a203dc 1073741824" returned: 0 in 0.766s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b68bea25-6545-4c7e-8496-9ec055efda84 tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-66d6d34b-6b1e-4f78-9b5a-7dc120a203dc {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:32 devstack sudo[101656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-66d6d34b-6b1e-4f78-9b5a-7dc120a203dc Jul 31 10:51:32 devstack sudo[101656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:33 devstack sudo[101656]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b68bea25-6545-4c7e-8496-9ec055efda84 tempest-VolumeQuotasNegativeTestJSON-1338186560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-66d6d34b-6b1e-4f78-9b5a-7dc120a203dc" returned: 0 in 0.457s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:33 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-b68bea25-6545-4c7e-8496-9ec055efda84 tempest-VolumeQuotasNegativeTestJSON-1338186560 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:51:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b68bea25-6545-4c7e-8496-9ec055efda84 tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:51:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b68bea25-6545-4c7e-8496-9ec055efda84 tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e604be8-96af-4f98-914b-4f1f3767a3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66d6d34b-6b1e-4f78-9b5a-7dc120a203dc', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b68bea25-6545-4c7e-8496-9ec055efda84 tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b90652a-89ff-42c4-92b6-d9c53dc7b3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:33 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-b68bea25-6545-4c7e-8496-9ec055efda84 tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Volume volume-66d6d34b-6b1e-4f78-9b5a-7dc120a203dc (66d6d34b-6b1e-4f78-9b5a-7dc120a203dc): created successfully Jul 31 10:51:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b68bea25-6545-4c7e-8496-9ec055efda84 tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b90652a-89ff-42c4-92b6-d9c53dc7b3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b68bea25-6545-4c7e-8496-9ec055efda84 tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Flow 'volume_create_manager' (e4a4cbe5-ab56-47d0-8210-1425280caf22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:51:33 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-b68bea25-6545-4c7e-8496-9ec055efda84 tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Created volume successfully. Jul 31 10:51:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-1f1a74ed-5260-40b7-b4d0-f838e761033d req-be2cd01e-9166-4038-95a6-7cc466bbac04 tempest-TestStampPattern-862817097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:51:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-1f1a74ed-5260-40b7-b4d0-f838e761033d req-be2cd01e-9166-4038-95a6-7cc466bbac04 tempest-TestStampPattern-862817097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:51:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-1f1a74ed-5260-40b7-b4d0-f838e761033d req-be2cd01e-9166-4038-95a6-7cc466bbac04 tempest-TestStampPattern-862817097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:51:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-1f1a74ed-5260-40b7-b4d0-f838e761033d req-be2cd01e-9166-4038-95a6-7cc466bbac04 tempest-TestStampPattern-862817097 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c', 'name': 'volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '21f62b54-cd93-4696-a990-912920c0076f', 'enforce_multipath': True} {{(pid=89090) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:51:35 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-1f1a74ed-5260-40b7-b4d0-f838e761033d req-be2cd01e-9166-4038-95a6-7cc466bbac04 tempest-TestStampPattern-862817097 None] attachment_update completed successfully. Jul 31 10:51:35 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-38201061-b61c-4552-8096-ffc1a74f5cab tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Acquiring lock "cinder-66d6d34b-6b1e-4f78-9b5a-7dc120a203dc-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:51:35 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-38201061-b61c-4552-8096-ffc1a74f5cab tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Lock "cinder-66d6d34b-6b1e-4f78-9b5a-7dc120a203dc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:51:35 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-38201061-b61c-4552-8096-ffc1a74f5cab tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Acquiring lock "cinder-quobyte-66d6d34b-6b1e-4f78-9b5a-7dc120a203dc" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:51:35 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-38201061-b61c-4552-8096-ffc1a74f5cab tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Lock "cinder-quobyte-66d6d34b-6b1e-4f78-9b5a-7dc120a203dc" acquired by "delete_volume" :: waited 0.039s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:51:36 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[39870537-cd66-4fef-bb2c-db3361c31d52]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:51:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-38201061-b61c-4552-8096-ffc1a74f5cab tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-66d6d34b-6b1e-4f78-9b5a-7dc120a203dc {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:36 devstack sudo[101742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-66d6d34b-6b1e-4f78-9b5a-7dc120a203dc Jul 31 10:51:36 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:36 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-38201061-b61c-4552-8096-ffc1a74f5cab tempest-VolumeQuotasNegativeTestJSON-1338186560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-66d6d34b-6b1e-4f78-9b5a-7dc120a203dc" returned: 0 in 0.610s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-38201061-b61c-4552-8096-ffc1a74f5cab tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-66d6d34b-6b1e-4f78-9b5a-7dc120a203dc {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:36 devstack sudo[102069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-66d6d34b-6b1e-4f78-9b5a-7dc120a203dc Jul 31 10:51:36 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:37 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-38201061-b61c-4552-8096-ffc1a74f5cab tempest-VolumeQuotasNegativeTestJSON-1338186560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-66d6d34b-6b1e-4f78-9b5a-7dc120a203dc" returned: 0 in 0.425s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-38201061-b61c-4552-8096-ffc1a74f5cab tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Lock "cinder-quobyte-66d6d34b-6b1e-4f78-9b5a-7dc120a203dc" released by "delete_volume" :: held 1.116s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:51:37 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-38201061-b61c-4552-8096-ffc1a74f5cab tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Created reservations ['bd9bba78-afb3-44c4-87a2-597ea6836e12', '5077ead0-d1de-40fe-901d-cda69c54b63b', '93aa87d8-819f-4721-8d07-58592b34e187', 'df155c8d-860f-415a-8d72-ea7aaf31e9ab'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:51:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-38201061-b61c-4552-8096-ffc1a74f5cab tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:51:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-38201061-b61c-4552-8096-ffc1a74f5cab tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:51:37 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-38201061-b61c-4552-8096-ffc1a74f5cab tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:51:37 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-38201061-b61c-4552-8096-ffc1a74f5cab tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:51:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-38201061-b61c-4552-8096-ffc1a74f5cab tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:51:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-38201061-b61c-4552-8096-ffc1a74f5cab tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:37 devstack sudo[102072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:51:37 devstack sudo[102072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:37 devstack sudo[102072]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-38201061-b61c-4552-8096-ffc1a74f5cab tempest-VolumeQuotasNegativeTestJSON-1338186560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.412s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:37 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-38201061-b61c-4552-8096-ffc1a74f5cab tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:51:37 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-38201061-b61c-4552-8096-ffc1a74f5cab tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Deleted volume successfully. Jul 31 10:51:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-38201061-b61c-4552-8096-ffc1a74f5cab tempest-VolumeQuotasNegativeTestJSON-1338186560 None] Lock "cinder-66d6d34b-6b1e-4f78-9b5a-7dc120a203dc-delete_volume" released by "delete_volume" :: held 1.938s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:51:41 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-248a45ad-cf1e-40aa-a29e-4071873ede5a tempest-VolumesNegativeTest-879817117 None] Acquiring lock "cinder-f5ae72d4-23f6-4366-ba91-209914fa222c-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:51:41 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-248a45ad-cf1e-40aa-a29e-4071873ede5a tempest-VolumesNegativeTest-879817117 None] Lock "cinder-f5ae72d4-23f6-4366-ba91-209914fa222c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:51:41 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-248a45ad-cf1e-40aa-a29e-4071873ede5a tempest-VolumesNegativeTest-879817117 None] Acquiring lock "cinder-quobyte-f5ae72d4-23f6-4366-ba91-209914fa222c" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:51:41 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-248a45ad-cf1e-40aa-a29e-4071873ede5a tempest-VolumesNegativeTest-879817117 None] Lock "cinder-quobyte-f5ae72d4-23f6-4366-ba91-209914fa222c" acquired by "delete_volume" :: waited 0.032s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:51:41 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc68e74-853e-485e-b622-b90e8d5e724e]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:51:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-248a45ad-cf1e-40aa-a29e-4071873ede5a tempest-VolumesNegativeTest-879817117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5ae72d4-23f6-4366-ba91-209914fa222c {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:41 devstack sudo[102099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5ae72d4-23f6-4366-ba91-209914fa222c Jul 31 10:51:41 devstack sudo[102099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:42 devstack sudo[102099]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-248a45ad-cf1e-40aa-a29e-4071873ede5a tempest-VolumesNegativeTest-879817117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5ae72d4-23f6-4366-ba91-209914fa222c" returned: 0 in 0.634s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-248a45ad-cf1e-40aa-a29e-4071873ede5a tempest-VolumesNegativeTest-879817117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5ae72d4-23f6-4366-ba91-209914fa222c {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:42 devstack sudo[102108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5ae72d4-23f6-4366-ba91-209914fa222c Jul 31 10:51:42 devstack sudo[102108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:42 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-52e8470b-f2fd-47a2-89a7-1ebb3a921ae9 req-585cc516-205c-4bcb-bf65-d189252522bd tempest-TestStampPattern-862817097 None] Terminate volume connection completed successfully. Jul 31 10:51:42 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-52e8470b-f2fd-47a2-89a7-1ebb3a921ae9 req-585cc516-205c-4bcb-bf65-d189252522bd tempest-TestStampPattern-862817097 None] Deleting attachment 21f62b54-cd93-4696-a990-912920c0076f. {{(pid=89090) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:51:42 devstack sudo[102108]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-248a45ad-cf1e-40aa-a29e-4071873ede5a tempest-VolumesNegativeTest-879817117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5ae72d4-23f6-4366-ba91-209914fa222c" returned: 0 in 0.498s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:42 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-248a45ad-cf1e-40aa-a29e-4071873ede5a tempest-VolumesNegativeTest-879817117 None] Lock "cinder-quobyte-f5ae72d4-23f6-4366-ba91-209914fa222c" released by "delete_volume" :: held 1.204s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:51:42 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-248a45ad-cf1e-40aa-a29e-4071873ede5a tempest-VolumesNegativeTest-879817117 None] Created reservations ['a6d70fa0-5a0b-4b0a-bf76-b1992c1ae7da', '6ca2323a-045a-4d54-a0e8-a9a823aa80ce', 'de695e16-8e92-4d35-ae3b-e4db8bf948a9', '18d0f25d-06ce-4c76-bb5f-5431998b189f'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:51:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-248a45ad-cf1e-40aa-a29e-4071873ede5a tempest-VolumesNegativeTest-879817117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:51:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-248a45ad-cf1e-40aa-a29e-4071873ede5a tempest-VolumesNegativeTest-879817117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:51:43 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-248a45ad-cf1e-40aa-a29e-4071873ede5a tempest-VolumesNegativeTest-879817117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:51:43 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-248a45ad-cf1e-40aa-a29e-4071873ede5a tempest-VolumesNegativeTest-879817117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:51:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-248a45ad-cf1e-40aa-a29e-4071873ede5a tempest-VolumesNegativeTest-879817117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:51:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-248a45ad-cf1e-40aa-a29e-4071873ede5a tempest-VolumesNegativeTest-879817117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:43 devstack sudo[102137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:51:43 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b261d642-3e41-40de-8b8b-6e16da6eab28 tempest-TestStampPattern-862817097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:51:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b261d642-3e41-40de-8b8b-6e16da6eab28 tempest-TestStampPattern-862817097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:51:43 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-b261d642-3e41-40de-8b8b-6e16da6eab28 tempest-TestStampPattern-862817097 None] Creating offline snapshot 40cee1b8-ac13-4e92-89ab-5c914968c66a of volume fd9a48ef-b8f0-44b8-b07e-dde0069cc670 {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:51:43 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[947ac997-2f23-4ac7-99d0-9f36800f77cc]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:51:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b261d642-3e41-40de-8b8b-6e16da6eab28 tempest-TestStampPattern-862817097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:43 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-248a45ad-cf1e-40aa-a29e-4071873ede5a tempest-VolumesNegativeTest-879817117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.420s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:43 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-248a45ad-cf1e-40aa-a29e-4071873ede5a tempest-VolumesNegativeTest-879817117 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:51:43 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-248a45ad-cf1e-40aa-a29e-4071873ede5a tempest-VolumesNegativeTest-879817117 None] Deleted volume successfully. Jul 31 10:51:43 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-248a45ad-cf1e-40aa-a29e-4071873ede5a tempest-VolumesNegativeTest-879817117 None] Lock "cinder-f5ae72d4-23f6-4366-ba91-209914fa222c-delete_volume" released by "delete_volume" :: held 2.051s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:51:43 devstack sudo[102140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670 Jul 31 10:51:43 devstack sudo[102140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:44 devstack sudo[102140]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b261d642-3e41-40de-8b8b-6e16da6eab28 tempest-TestStampPattern-862817097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670" returned: 0 in 0.519s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b261d642-3e41-40de-8b8b-6e16da6eab28 tempest-TestStampPattern-862817097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670.40cee1b8-ac13-4e92-89ab-5c914968c66a 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:44 devstack sudo[102145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670.40cee1b8-ac13-4e92-89ab-5c914968c66a 1G Jul 31 10:51:44 devstack sudo[102145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:44 devstack sudo[102145]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b261d642-3e41-40de-8b8b-6e16da6eab28 tempest-TestStampPattern-862817097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670.40cee1b8-ac13-4e92-89ab-5c914968c66a 1G" returned: 0 in 0.558s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b261d642-3e41-40de-8b8b-6e16da6eab28 tempest-TestStampPattern-862817097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670.40cee1b8-ac13-4e92-89ab-5c914968c66a {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:44 devstack sudo[102150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670.40cee1b8-ac13-4e92-89ab-5c914968c66a Jul 31 10:51:44 devstack sudo[102150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:44 devstack sudo[102150]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b261d642-3e41-40de-8b8b-6e16da6eab28 tempest-TestStampPattern-862817097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670.40cee1b8-ac13-4e92-89ab-5c914968c66a" returned: 0 in 0.408s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:44 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-b261d642-3e41-40de-8b8b-6e16da6eab28 tempest-TestStampPattern-862817097 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670.40cee1b8-ac13-4e92-89ab-5c914968c66a is being set with open permissions: ugo+rw Jul 31 10:51:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b261d642-3e41-40de-8b8b-6e16da6eab28 tempest-TestStampPattern-862817097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670.40cee1b8-ac13-4e92-89ab-5c914968c66a {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:45 devstack sudo[102155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670.40cee1b8-ac13-4e92-89ab-5c914968c66a Jul 31 10:51:45 devstack sudo[102155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:45 devstack sudo[102155]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b261d642-3e41-40de-8b8b-6e16da6eab28 tempest-TestStampPattern-862817097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670.40cee1b8-ac13-4e92-89ab-5c914968c66a" returned: 0 in 0.377s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b261d642-3e41-40de-8b8b-6e16da6eab28 tempest-TestStampPattern-862817097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:45 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670.info Jul 31 10:51:45 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:45 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b261d642-3e41-40de-8b8b-6e16da6eab28 tempest-TestStampPattern-862817097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670.info" returned: 0 in 0.415s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:45 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-b261d642-3e41-40de-8b8b-6e16da6eab28 tempest-TestStampPattern-862817097 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670.info is being set with open permissions: ugo+rw Jul 31 10:51:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b261d642-3e41-40de-8b8b-6e16da6eab28 tempest-TestStampPattern-862817097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:45 devstack sudo[102161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670.info Jul 31 10:51:45 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:45 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:51:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:51:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:51:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:51:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:51:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:51:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:46 devstack sudo[102163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:51:46 devstack sudo[102163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:46 devstack sudo[102163]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.417s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:46 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:51:46 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b261d642-3e41-40de-8b8b-6e16da6eab28 tempest-TestStampPattern-862817097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670.info" returned: 0 in 0.547s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b261d642-3e41-40de-8b8b-6e16da6eab28 tempest-TestStampPattern-862817097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.993s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:51:46 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager._thread_info {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:51:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread count: 28 {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:51:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread info: [<_MainThread(MainThread, started 134005426110592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:51:46 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-b261d642-3e41-40de-8b8b-6e16da6eab28 tempest-TestStampPattern-862817097 None] Create snapshot completed successfully Jul 31 10:51:49 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea8c1d8d-b5a6-49fe-bd61-665027c73f63 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:51:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ea8c1d8d-b5a6-49fe-bd61-665027c73f63 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Flow 'volume_create_manager' (980e30fb-f910-43bf-966a-eb5530579a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:51:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ea8c1d8d-b5a6-49fe-bd61-665027c73f63 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73e6bb56-8c44-4054-a56d-a0d9edce2bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ea8c1d8d-b5a6-49fe-bd61-665027c73f63 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73e6bb56-8c44-4054-a56d-a0d9edce2bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1385416425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=207b9c9b-b4a9-4b1f-bd57-22257207f488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab2eb1e83d1c42489c9a8e0003a65580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:51:49Z,use_quota=True,user_id='403776d336664cb6bea45ae060dd483e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ea8c1d8d-b5a6-49fe-bd61-665027c73f63 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62d21c72-6dce-4ec3-a36a-51406d055f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ea8c1d8d-b5a6-49fe-bd61-665027c73f63 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62d21c72-6dce-4ec3-a36a-51406d055f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ea8c1d8d-b5a6-49fe-bd61-665027c73f63 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80214cb7-e4ce-48a5-b4a1-be58e2caa3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ea8c1d8d-b5a6-49fe-bd61-665027c73f63 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80214cb7-e4ce-48a5-b4a1-be58e2caa3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '207b9c9b-b4a9-4b1f-bd57-22257207f488', 'volume_name': 'volume-207b9c9b-b4a9-4b1f-bd57-22257207f488', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ea8c1d8d-b5a6-49fe-bd61-665027c73f63 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa2b3cd8-7ad2-4522-b516-c83cc0a77352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ea8c1d8d-b5a6-49fe-bd61-665027c73f63 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa2b3cd8-7ad2-4522-b516-c83cc0a77352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ea8c1d8d-b5a6-49fe-bd61-665027c73f63 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97629660-6285-4d11-a2c1-046b47d8f6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:49 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-ea8c1d8d-b5a6-49fe-bd61-665027c73f63 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Volume 207b9c9b-b4a9-4b1f-bd57-22257207f488: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-207b9c9b-b4a9-4b1f-bd57-22257207f488', 'volume_size': 1} Jul 31 10:51:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ea8c1d8d-b5a6-49fe-bd61-665027c73f63 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:51:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ea8c1d8d-b5a6-49fe-bd61-665027c73f63 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:51:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ea8c1d8d-b5a6-49fe-bd61-665027c73f63 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1385416425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=207b9c9b-b4a9-4b1f-bd57-22257207f488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab2eb1e83d1c42489c9a8e0003a65580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:51:49Z,use_quota=True,user_id='403776d336664cb6bea45ae060dd483e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:51:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-ea8c1d8d-b5a6-49fe-bd61-665027c73f63 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Creating volume 207b9c9b-b4a9-4b1f-bd57-22257207f488 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:51:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ea8c1d8d-b5a6-49fe-bd61-665027c73f63 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:51:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ea8c1d8d-b5a6-49fe-bd61-665027c73f63 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:51:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ea8c1d8d-b5a6-49fe-bd61-665027c73f63 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:51:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ea8c1d8d-b5a6-49fe-bd61-665027c73f63 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:51:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ea8c1d8d-b5a6-49fe-bd61-665027c73f63 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:51:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ea8c1d8d-b5a6-49fe-bd61-665027c73f63 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:51:49 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-ea8c1d8d-b5a6-49fe-bd61-665027c73f63 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:51:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ea8c1d8d-b5a6-49fe-bd61-665027c73f63 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:49 devstack sudo[102172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488 1073741824 Jul 31 10:51:49 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:50 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ea8c1d8d-b5a6-49fe-bd61-665027c73f63 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488 1073741824" returned: 0 in 0.770s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ea8c1d8d-b5a6-49fe-bd61-665027c73f63 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:50 devstack sudo[102196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488 Jul 31 10:51:50 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:50 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ea8c1d8d-b5a6-49fe-bd61-665027c73f63 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488" returned: 0 in 0.424s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:50 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ea8c1d8d-b5a6-49fe-bd61-665027c73f63 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:51:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ea8c1d8d-b5a6-49fe-bd61-665027c73f63 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:51:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ea8c1d8d-b5a6-49fe-bd61-665027c73f63 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97629660-6285-4d11-a2c1-046b47d8f6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-207b9c9b-b4a9-4b1f-bd57-22257207f488', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ea8c1d8d-b5a6-49fe-bd61-665027c73f63 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b201e11-9655-43bc-ae41-e3c54e559d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:50 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-ea8c1d8d-b5a6-49fe-bd61-665027c73f63 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Volume volume-207b9c9b-b4a9-4b1f-bd57-22257207f488 (207b9c9b-b4a9-4b1f-bd57-22257207f488): created successfully Jul 31 10:51:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ea8c1d8d-b5a6-49fe-bd61-665027c73f63 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b201e11-9655-43bc-ae41-e3c54e559d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ea8c1d8d-b5a6-49fe-bd61-665027c73f63 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Flow 'volume_create_manager' (980e30fb-f910-43bf-966a-eb5530579a17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:51:50 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-ea8c1d8d-b5a6-49fe-bd61-665027c73f63 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Created volume successfully. Jul 31 10:51:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c7ba3050-ce92-44b5-a4b8-74dd7abab23a tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:51:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c7ba3050-ce92-44b5-a4b8-74dd7abab23a tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:51:51 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-c7ba3050-ce92-44b5-a4b8-74dd7abab23a tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Creating offline snapshot 0fa41121-812b-4174-923f-09744c125d0e of volume 207b9c9b-b4a9-4b1f-bd57-22257207f488 {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:51:51 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a18a4a0-c447-4b71-a977-87eeb6f84d30]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:51:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c7ba3050-ce92-44b5-a4b8-74dd7abab23a tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:51 devstack sudo[102208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488 Jul 31 10:51:51 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:52 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c7ba3050-ce92-44b5-a4b8-74dd7abab23a tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488" returned: 0 in 0.597s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c7ba3050-ce92-44b5-a4b8-74dd7abab23a tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488.0fa41121-812b-4174-923f-09744c125d0e 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:52 devstack sudo[102213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488.0fa41121-812b-4174-923f-09744c125d0e 1G Jul 31 10:51:52 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:53 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c7ba3050-ce92-44b5-a4b8-74dd7abab23a tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488.0fa41121-812b-4174-923f-09744c125d0e 1G" returned: 0 in 0.815s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c7ba3050-ce92-44b5-a4b8-74dd7abab23a tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-207b9c9b-b4a9-4b1f-bd57-22257207f488 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488.0fa41121-812b-4174-923f-09744c125d0e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:53 devstack sudo[102219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-207b9c9b-b4a9-4b1f-bd57-22257207f488 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488.0fa41121-812b-4174-923f-09744c125d0e Jul 31 10:51:53 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:53 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c7ba3050-ce92-44b5-a4b8-74dd7abab23a tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-207b9c9b-b4a9-4b1f-bd57-22257207f488 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488.0fa41121-812b-4174-923f-09744c125d0e" returned: 0 in 0.482s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:53 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-c7ba3050-ce92-44b5-a4b8-74dd7abab23a tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488.0fa41121-812b-4174-923f-09744c125d0e is being set with open permissions: ugo+rw Jul 31 10:51:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c7ba3050-ce92-44b5-a4b8-74dd7abab23a tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488.0fa41121-812b-4174-923f-09744c125d0e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:53 devstack sudo[102224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488.0fa41121-812b-4174-923f-09744c125d0e Jul 31 10:51:53 devstack sudo[102224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:54 devstack sudo[102224]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c7ba3050-ce92-44b5-a4b8-74dd7abab23a tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488.0fa41121-812b-4174-923f-09744c125d0e" returned: 0 in 0.349s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c7ba3050-ce92-44b5-a4b8-74dd7abab23a tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:54 devstack sudo[102227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488.info Jul 31 10:51:54 devstack sudo[102227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:54 devstack sudo[102227]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c7ba3050-ce92-44b5-a4b8-74dd7abab23a tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488.info" returned: 0 in 0.360s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:54 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-c7ba3050-ce92-44b5-a4b8-74dd7abab23a tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488.info is being set with open permissions: ugo+rw Jul 31 10:51:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c7ba3050-ce92-44b5-a4b8-74dd7abab23a tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:54 devstack sudo[102230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488.info Jul 31 10:51:54 devstack sudo[102230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:54 devstack sudo[102230]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c7ba3050-ce92-44b5-a4b8-74dd7abab23a tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488.info" returned: 0 in 0.546s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c7ba3050-ce92-44b5-a4b8-74dd7abab23a tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.302s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:51:55 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-c7ba3050-ce92-44b5-a4b8-74dd7abab23a tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Create snapshot completed successfully Jul 31 10:51:56 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9df49300-e56c-4034-b275-afae1d81d863 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Acquiring lock "cinder-0fa41121-812b-4174-923f-09744c125d0e-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:51:56 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Flow 'volume_create_manager' (12e6687a-d540-4602-ab8a-58203abf093f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bbdecef-bfd4-48ff-b9da-62528b53ff2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9df49300-e56c-4034-b275-afae1d81d863 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Lock "cinder-0fa41121-812b-4174-923f-09744c125d0e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.079s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9df49300-e56c-4034-b275-afae1d81d863 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Acquiring lock "cinder-quobyte-207b9c9b-b4a9-4b1f-bd57-22257207f488" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bbdecef-bfd4-48ff-b9da-62528b53ff2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-844151124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e6d588e-9be7-4897-937b-a42c7340b620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afa88751cdf94cfe98cb502548e491fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=40cee1b8-ac13-4e92-89ab-5c914968c66a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:51:57Z,use_quota=True,user_id='ab6d51c6def14ae8869826b5ff5432d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c59204e-657d-4796-ab28-4bbb7b89a9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c59204e-657d-4796-ab28-4bbb7b89a9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc3cd6b2-c98d-431f-b837-b172aeb21041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc3cd6b2-c98d-431f-b837-b172aeb21041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6e6d588e-9be7-4897-937b-a42c7340b620', 'volume_name': 'volume-6e6d588e-9be7-4897-937b-a42c7340b620', 'volume_size': 1, 'snapshot_id': '40cee1b8-ac13-4e92-89ab-5c914968c66a'}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca5fa474-fc27-4550-a874-e458be46fece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca5fa474-fc27-4550-a874-e458be46fece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a483788e-e3a1-457e-84b8-bb90455411f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:57 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Volume 6e6d588e-9be7-4897-937b-a42c7340b620: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6e6d588e-9be7-4897-937b-a42c7340b620', 'volume_size': 1, 'snapshot_id': '40cee1b8-ac13-4e92-89ab-5c914968c66a'} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9df49300-e56c-4034-b275-afae1d81d863 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Lock "cinder-quobyte-207b9c9b-b4a9-4b1f-bd57-22257207f488" acquired by "delete_snapshot" :: waited 0.097s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9df49300-e56c-4034-b275-afae1d81d863 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Acquiring lock "cinder-quobyte-0fa41121-812b-4174-923f-09744c125d0e" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Acquiring lock "cinder-quobyte-40cee1b8-ac13-4e92-89ab-5c914968c66a-6e6d588e-9be7-4897-937b-a42c7340b620" by "_create_volume_from_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9df49300-e56c-4034-b275-afae1d81d863 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Lock "cinder-quobyte-0fa41121-812b-4174-923f-09744c125d0e" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-9df49300-e56c-4034-b275-afae1d81d863 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Deleting offline snapshot 0fa41121-812b-4174-923f-09744c125d0e of volume 207b9c9b-b4a9-4b1f-bd57-22257207f488 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-9df49300-e56c-4034-b275-afae1d81d863 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] snapshot_file for this snap is: volume-207b9c9b-b4a9-4b1f-bd57-22257207f488.0fa41121-812b-4174-923f-09744c125d0e {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[900a3fdf-948e-4001-84e7-448593d245a1]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9df49300-e56c-4034-b275-afae1d81d863 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488.0fa41121-812b-4174-923f-09744c125d0e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Lock "cinder-quobyte-40cee1b8-ac13-4e92-89ab-5c914968c66a-6e6d588e-9be7-4897-937b-a42c7340b620" acquired by "_create_volume_from_snapshot" :: waited 0.072s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Creating volume 6e6d588e-9be7-4897-937b-a42c7340b620 from snapshot 40cee1b8-ac13-4e92-89ab-5c914968c66a {{(pid=89090) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Acquiring lock "cinder-quobyte-6e6d588e-9be7-4897-937b-a42c7340b620" by "_copy_volume_from_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Lock "cinder-quobyte-6e6d588e-9be7-4897-937b-a42c7340b620" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] snapshot: 40cee1b8-ac13-4e92-89ab-5c914968c66a, volume: 6e6d588e-9be7-4897-937b-a42c7340b620, {{(pid=89090) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e638f5-4427-4f85-90aa-f59c75464671]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670.40cee1b8-ac13-4e92-89ab-5c914968c66a {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:57 devstack sudo[102235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488.0fa41121-812b-4174-923f-09744c125d0e Jul 31 10:51:57 devstack sudo[102235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:57 devstack sudo[102236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670.40cee1b8-ac13-4e92-89ab-5c914968c66a Jul 31 10:51:57 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:57 devstack sudo[102235]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9df49300-e56c-4034-b275-afae1d81d863 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488.0fa41121-812b-4174-923f-09744c125d0e" returned: 0 in 0.513s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-9df49300-e56c-4034-b275-afae1d81d863 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-207b9c9b-b4a9-4b1f-bd57-22257207f488(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[d736b1f5-355d-4d7f-b14a-7b03b154ac40]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9df49300-e56c-4034-b275-afae1d81d863 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:57 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670.40cee1b8-ac13-4e92-89ab-5c914968c66a" returned: 0 in 0.455s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[f190aeea-5218-40ae-a323-eff449b4b19e]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:51:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:57 devstack sudo[102247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488 Jul 31 10:51:57 devstack sudo[102247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:57 devstack sudo[102248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670 Jul 31 10:51:57 devstack sudo[102248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:58 devstack sudo[102248]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670" returned: 0 in 0.510s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:58 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670 {{(pid=89090) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 10:51:58 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Creating direct copy from snapshot {{(pid=89090) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 10:51:58 devstack cinder-volume[89090]: DEBUG cinder.utils [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Path /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6e6d588e-9be7-4897-937b-a42c7340b620 not found in is_blk_device check {{(pid=89090) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 10:51:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6e6d588e-9be7-4897-937b-a42c7340b620 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:58 devstack sudo[102247]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9df49300-e56c-4034-b275-afae1d81d863 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488" returned: 0 in 0.613s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9df49300-e56c-4034-b275-afae1d81d863 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488.0fa41121-812b-4174-923f-09744c125d0e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:58 devstack sudo[102257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6e6d588e-9be7-4897-937b-a42c7340b620 Jul 31 10:51:58 devstack sudo[102257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:58 devstack sudo[102258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488.0fa41121-812b-4174-923f-09744c125d0e Jul 31 10:51:58 devstack sudo[102258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:58 devstack sudo[102258]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9df49300-e56c-4034-b275-afae1d81d863 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488.0fa41121-812b-4174-923f-09744c125d0e" returned: 0 in 0.594s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9df49300-e56c-4034-b275-afae1d81d863 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488.0fa41121-812b-4174-923f-09744c125d0e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:59 devstack sudo[102267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488.0fa41121-812b-4174-923f-09744c125d0e Jul 31 10:51:59 devstack sudo[102267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:59 devstack sudo[102267]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9df49300-e56c-4034-b275-afae1d81d863 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488.0fa41121-812b-4174-923f-09744c125d0e" returned: 0 in 0.736s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:59 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9df49300-e56c-4034-b275-afae1d81d863 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Lock "cinder-quobyte-0fa41121-812b-4174-923f-09744c125d0e" released by "_delete_snapshot" :: held 2.706s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:51:59 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9df49300-e56c-4034-b275-afae1d81d863 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Lock "cinder-quobyte-207b9c9b-b4a9-4b1f-bd57-22257207f488" released by "delete_snapshot" :: held 2.772s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:52:00 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-9df49300-e56c-4034-b275-afae1d81d863 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Created reservations ['a08a754e-b859-4bef-aa50-edcc401ad4bf', '47c47321-4871-49ad-b5db-3490c8790326', '7d7cb1af-6982-473d-9c5c-98bc4e8db8b4', '835d22c7-0408-495f-a4bb-98881856aa47'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:52:00 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-9df49300-e56c-4034-b275-afae1d81d863 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Delete snapshot completed successfully. Jul 31 10:52:00 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9df49300-e56c-4034-b275-afae1d81d863 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Lock "cinder-0fa41121-812b-4174-923f-09744c125d0e-delete_snapshot" released by "delete_snapshot" :: held 3.511s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:52:01 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2f9352bd-b4c3-4594-b01f-d74b84d11084 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Acquiring lock "cinder-207b9c9b-b4a9-4b1f-bd57-22257207f488-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:52:01 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2f9352bd-b4c3-4594-b01f-d74b84d11084 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Lock "cinder-207b9c9b-b4a9-4b1f-bd57-22257207f488-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:52:02 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2f9352bd-b4c3-4594-b01f-d74b84d11084 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Acquiring lock "cinder-quobyte-207b9c9b-b4a9-4b1f-bd57-22257207f488" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:52:02 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2f9352bd-b4c3-4594-b01f-d74b84d11084 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Lock "cinder-quobyte-207b9c9b-b4a9-4b1f-bd57-22257207f488" acquired by "delete_volume" :: waited 0.065s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:52:02 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[43265980-63b6-4635-bc7c-77c61ce6903f]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:52:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2f9352bd-b4c3-4594-b01f-d74b84d11084 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:02 devstack sudo[102277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488 Jul 31 10:52:02 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:03 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2f9352bd-b4c3-4594-b01f-d74b84d11084 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488" returned: 0 in 1.627s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2f9352bd-b4c3-4594-b01f-d74b84d11084 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:04 devstack sudo[102284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488 Jul 31 10:52:04 devstack sudo[102284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:04 devstack sudo[102284]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2f9352bd-b4c3-4594-b01f-d74b84d11084 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-207b9c9b-b4a9-4b1f-bd57-22257207f488" returned: 0 in 0.721s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:04 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2f9352bd-b4c3-4594-b01f-d74b84d11084 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Lock "cinder-quobyte-207b9c9b-b4a9-4b1f-bd57-22257207f488" released by "delete_volume" :: held 2.584s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:52:04 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-2f9352bd-b4c3-4594-b01f-d74b84d11084 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Created reservations ['72f75a62-2e69-4d39-bdee-2890b8753751', '4801a193-2aab-40e4-9623-ae79520d97eb', 'ee823f03-05d7-4055-8559-d6f74343a73f', 'b9382356-4fbf-4edf-bbe4-8b630488b5f2'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:52:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2f9352bd-b4c3-4594-b01f-d74b84d11084 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:52:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2f9352bd-b4c3-4594-b01f-d74b84d11084 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:52:05 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2f9352bd-b4c3-4594-b01f-d74b84d11084 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:52:05 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2f9352bd-b4c3-4594-b01f-d74b84d11084 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:52:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2f9352bd-b4c3-4594-b01f-d74b84d11084 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:52:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2f9352bd-b4c3-4594-b01f-d74b84d11084 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:05 devstack sudo[102321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:52:05 devstack sudo[102321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:06 devstack sudo[102257]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6e6d588e-9be7-4897-937b-a42c7340b620" returned: 0 in 7.776s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:06 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Image conversion details: src /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670, size 1024.00 MB, duration 7.78 sec, destination /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6e6d588e-9be7-4897-937b-a42c7340b620 {{(pid=89090) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 10:52:06 devstack cinder-volume[89090]: INFO cinder.image.image_utils [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Converted 1024.00 MB image at 131.59 MB/s Jul 31 10:52:06 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6e6d588e-9be7-4897-937b-a42c7340b620 is being set with open permissions: ugo+rw Jul 31 10:52:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6e6d588e-9be7-4897-937b-a42c7340b620 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:06 devstack sudo[102331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6e6d588e-9be7-4897-937b-a42c7340b620 Jul 31 10:52:06 devstack sudo[102331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:06 devstack sudo[102321]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2f9352bd-b4c3-4594-b01f-d74b84d11084 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 1.005s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:06 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-2f9352bd-b4c3-4594-b01f-d74b84d11084 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:52:06 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-2f9352bd-b4c3-4594-b01f-d74b84d11084 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Deleted volume successfully. Jul 31 10:52:06 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2f9352bd-b4c3-4594-b01f-d74b84d11084 tempest-VolumeSnapshotQuotasNegativeTestJSON-675954966 None] Lock "cinder-207b9c9b-b4a9-4b1f-bd57-22257207f488-delete_volume" released by "delete_volume" :: held 4.565s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:52:06 devstack sudo[102331]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6e6d588e-9be7-4897-937b-a42c7340b620" returned: 0 in 0.428s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:06 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Lock "cinder-quobyte-6e6d588e-9be7-4897-937b-a42c7340b620" released by "_copy_volume_from_snapshot" :: held 9.317s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:52:06 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Lock "cinder-quobyte-40cee1b8-ac13-4e92-89ab-5c914968c66a-6e6d588e-9be7-4897-937b-a42c7340b620" released by "_create_volume_from_snapshot" :: held 9.447s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:52:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.521s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:52:06 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a483788e-e3a1-457e-84b8-bb90455411f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e6d588e-9be7-4897-937b-a42c7340b620', 'volume_size': 1, 'snapshot_id': '40cee1b8-ac13-4e92-89ab-5c914968c66a'}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:06 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (724dba3a-3e22-4422-a9c8-f421ee2c62ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:06 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Volume volume-6e6d588e-9be7-4897-937b-a42c7340b620 (6e6d588e-9be7-4897-937b-a42c7340b620): created successfully Jul 31 10:52:06 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (724dba3a-3e22-4422-a9c8-f421ee2c62ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:06 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Flow 'volume_create_manager' (12e6687a-d540-4602-ab8a-58203abf093f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:52:06 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-170c9205-f86c-4451-8e35-70528776a373 tempest-TestStampPattern-862817097 None] Created volume successfully. Jul 31 10:52:15 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:52:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Flow 'volume_create_manager' (d08b9cd6-cfef-4b88-b8cf-89385f4a9569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:52:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e559f4a4-e086-498f-8b68-5b88cb615377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e559f4a4-e086-498f-8b68-5b88cb615377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-770510986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c4dd065-1621-4cd9-b081-5223550da237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d37f633b0c14f08aa32991a41ded338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:52:16Z,use_quota=True,user_id='5f878b050f164dbd9f2e57c7b67937da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a0d18f2-f8f9-4ecb-b76b-ff7b3d12f3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a0d18f2-f8f9-4ecb-b76b-ff7b3d12f3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fdf6719-c5d9-4c67-8cd4-369cbb947aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:16 devstack cinder-volume[89090]: DEBUG cinder.image.glance [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Creating Keystone auth plugin from conf {{(pid=89090) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 10:52:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fdf6719-c5d9-4c67-8cd4-369cbb947aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8c4dd065-1621-4cd9-b081-5223550da237', 'volume_name': 'volume-8c4dd065-1621-4cd9-b081-5223550da237', 'volume_size': 1, 'image_id': 'b429196b-9072-49ce-b54e-9693a9fd5306', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b429196b-9072-49ce-b54e-9693a9fd5306', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c7e7a60bc5b640caa5ec5fc5df1bd573', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b429196b-9072-49ce-b54e-9693a9fd5306', 'created_at': datetime.datetime(2026, 7, 31, 8, 33, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 33, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b429196b-9072-49ce-b54e-9693a9fd5306/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c5b676-eec0-4553-a447-f7a177a05625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c5b676-eec0-4553-a447-f7a177a05625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e14b5118-c3fd-4f1f-beb7-a9a32c56ad07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:16 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Volume 8c4dd065-1621-4cd9-b081-5223550da237: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8c4dd065-1621-4cd9-b081-5223550da237', 'volume_size': 1, 'image_id': 'b429196b-9072-49ce-b54e-9693a9fd5306', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b429196b-9072-49ce-b54e-9693a9fd5306', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c7e7a60bc5b640caa5ec5fc5df1bd573', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b429196b-9072-49ce-b54e-9693a9fd5306', 'created_at': datetime.datetime(2026, 7, 31, 8, 33, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 33, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b429196b-9072-49ce-b54e-9693a9fd5306/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 31 10:52:16 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Trying to clone 8c4dd065-1621-4cd9-b081-5223550da237 from image b429196b-9072-49ce-b54e-9693a9fd5306 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b429196b-9072-49ce-b54e-9693a9fd5306', 'metadata': {}}]). {{(pid=89090) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 10:52:17 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306__emud229devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89090) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 10:52:17 devstack cinder-volume[89090]: INFO cinder.image.image_utils [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Image download 20.69 MB at 20.69 MB/s Jul 31 10:52:17 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de0fbe4-914e-4999-a250-e6866ced9a18]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:52:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306__emud229devstack@QuobyteHD {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:17 devstack sudo[102377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306__emud229devstack@QuobyteHD Jul 31 10:52:17 devstack sudo[102377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:17 devstack sudo[102377]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306__emud229devstack@QuobyteHD" returned: 0 in 0.485s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:17 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Temporary image b429196b-9072-49ce-b54e-9693a9fd5306 is fetched for user 5f878b050f164dbd9f2e57c7b67937da. {{(pid=89090) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 10:52:18 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[574ab852-4db2-435c-925b-9c0c623111b5]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:52:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306__emud229devstack@QuobyteHD {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:18 devstack sudo[102383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306__emud229devstack@QuobyteHD Jul 31 10:52:18 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:18 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306__emud229devstack@QuobyteHD" returned: 0 in 0.702s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:52:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:52:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-770510986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c4dd065-1621-4cd9-b081-5223550da237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d37f633b0c14f08aa32991a41ded338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:52:16Z,use_quota=True,user_id='5f878b050f164dbd9f2e57c7b67937da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:52:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Creating volume 8c4dd065-1621-4cd9-b081-5223550da237 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:52:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:52:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:52:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:52:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:52:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:52:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:52:18 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:52:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8c4dd065-1621-4cd9-b081-5223550da237 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:18 devstack sudo[102389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8c4dd065-1621-4cd9-b081-5223550da237 1073741824 Jul 31 10:52:18 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:19 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8c4dd065-1621-4cd9-b081-5223550da237 1073741824" returned: 0 in 0.834s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8c4dd065-1621-4cd9-b081-5223550da237 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:19 devstack sudo[102396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8c4dd065-1621-4cd9-b081-5223550da237 Jul 31 10:52:19 devstack sudo[102396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:20 devstack sudo[102396]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8c4dd065-1621-4cd9-b081-5223550da237" returned: 0 in 0.354s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:20 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] <== create_volume: return (1266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:52:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:52:20 devstack cinder-volume[89090]: DEBUG cinder.volume.volume_utils [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Attempting download of b429196b-9072-49ce-b54e-9693a9fd5306 ((None, [{'url': 'file:///opt/stack/data/glance/images/b429196b-9072-49ce-b54e-9693a9fd5306', 'metadata': {}}])) to volume 8c4dd065-1621-4cd9-b081-5223550da237. {{(pid=89090) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 10:52:20 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff5e46a-d425-46df-b829-50a11de2cae7]: (4, 'raw') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:52:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b429196b-9072-49ce-b54e-9693a9fd5306_kxo3x19u {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:20 devstack sudo[102412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b429196b-9072-49ce-b54e-9693a9fd5306_kxo3x19u Jul 31 10:52:20 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:21 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b429196b-9072-49ce-b54e-9693a9fd5306_kxo3x19u" returned: 0 in 0.756s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b429196b-9072-49ce-b54e-9693a9fd5306_kxo3x19u {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:21 devstack sudo[102428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b429196b-9072-49ce-b54e-9693a9fd5306_kxo3x19u Jul 31 10:52:21 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:21 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-23de5b60-b6e6-4f5d-a137-f3e2cbea288b tempest-VolumeTypesAccessTest-1920233364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:52:21 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-23de5b60-b6e6-4f5d-a137-f3e2cbea288b tempest-VolumeTypesAccessTest-1920233364 None] Flow 'volume_create_manager' (b753eb6a-0613-485c-b688-d526b8b174ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:52:21 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-23de5b60-b6e6-4f5d-a137-f3e2cbea288b tempest-VolumeTypesAccessTest-1920233364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef4496cf-4c3f-43b8-9f0b-24d02b8fc846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:21 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-23de5b60-b6e6-4f5d-a137-f3e2cbea288b tempest-VolumeTypesAccessTest-1920233364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef4496cf-4c3f-43b8-9f0b-24d02b8fc846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1510824115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b548cd1-79d2-4991-a700-872eee19b874,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59de1d486b3f425e8f12fe689096e98a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:52:21Z,use_quota=True,user_id='182d06ffdb1c464580757e4e1ce5fa02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e82ca903-e1f3-422c-ab89-8153f1028abb),volume_type_id=e82ca903-e1f3-422c-ab89-8153f1028abb)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:21 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-23de5b60-b6e6-4f5d-a137-f3e2cbea288b tempest-VolumeTypesAccessTest-1920233364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccc7ea8e-046a-4f6e-9409-5ad2648e021e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:21 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-23de5b60-b6e6-4f5d-a137-f3e2cbea288b tempest-VolumeTypesAccessTest-1920233364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccc7ea8e-046a-4f6e-9409-5ad2648e021e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:21 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-23de5b60-b6e6-4f5d-a137-f3e2cbea288b tempest-VolumeTypesAccessTest-1920233364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c17d2cd-40bf-4d6a-b4b9-ce9314d7f350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:21 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-23de5b60-b6e6-4f5d-a137-f3e2cbea288b tempest-VolumeTypesAccessTest-1920233364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c17d2cd-40bf-4d6a-b4b9-ce9314d7f350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b548cd1-79d2-4991-a700-872eee19b874', 'volume_name': 'volume-8b548cd1-79d2-4991-a700-872eee19b874', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:21 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-23de5b60-b6e6-4f5d-a137-f3e2cbea288b tempest-VolumeTypesAccessTest-1920233364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (479721fd-9b09-43df-8657-435f09f4e8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:21 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-23de5b60-b6e6-4f5d-a137-f3e2cbea288b tempest-VolumeTypesAccessTest-1920233364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (479721fd-9b09-43df-8657-435f09f4e8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:21 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-23de5b60-b6e6-4f5d-a137-f3e2cbea288b tempest-VolumeTypesAccessTest-1920233364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd317220-5f93-4218-a12f-674cac442bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:21 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-23de5b60-b6e6-4f5d-a137-f3e2cbea288b tempest-VolumeTypesAccessTest-1920233364 None] Volume 8b548cd1-79d2-4991-a700-872eee19b874: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b548cd1-79d2-4991-a700-872eee19b874', 'volume_size': 1} Jul 31 10:52:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-23de5b60-b6e6-4f5d-a137-f3e2cbea288b tempest-VolumeTypesAccessTest-1920233364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:52:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-23de5b60-b6e6-4f5d-a137-f3e2cbea288b tempest-VolumeTypesAccessTest-1920233364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:52:21 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-23de5b60-b6e6-4f5d-a137-f3e2cbea288b tempest-VolumeTypesAccessTest-1920233364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1510824115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b548cd1-79d2-4991-a700-872eee19b874,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59de1d486b3f425e8f12fe689096e98a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:52:21Z,use_quota=True,user_id='182d06ffdb1c464580757e4e1ce5fa02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e82ca903-e1f3-422c-ab89-8153f1028abb),volume_type_id=e82ca903-e1f3-422c-ab89-8153f1028abb)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:52:21 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-23de5b60-b6e6-4f5d-a137-f3e2cbea288b tempest-VolumeTypesAccessTest-1920233364 None] Creating volume 8b548cd1-79d2-4991-a700-872eee19b874 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:52:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-23de5b60-b6e6-4f5d-a137-f3e2cbea288b tempest-VolumeTypesAccessTest-1920233364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:52:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-23de5b60-b6e6-4f5d-a137-f3e2cbea288b tempest-VolumeTypesAccessTest-1920233364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:52:21 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-23de5b60-b6e6-4f5d-a137-f3e2cbea288b tempest-VolumeTypesAccessTest-1920233364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:52:21 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-23de5b60-b6e6-4f5d-a137-f3e2cbea288b tempest-VolumeTypesAccessTest-1920233364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:52:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-23de5b60-b6e6-4f5d-a137-f3e2cbea288b tempest-VolumeTypesAccessTest-1920233364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:52:21 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-23de5b60-b6e6-4f5d-a137-f3e2cbea288b tempest-VolumeTypesAccessTest-1920233364 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:52:21 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-23de5b60-b6e6-4f5d-a137-f3e2cbea288b tempest-VolumeTypesAccessTest-1920233364 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:52:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-23de5b60-b6e6-4f5d-a137-f3e2cbea288b tempest-VolumeTypesAccessTest-1920233364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b548cd1-79d2-4991-a700-872eee19b874 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:21 devstack sudo[102434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b548cd1-79d2-4991-a700-872eee19b874 1073741824 Jul 31 10:52:21 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:21 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b429196b-9072-49ce-b54e-9693a9fd5306_kxo3x19u" returned: 1 in 0.701s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b429196b-9072-49ce-b54e-9693a9fd5306_kxo3x19u' failed. Not Retrying. {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 10:52:21 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5b86a8-cd0d-4b7b-ba26-b9a7f17b7448]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:52:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306__emud229devstack@QuobyteHD {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:21 devstack sudo[102445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306__emud229devstack@QuobyteHD Jul 31 10:52:21 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:22 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-23de5b60-b6e6-4f5d-a137-f3e2cbea288b tempest-VolumeTypesAccessTest-1920233364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b548cd1-79d2-4991-a700-872eee19b874 1073741824" returned: 0 in 0.728s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-23de5b60-b6e6-4f5d-a137-f3e2cbea288b tempest-VolumeTypesAccessTest-1920233364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b548cd1-79d2-4991-a700-872eee19b874 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:22 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306__emud229devstack@QuobyteHD" returned: 0 in 0.559s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:22 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] b429196b-9072-49ce-b54e-9693a9fd5306 was qcow2, converting to qcow2 {{(pid=89090) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 10:52:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306__emud229devstack@QuobyteHD /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8c4dd065-1621-4cd9-b081-5223550da237 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:22 devstack sudo[102474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b548cd1-79d2-4991-a700-872eee19b874 Jul 31 10:52:22 devstack sudo[102474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:22 devstack sudo[102477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306__emud229devstack@QuobyteHD /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8c4dd065-1621-4cd9-b081-5223550da237 Jul 31 10:52:22 devstack sudo[102477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:22 devstack sudo[102474]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-23de5b60-b6e6-4f5d-a137-f3e2cbea288b tempest-VolumeTypesAccessTest-1920233364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b548cd1-79d2-4991-a700-872eee19b874" returned: 0 in 0.523s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:22 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-23de5b60-b6e6-4f5d-a137-f3e2cbea288b tempest-VolumeTypesAccessTest-1920233364 None] <== create_volume: return (1368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:52:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-23de5b60-b6e6-4f5d-a137-f3e2cbea288b tempest-VolumeTypesAccessTest-1920233364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.370s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:52:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-23de5b60-b6e6-4f5d-a137-f3e2cbea288b tempest-VolumeTypesAccessTest-1920233364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd317220-5f93-4218-a12f-674cac442bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b548cd1-79d2-4991-a700-872eee19b874', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-23de5b60-b6e6-4f5d-a137-f3e2cbea288b tempest-VolumeTypesAccessTest-1920233364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09f4b977-5070-4fc7-9857-85c31af6f5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:22 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-23de5b60-b6e6-4f5d-a137-f3e2cbea288b tempest-VolumeTypesAccessTest-1920233364 None] Volume volume-8b548cd1-79d2-4991-a700-872eee19b874 (8b548cd1-79d2-4991-a700-872eee19b874): created successfully Jul 31 10:52:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-23de5b60-b6e6-4f5d-a137-f3e2cbea288b tempest-VolumeTypesAccessTest-1920233364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09f4b977-5070-4fc7-9857-85c31af6f5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-23de5b60-b6e6-4f5d-a137-f3e2cbea288b tempest-VolumeTypesAccessTest-1920233364 None] Flow 'volume_create_manager' (b753eb6a-0613-485c-b688-d526b8b174ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:52:22 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-23de5b60-b6e6-4f5d-a137-f3e2cbea288b tempest-VolumeTypesAccessTest-1920233364 None] Created volume successfully. Jul 31 10:52:23 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ec77a33b-bde6-4085-82fe-45f61b8bec0f tempest-VolumeTypesAccessTest-1920233364 None] Acquiring lock "cinder-8b548cd1-79d2-4991-a700-872eee19b874-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:52:23 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ec77a33b-bde6-4085-82fe-45f61b8bec0f tempest-VolumeTypesAccessTest-1920233364 None] Lock "cinder-8b548cd1-79d2-4991-a700-872eee19b874-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:52:23 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ec77a33b-bde6-4085-82fe-45f61b8bec0f tempest-VolumeTypesAccessTest-1920233364 None] Acquiring lock "cinder-quobyte-8b548cd1-79d2-4991-a700-872eee19b874" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:52:23 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ec77a33b-bde6-4085-82fe-45f61b8bec0f tempest-VolumeTypesAccessTest-1920233364 None] Lock "cinder-quobyte-8b548cd1-79d2-4991-a700-872eee19b874" acquired by "delete_volume" :: waited 0.036s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:52:23 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce513cc-0511-4475-b639-923e60d98019]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:52:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ec77a33b-bde6-4085-82fe-45f61b8bec0f tempest-VolumeTypesAccessTest-1920233364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b548cd1-79d2-4991-a700-872eee19b874 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:24 devstack sudo[102488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b548cd1-79d2-4991-a700-872eee19b874 Jul 31 10:52:24 devstack sudo[102488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:24 devstack sudo[102488]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ec77a33b-bde6-4085-82fe-45f61b8bec0f tempest-VolumeTypesAccessTest-1920233364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b548cd1-79d2-4991-a700-872eee19b874" returned: 0 in 0.948s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ec77a33b-bde6-4085-82fe-45f61b8bec0f tempest-VolumeTypesAccessTest-1920233364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b548cd1-79d2-4991-a700-872eee19b874 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:24 devstack sudo[102493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b548cd1-79d2-4991-a700-872eee19b874 Jul 31 10:52:24 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:25 devstack sudo[102493]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ec77a33b-bde6-4085-82fe-45f61b8bec0f tempest-VolumeTypesAccessTest-1920233364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b548cd1-79d2-4991-a700-872eee19b874" returned: 0 in 0.552s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:25 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ec77a33b-bde6-4085-82fe-45f61b8bec0f tempest-VolumeTypesAccessTest-1920233364 None] Lock "cinder-quobyte-8b548cd1-79d2-4991-a700-872eee19b874" released by "delete_volume" :: held 1.603s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:52:25 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=48,cinder:UPDATE=48,cinder:DELETE=5,cinder:INSERT=15 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:52:25 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=52,cinder:UPDATE=51,cinder:INSERT=9,cinder:DELETE=4 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:52:25 devstack cinder-volume[89090]: WARNING cinder.quota [None req-ec77a33b-bde6-4085-82fe-45f61b8bec0f tempest-VolumeTypesAccessTest-1920233364 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1969816821 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1969816821, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:52:25 devstack cinder-volume[89090]: WARNING cinder.quota [None req-ec77a33b-bde6-4085-82fe-45f61b8bec0f tempest-VolumeTypesAccessTest-1920233364 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1969816821 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1969816821, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:52:25 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-ec77a33b-bde6-4085-82fe-45f61b8bec0f tempest-VolumeTypesAccessTest-1920233364 None] Created reservations ['24c5b57f-6168-4a4a-b757-fba248fc2086', '54350abd-c8a3-478c-8c5e-b0d6ee12bb60', '80c16fc9-887c-4bb6-9102-8bb5c14ede99', 'cb7e9e2a-f1b3-4372-b1e2-f578f64ee345'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:52:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ec77a33b-bde6-4085-82fe-45f61b8bec0f tempest-VolumeTypesAccessTest-1920233364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:52:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ec77a33b-bde6-4085-82fe-45f61b8bec0f tempest-VolumeTypesAccessTest-1920233364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:52:25 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ec77a33b-bde6-4085-82fe-45f61b8bec0f tempest-VolumeTypesAccessTest-1920233364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:52:25 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ec77a33b-bde6-4085-82fe-45f61b8bec0f tempest-VolumeTypesAccessTest-1920233364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:52:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ec77a33b-bde6-4085-82fe-45f61b8bec0f tempest-VolumeTypesAccessTest-1920233364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:52:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ec77a33b-bde6-4085-82fe-45f61b8bec0f tempest-VolumeTypesAccessTest-1920233364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:25 devstack sudo[102496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:52:25 devstack sudo[102496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:25 devstack sudo[102477]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306__emud229devstack@QuobyteHD /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8c4dd065-1621-4cd9-b081-5223550da237" returned: 0 in 3.661s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:25 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306__emud229devstack@QuobyteHD, size 112.00 MB, duration 3.66 sec, destination /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8c4dd065-1621-4cd9-b081-5223550da237 {{(pid=89090) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 10:52:25 devstack cinder-volume[89090]: INFO cinder.image.image_utils [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Converted 112.00 MB image at 30.57 MB/s Jul 31 10:52:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8c4dd065-1621-4cd9-b081-5223550da237 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:26 devstack sudo[102498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8c4dd065-1621-4cd9-b081-5223550da237 1G Jul 31 10:52:26 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:26 devstack sudo[102496]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ec77a33b-bde6-4085-82fe-45f61b8bec0f tempest-VolumeTypesAccessTest-1920233364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.556s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:26 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-ec77a33b-bde6-4085-82fe-45f61b8bec0f tempest-VolumeTypesAccessTest-1920233364 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:52:26 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-ec77a33b-bde6-4085-82fe-45f61b8bec0f tempest-VolumeTypesAccessTest-1920233364 None] Deleted volume successfully. Jul 31 10:52:26 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ec77a33b-bde6-4085-82fe-45f61b8bec0f tempest-VolumeTypesAccessTest-1920233364 None] Lock "cinder-8b548cd1-79d2-4991-a700-872eee19b874-delete_volume" released by "delete_volume" :: held 2.837s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:52:26 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8c4dd065-1621-4cd9-b081-5223550da237 1G" returned: 0 in 0.772s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:26 devstack cinder-volume[89090]: DEBUG cinder.volume.volume_utils [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Downloaded image b429196b-9072-49ce-b54e-9693a9fd5306 ((None, [{'url': 'file:///opt/stack/data/glance/images/b429196b-9072-49ce-b54e-9693a9fd5306', 'metadata': {}}])) to volume 8c4dd065-1621-4cd9-b081-5223550da237 successfully. {{(pid=89090) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 10:52:26 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Temporary image b429196b-9072-49ce-b54e-9693a9fd5306 for user 5f878b050f164dbd9f2e57c7b67937da is deleted. {{(pid=89090) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 10:52:26 devstack cinder-volume[89090]: DEBUG cinder.volume.volume_utils [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Marking volume 8c4dd065-1621-4cd9-b081-5223550da237 as bootable. {{(pid=89090) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 10:52:26 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Copying metadata from image b429196b-9072-49ce-b54e-9693a9fd5306 to 8c4dd065-1621-4cd9-b081-5223550da237. {{(pid=89090) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 10:52:26 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Creating volume glance metadata for volume 8c4dd065-1621-4cd9-b081-5223550da237 backed by image b429196b-9072-49ce-b54e-9693a9fd5306 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b429196b-9072-49ce-b54e-9693a9fd5306', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89090) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 10:52:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e14b5118-c3fd-4f1f-beb7-a9a32c56ad07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c4dd065-1621-4cd9-b081-5223550da237', 'volume_size': 1, 'image_id': 'b429196b-9072-49ce-b54e-9693a9fd5306', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b429196b-9072-49ce-b54e-9693a9fd5306', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c7e7a60bc5b640caa5ec5fc5df1bd573', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b429196b-9072-49ce-b54e-9693a9fd5306', 'created_at': datetime.datetime(2026, 7, 31, 8, 33, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 33, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b429196b-9072-49ce-b54e-9693a9fd5306/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ed735e7-e39c-4351-b58d-7e417a134750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:27 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Volume volume-8c4dd065-1621-4cd9-b081-5223550da237 (8c4dd065-1621-4cd9-b081-5223550da237): created successfully Jul 31 10:52:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ed735e7-e39c-4351-b58d-7e417a134750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Flow 'volume_create_manager' (d08b9cd6-cfef-4b88-b8cf-89385f4a9569) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:52:27 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-191a33e4-2028-409f-8955-81a77d4c7c97 tempest-TestShelveInstance-693135770 None] Created volume successfully. Jul 31 10:52:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-39f3d96b-4a6c-4f9a-9e03-872a90b201d7 req-19f52c02-fdea-4a78-8a58-be0a7c7cb1dd tempest-TestShelveInstance-693135770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:52:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-39f3d96b-4a6c-4f9a-9e03-872a90b201d7 req-19f52c02-fdea-4a78-8a58-be0a7c7cb1dd tempest-TestShelveInstance-693135770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:52:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-39f3d96b-4a6c-4f9a-9e03-872a90b201d7 req-19f52c02-fdea-4a78-8a58-be0a7c7cb1dd tempest-TestShelveInstance-693135770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.068s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:52:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-39f3d96b-4a6c-4f9a-9e03-872a90b201d7 req-19f52c02-fdea-4a78-8a58-be0a7c7cb1dd tempest-TestShelveInstance-693135770 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c', 'name': 'volume-8c4dd065-1621-4cd9-b081-5223550da237', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '087d18e7-b818-4e10-8f77-cdc1e90028fd', 'enforce_multipath': True} {{(pid=89090) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:52:36 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-39f3d96b-4a6c-4f9a-9e03-872a90b201d7 req-19f52c02-fdea-4a78-8a58-be0a7c7cb1dd tempest-TestShelveInstance-693135770 None] attachment_update completed successfully. Jul 31 10:52:45 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:52:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:52:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:52:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:52:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:52:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:52:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:46 devstack sudo[103089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:52:46 devstack sudo[103089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:46 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=17,cinder:INSERT=7,cinder:UPDATE=11 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:52:46 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:INSERT=9,cinder:UPDATE=11,cinder:SELECT=15,cinder:DELETE=2 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:52:46 devstack sudo[103089]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.833s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:46 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:52:46 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager._thread_info {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:52:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread count: 28 {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:52:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread info: [<_MainThread(MainThread, started 134005426110592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:52:49 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd64e64e-9bd0-456d-8818-3ab207322676 tempest-VolumesDeleteCascade-644998590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:52:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cd64e64e-9bd0-456d-8818-3ab207322676 tempest-VolumesDeleteCascade-644998590 None] Flow 'volume_create_manager' (55331bb3-1a61-40d5-8e36-cdc36872e8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:52:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cd64e64e-9bd0-456d-8818-3ab207322676 tempest-VolumesDeleteCascade-644998590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d94cdc8-0598-48b1-804c-8c394276c606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cd64e64e-9bd0-456d-8818-3ab207322676 tempest-VolumesDeleteCascade-644998590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d94cdc8-0598-48b1-804c-8c394276c606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-621561571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ea02cee7def4d1dbbb7d1131818ccf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:52:50Z,use_quota=True,user_id='ef8f5360df4f409fb83c3e9f5a54e1a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cd64e64e-9bd0-456d-8818-3ab207322676 tempest-VolumesDeleteCascade-644998590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9400d250-ca75-40a1-9098-d6d01658e188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cd64e64e-9bd0-456d-8818-3ab207322676 tempest-VolumesDeleteCascade-644998590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9400d250-ca75-40a1-9098-d6d01658e188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cd64e64e-9bd0-456d-8818-3ab207322676 tempest-VolumesDeleteCascade-644998590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d6c46f-8a16-417b-ac57-4d10e51331b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cd64e64e-9bd0-456d-8818-3ab207322676 tempest-VolumesDeleteCascade-644998590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d6c46f-8a16-417b-ac57-4d10e51331b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431', 'volume_name': 'volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cd64e64e-9bd0-456d-8818-3ab207322676 tempest-VolumesDeleteCascade-644998590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d0046de-91d5-49bc-b0f9-115957136ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cd64e64e-9bd0-456d-8818-3ab207322676 tempest-VolumesDeleteCascade-644998590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d0046de-91d5-49bc-b0f9-115957136ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cd64e64e-9bd0-456d-8818-3ab207322676 tempest-VolumesDeleteCascade-644998590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4886f22-51e7-465c-ac4d-b86168664df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:50 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-cd64e64e-9bd0-456d-8818-3ab207322676 tempest-VolumesDeleteCascade-644998590 None] Volume 8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431', 'volume_size': 1} Jul 31 10:52:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-cd64e64e-9bd0-456d-8818-3ab207322676 tempest-VolumesDeleteCascade-644998590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:52:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-cd64e64e-9bd0-456d-8818-3ab207322676 tempest-VolumesDeleteCascade-644998590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:52:50 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-cd64e64e-9bd0-456d-8818-3ab207322676 tempest-VolumesDeleteCascade-644998590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-621561571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ea02cee7def4d1dbbb7d1131818ccf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:52:50Z,use_quota=True,user_id='ef8f5360df4f409fb83c3e9f5a54e1a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:52:50 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-cd64e64e-9bd0-456d-8818-3ab207322676 tempest-VolumesDeleteCascade-644998590 None] Creating volume 8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:52:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-cd64e64e-9bd0-456d-8818-3ab207322676 tempest-VolumesDeleteCascade-644998590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:52:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-cd64e64e-9bd0-456d-8818-3ab207322676 tempest-VolumesDeleteCascade-644998590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:52:50 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-cd64e64e-9bd0-456d-8818-3ab207322676 tempest-VolumesDeleteCascade-644998590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:52:50 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-cd64e64e-9bd0-456d-8818-3ab207322676 tempest-VolumesDeleteCascade-644998590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:52:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-cd64e64e-9bd0-456d-8818-3ab207322676 tempest-VolumesDeleteCascade-644998590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:52:50 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-cd64e64e-9bd0-456d-8818-3ab207322676 tempest-VolumesDeleteCascade-644998590 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:52:50 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-cd64e64e-9bd0-456d-8818-3ab207322676 tempest-VolumesDeleteCascade-644998590 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:52:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-cd64e64e-9bd0-456d-8818-3ab207322676 tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:50 devstack sudo[103093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431 1073741824 Jul 31 10:52:50 devstack sudo[103093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:51 devstack sudo[103093]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-cd64e64e-9bd0-456d-8818-3ab207322676 tempest-VolumesDeleteCascade-644998590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431 1073741824" returned: 0 in 1.075s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-cd64e64e-9bd0-456d-8818-3ab207322676 tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:51 devstack sudo[103099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431 Jul 31 10:52:51 devstack sudo[103099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:52 devstack sudo[103099]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-cd64e64e-9bd0-456d-8818-3ab207322676 tempest-VolumesDeleteCascade-644998590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431" returned: 0 in 0.696s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:52 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-cd64e64e-9bd0-456d-8818-3ab207322676 tempest-VolumesDeleteCascade-644998590 None] <== create_volume: return (1909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:52:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-cd64e64e-9bd0-456d-8818-3ab207322676 tempest-VolumesDeleteCascade-644998590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.913s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:52:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cd64e64e-9bd0-456d-8818-3ab207322676 tempest-VolumesDeleteCascade-644998590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4886f22-51e7-465c-ac4d-b86168664df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cd64e64e-9bd0-456d-8818-3ab207322676 tempest-VolumesDeleteCascade-644998590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ddfbb48-d648-4034-8b71-03420fc9b268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:52 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-cd64e64e-9bd0-456d-8818-3ab207322676 tempest-VolumesDeleteCascade-644998590 None] Volume volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431 (8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431): created successfully Jul 31 10:52:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cd64e64e-9bd0-456d-8818-3ab207322676 tempest-VolumesDeleteCascade-644998590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ddfbb48-d648-4034-8b71-03420fc9b268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cd64e64e-9bd0-456d-8818-3ab207322676 tempest-VolumesDeleteCascade-644998590 None] Flow 'volume_create_manager' (55331bb3-1a61-40d5-8e36-cdc36872e8c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:52:52 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-cd64e64e-9bd0-456d-8818-3ab207322676 tempest-VolumesDeleteCascade-644998590 None] Created volume successfully. Jul 31 10:52:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e6d5347e-04b6-4024-9c01-da2a511e8304 tempest-VolumesDeleteCascade-644998590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:52:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e6d5347e-04b6-4024-9c01-da2a511e8304 tempest-VolumesDeleteCascade-644998590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:52:54 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-e6d5347e-04b6-4024-9c01-da2a511e8304 tempest-VolumesDeleteCascade-644998590 None] Creating offline snapshot 335ff287-bd2e-4bb2-941b-5e181567b63e of volume 8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431 {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:52:54 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[583ed3de-524f-44a7-bb26-dc6965964bdc]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:52:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e6d5347e-04b6-4024-9c01-da2a511e8304 tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:54 devstack sudo[103111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431 Jul 31 10:52:54 devstack sudo[103111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-d13f67fc-15a9-4d0c-a91a-72dc90d06905 req-2b857798-1b49-4a67-a008-05397dac6d00 tempest-TestStampPattern-862817097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:52:55 devstack sudo[103111]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e6d5347e-04b6-4024-9c01-da2a511e8304 tempest-VolumesDeleteCascade-644998590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431" returned: 0 in 1.078s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e6d5347e-04b6-4024-9c01-da2a511e8304 tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.335ff287-bd2e-4bb2-941b-5e181567b63e 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:55 devstack sudo[103125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.335ff287-bd2e-4bb2-941b-5e181567b63e 1G Jul 31 10:52:55 devstack sudo[103125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:55 devstack sudo[103125]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e6d5347e-04b6-4024-9c01-da2a511e8304 tempest-VolumesDeleteCascade-644998590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.335ff287-bd2e-4bb2-941b-5e181567b63e 1G" returned: 0 in 0.645s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e6d5347e-04b6-4024-9c01-da2a511e8304 tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.335ff287-bd2e-4bb2-941b-5e181567b63e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:55 devstack sudo[103132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.335ff287-bd2e-4bb2-941b-5e181567b63e Jul 31 10:52:55 devstack sudo[103132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:56 devstack sudo[103132]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e6d5347e-04b6-4024-9c01-da2a511e8304 tempest-VolumesDeleteCascade-644998590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.335ff287-bd2e-4bb2-941b-5e181567b63e" returned: 0 in 0.498s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:56 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-e6d5347e-04b6-4024-9c01-da2a511e8304 tempest-VolumesDeleteCascade-644998590 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.335ff287-bd2e-4bb2-941b-5e181567b63e is being set with open permissions: ugo+rw Jul 31 10:52:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e6d5347e-04b6-4024-9c01-da2a511e8304 tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.335ff287-bd2e-4bb2-941b-5e181567b63e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:56 devstack sudo[103137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.335ff287-bd2e-4bb2-941b-5e181567b63e Jul 31 10:52:56 devstack sudo[103137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:56 devstack sudo[103137]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e6d5347e-04b6-4024-9c01-da2a511e8304 tempest-VolumesDeleteCascade-644998590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.335ff287-bd2e-4bb2-941b-5e181567b63e" returned: 0 in 0.374s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e6d5347e-04b6-4024-9c01-da2a511e8304 tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:56 devstack sudo[103140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.info Jul 31 10:52:56 devstack sudo[103140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:57 devstack sudo[103140]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e6d5347e-04b6-4024-9c01-da2a511e8304 tempest-VolumesDeleteCascade-644998590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.info" returned: 0 in 0.293s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:57 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-e6d5347e-04b6-4024-9c01-da2a511e8304 tempest-VolumesDeleteCascade-644998590 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.info is being set with open permissions: ugo+rw Jul 31 10:52:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e6d5347e-04b6-4024-9c01-da2a511e8304 tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:57 devstack sudo[103143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.info Jul 31 10:52:57 devstack sudo[103143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:57 devstack sudo[103143]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e6d5347e-04b6-4024-9c01-da2a511e8304 tempest-VolumesDeleteCascade-644998590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.info" returned: 0 in 0.297s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e6d5347e-04b6-4024-9c01-da2a511e8304 tempest-VolumesDeleteCascade-644998590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.380s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:52:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-d13f67fc-15a9-4d0c-a91a-72dc90d06905 req-2b857798-1b49-4a67-a008-05397dac6d00 tempest-TestStampPattern-862817097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.624s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:52:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-d13f67fc-15a9-4d0c-a91a-72dc90d06905 req-2b857798-1b49-4a67-a008-05397dac6d00 tempest-TestStampPattern-862817097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:52:57 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-e6d5347e-04b6-4024-9c01-da2a511e8304 tempest-VolumesDeleteCascade-644998590 None] Create snapshot completed successfully Jul 31 10:52:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-d13f67fc-15a9-4d0c-a91a-72dc90d06905 req-2b857798-1b49-4a67-a008-05397dac6d00 tempest-TestStampPattern-862817097 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c', 'name': 'volume-6e6d588e-9be7-4897-937b-a42c7340b620', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bc087350-99cb-47a4-99d9-d472ef50eb5a', 'enforce_multipath': True} {{(pid=89090) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:52:57 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-d13f67fc-15a9-4d0c-a91a-72dc90d06905 req-2b857798-1b49-4a67-a008-05397dac6d00 tempest-TestStampPattern-862817097 None] attachment_update completed successfully. Jul 31 10:52:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-5791ca53-bed1-43c5-b9e6-830b90d644fa tempest-VolumesDeleteCascade-644998590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:52:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-5791ca53-bed1-43c5-b9e6-830b90d644fa tempest-VolumesDeleteCascade-644998590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:52:58 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-5791ca53-bed1-43c5-b9e6-830b90d644fa tempest-VolumesDeleteCascade-644998590 None] Creating offline snapshot c3788c74-2e40-40de-b7d1-ed946d5551b3 of volume 8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431 {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:52:58 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb8af26-0df0-4237-9da5-8dc59c5f6a2f]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:52:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5791ca53-bed1-43c5-b9e6-830b90d644fa tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.335ff287-bd2e-4bb2-941b-5e181567b63e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:58 devstack sudo[103152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.335ff287-bd2e-4bb2-941b-5e181567b63e Jul 31 10:52:58 devstack sudo[103152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:59 devstack sudo[103152]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5791ca53-bed1-43c5-b9e6-830b90d644fa tempest-VolumesDeleteCascade-644998590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.335ff287-bd2e-4bb2-941b-5e181567b63e" returned: 0 in 0.482s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:59 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-5791ca53-bed1-43c5-b9e6-830b90d644fa tempest-VolumesDeleteCascade-644998590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:52:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5791ca53-bed1-43c5-b9e6-830b90d644fa tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.335ff287-bd2e-4bb2-941b-5e181567b63e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.c3788c74-2e40-40de-b7d1-ed946d5551b3 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:59 devstack sudo[103167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.335ff287-bd2e-4bb2-941b-5e181567b63e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.c3788c74-2e40-40de-b7d1-ed946d5551b3 1G Jul 31 10:52:59 devstack sudo[103167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:59 devstack sudo[103167]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5791ca53-bed1-43c5-b9e6-830b90d644fa tempest-VolumesDeleteCascade-644998590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.335ff287-bd2e-4bb2-941b-5e181567b63e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.c3788c74-2e40-40de-b7d1-ed946d5551b3 1G" returned: 0 in 0.599s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5791ca53-bed1-43c5-b9e6-830b90d644fa tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.335ff287-bd2e-4bb2-941b-5e181567b63e -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.c3788c74-2e40-40de-b7d1-ed946d5551b3 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:59 devstack sudo[103179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.335ff287-bd2e-4bb2-941b-5e181567b63e -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.c3788c74-2e40-40de-b7d1-ed946d5551b3 Jul 31 10:52:59 devstack sudo[103179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:00 devstack sudo[103179]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5791ca53-bed1-43c5-b9e6-830b90d644fa tempest-VolumesDeleteCascade-644998590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.335ff287-bd2e-4bb2-941b-5e181567b63e -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.c3788c74-2e40-40de-b7d1-ed946d5551b3" returned: 0 in 0.504s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:00 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-5791ca53-bed1-43c5-b9e6-830b90d644fa tempest-VolumesDeleteCascade-644998590 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.c3788c74-2e40-40de-b7d1-ed946d5551b3 is being set with open permissions: ugo+rw Jul 31 10:53:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5791ca53-bed1-43c5-b9e6-830b90d644fa tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.c3788c74-2e40-40de-b7d1-ed946d5551b3 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:00 devstack sudo[103184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.c3788c74-2e40-40de-b7d1-ed946d5551b3 Jul 31 10:53:00 devstack sudo[103184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:00 devstack sudo[103184]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5791ca53-bed1-43c5-b9e6-830b90d644fa tempest-VolumesDeleteCascade-644998590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.c3788c74-2e40-40de-b7d1-ed946d5551b3" returned: 0 in 0.362s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-5791ca53-bed1-43c5-b9e6-830b90d644fa tempest-VolumesDeleteCascade-644998590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.124s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:00 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-5791ca53-bed1-43c5-b9e6-830b90d644fa tempest-VolumesDeleteCascade-644998590 None] Create snapshot completed successfully Jul 31 10:53:01 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-6c15608a-e1ba-49d8-a80f-be22ba0ce77a req-5d9e56f7-6fb0-4e0c-be96-56cfcd803517 tempest-TestStampPattern-862817097 None] Terminate volume connection completed successfully. Jul 31 10:53:01 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-6c15608a-e1ba-49d8-a80f-be22ba0ce77a req-5d9e56f7-6fb0-4e0c-be96-56cfcd803517 tempest-TestStampPattern-862817097 None] Deleting attachment bc087350-99cb-47a4-99d9-d472ef50eb5a. {{(pid=89090) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:53:01 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Acquiring lock "cinder-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:53:02 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Lock "cinder-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:53:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Performing cascade delete. {{(pid=89090) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 31 10:53:02 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Acquiring lock "cinder-335ff287-bd2e-4bb2-941b-5e181567b63e-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:53:02 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Lock "cinder-335ff287-bd2e-4bb2-941b-5e181567b63e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:53:02 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Acquiring lock "cinder-quobyte-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:53:02 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Lock "cinder-quobyte-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431" acquired by "delete_snapshot" :: waited 0.023s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:53:02 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Acquiring lock "cinder-quobyte-335ff287-bd2e-4bb2-941b-5e181567b63e" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:53:02 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Lock "cinder-quobyte-335ff287-bd2e-4bb2-941b-5e181567b63e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:53:02 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Deleting offline snapshot 335ff287-bd2e-4bb2-941b-5e181567b63e of volume 8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:53:02 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] snapshot_file for this snap is: volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.335ff287-bd2e-4bb2-941b-5e181567b63e {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:53:02 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae399ae9-6c35-494a-9f9a-ca708f13704e]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:53:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.335ff287-bd2e-4bb2-941b-5e181567b63e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:02 devstack sudo[103239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.335ff287-bd2e-4bb2-941b-5e181567b63e Jul 31 10:53:02 devstack sudo[103239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:02 devstack sudo[103239]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.335ff287-bd2e-4bb2-941b-5e181567b63e" returned: 0 in 0.578s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:02 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:53:02 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[a296cabf-823f-407c-a679-21707788a104]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:53:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:03 devstack sudo[103246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431 Jul 31 10:53:03 devstack sudo[103246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:03 devstack sudo[103246]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431" returned: 0 in 0.661s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:03 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[9855024f-74e5-4513-afa3-c674003ea2f1]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:53:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.c3788c74-2e40-40de-b7d1-ed946d5551b3 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:03 devstack sudo[103260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.c3788c74-2e40-40de-b7d1-ed946d5551b3 Jul 31 10:53:03 devstack sudo[103260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:04 devstack sudo[103260]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.c3788c74-2e40-40de-b7d1-ed946d5551b3" returned: 0 in 0.802s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:53:04 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d30c11e-d55e-41b2-a477-5fdd6805509d]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:53:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.335ff287-bd2e-4bb2-941b-5e181567b63e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:04 devstack sudo[103284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.335ff287-bd2e-4bb2-941b-5e181567b63e Jul 31 10:53:04 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:05 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.335ff287-bd2e-4bb2-941b-5e181567b63e" returned: 0 in 0.598s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:05 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:53:05 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f220b3e-7862-433e-a351-548456cd8589]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:53:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:05 devstack sudo[103292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431 Jul 31 10:53:05 devstack sudo[103292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:05 devstack sudo[103292]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431" returned: 0 in 0.550s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.335ff287-bd2e-4bb2-941b-5e181567b63e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:05 devstack sudo[103298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.335ff287-bd2e-4bb2-941b-5e181567b63e Jul 31 10:53:05 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:06 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.335ff287-bd2e-4bb2-941b-5e181567b63e" returned: 0 in 0.600s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.335ff287-bd2e-4bb2-941b-5e181567b63e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:06 devstack sudo[103305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.335ff287-bd2e-4bb2-941b-5e181567b63e Jul 31 10:53:06 devstack sudo[103305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:06 devstack sudo[103305]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.335ff287-bd2e-4bb2-941b-5e181567b63e" returned: 0 in 0.352s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.c3788c74-2e40-40de-b7d1-ed946d5551b3 -F qcow2 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:06 devstack sudo[103308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.c3788c74-2e40-40de-b7d1-ed946d5551b3 -F qcow2 Jul 31 10:53:06 devstack sudo[103308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:06 devstack sudo[103308]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.c3788c74-2e40-40de-b7d1-ed946d5551b3 -F qcow2" returned: 0 in 0.412s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:07 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Lock "cinder-quobyte-335ff287-bd2e-4bb2-941b-5e181567b63e" released by "_delete_snapshot" :: held 4.873s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:53:07 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Lock "cinder-quobyte-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431" released by "delete_snapshot" :: held 4.900s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:53:07 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Created reservations ['a9587cdf-d3c2-4f5c-abd6-f1e6b18195fc', '2bef3f92-588e-4063-b761-dff6fcdf6b52', '97790d4c-d5af-4a2d-9ad6-0f0b729eae00', 'fe9608ae-fcec-4cec-a96d-a6ceee9ae946'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:53:07 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Delete snapshot completed successfully. Jul 31 10:53:07 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Lock "cinder-335ff287-bd2e-4bb2-941b-5e181567b63e-delete_snapshot" released by "delete_snapshot" :: held 5.129s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:53:07 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Acquiring lock "cinder-c3788c74-2e40-40de-b7d1-ed946d5551b3-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:53:07 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Lock "cinder-c3788c74-2e40-40de-b7d1-ed946d5551b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:53:07 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Acquiring lock "cinder-quobyte-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:53:07 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Lock "cinder-quobyte-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431" acquired by "delete_snapshot" :: waited 0.028s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:53:07 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Acquiring lock "cinder-quobyte-c3788c74-2e40-40de-b7d1-ed946d5551b3" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:53:07 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Lock "cinder-quobyte-c3788c74-2e40-40de-b7d1-ed946d5551b3" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:53:07 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Deleting offline snapshot c3788c74-2e40-40de-b7d1-ed946d5551b3 of volume 8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:53:07 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] snapshot_file for this snap is: volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.c3788c74-2e40-40de-b7d1-ed946d5551b3 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:53:07 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bcc353-936b-415d-a1b5-7485125e179b]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:53:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.c3788c74-2e40-40de-b7d1-ed946d5551b3 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:07 devstack sudo[103362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.c3788c74-2e40-40de-b7d1-ed946d5551b3 Jul 31 10:53:07 devstack sudo[103362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:07 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-629872a9-a1a8-40d3-99ff-da7f11922390 tempest-TestStampPattern-862817097 None] Acquiring lock "cinder-6e6d588e-9be7-4897-937b-a42c7340b620-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:53:07 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-629872a9-a1a8-40d3-99ff-da7f11922390 tempest-TestStampPattern-862817097 None] Lock "cinder-6e6d588e-9be7-4897-937b-a42c7340b620-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:53:07 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-629872a9-a1a8-40d3-99ff-da7f11922390 tempest-TestStampPattern-862817097 None] Acquiring lock "cinder-quobyte-6e6d588e-9be7-4897-937b-a42c7340b620" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:53:07 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-629872a9-a1a8-40d3-99ff-da7f11922390 tempest-TestStampPattern-862817097 None] Lock "cinder-quobyte-6e6d588e-9be7-4897-937b-a42c7340b620" acquired by "delete_volume" :: waited 0.026s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:53:07 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca9aca1-32bb-46f5-bcb3-95dfca8d08aa]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:53:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-629872a9-a1a8-40d3-99ff-da7f11922390 tempest-TestStampPattern-862817097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6e6d588e-9be7-4897-937b-a42c7340b620 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:08 devstack sudo[103374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6e6d588e-9be7-4897-937b-a42c7340b620 Jul 31 10:53:08 devstack sudo[103374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:08 devstack sudo[103362]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.c3788c74-2e40-40de-b7d1-ed946d5551b3" returned: 0 in 0.736s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:08 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:53:08 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e347ef2-7d1e-453a-b4be-c9aab1915300]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:53:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:08 devstack sudo[103383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431 Jul 31 10:53:08 devstack sudo[103383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:08 devstack sudo[103374]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-629872a9-a1a8-40d3-99ff-da7f11922390 tempest-TestStampPattern-862817097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6e6d588e-9be7-4897-937b-a42c7340b620" returned: 0 in 0.492s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-629872a9-a1a8-40d3-99ff-da7f11922390 tempest-TestStampPattern-862817097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6e6d588e-9be7-4897-937b-a42c7340b620 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:08 devstack sudo[103391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6e6d588e-9be7-4897-937b-a42c7340b620 Jul 31 10:53:08 devstack sudo[103391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:08 devstack sudo[103383]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431" returned: 0 in 0.562s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.c3788c74-2e40-40de-b7d1-ed946d5551b3 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:08 devstack sudo[103391]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-629872a9-a1a8-40d3-99ff-da7f11922390 tempest-TestStampPattern-862817097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6e6d588e-9be7-4897-937b-a42c7340b620" returned: 0 in 0.392s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:08 devstack sudo[103397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.c3788c74-2e40-40de-b7d1-ed946d5551b3 Jul 31 10:53:08 devstack sudo[103397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:08 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-629872a9-a1a8-40d3-99ff-da7f11922390 tempest-TestStampPattern-862817097 None] Lock "cinder-quobyte-6e6d588e-9be7-4897-937b-a42c7340b620" released by "delete_volume" :: held 0.975s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:53:08 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-629872a9-a1a8-40d3-99ff-da7f11922390 tempest-TestStampPattern-862817097 None] Created reservations ['b3c7dac7-64e8-46ef-8c27-187f2b1a7d3a', '75ccda0d-4128-441e-b3c3-0f7e7d9fcb1e', '6047e63c-45ad-4c4a-a899-3006f7887a87', 'e62ba0ff-00af-4170-891b-00d95eb65d2c'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:53:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-629872a9-a1a8-40d3-99ff-da7f11922390 tempest-TestStampPattern-862817097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-629872a9-a1a8-40d3-99ff-da7f11922390 tempest-TestStampPattern-862817097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:09 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-629872a9-a1a8-40d3-99ff-da7f11922390 tempest-TestStampPattern-862817097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:53:09 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-629872a9-a1a8-40d3-99ff-da7f11922390 tempest-TestStampPattern-862817097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:53:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-629872a9-a1a8-40d3-99ff-da7f11922390 tempest-TestStampPattern-862817097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-629872a9-a1a8-40d3-99ff-da7f11922390 tempest-TestStampPattern-862817097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:09 devstack sudo[103399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:53:09 devstack sudo[103399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:09 devstack sudo[103397]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.c3788c74-2e40-40de-b7d1-ed946d5551b3" returned: 0 in 0.521s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.c3788c74-2e40-40de-b7d1-ed946d5551b3 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:09 devstack sudo[103405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.c3788c74-2e40-40de-b7d1-ed946d5551b3 Jul 31 10:53:09 devstack sudo[103405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:09 devstack sudo[103399]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-629872a9-a1a8-40d3-99ff-da7f11922390 tempest-TestStampPattern-862817097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.322s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:09 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-629872a9-a1a8-40d3-99ff-da7f11922390 tempest-TestStampPattern-862817097 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:53:09 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-629872a9-a1a8-40d3-99ff-da7f11922390 tempest-TestStampPattern-862817097 None] Deleted volume successfully. Jul 31 10:53:09 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-629872a9-a1a8-40d3-99ff-da7f11922390 tempest-TestStampPattern-862817097 None] Lock "cinder-6e6d588e-9be7-4897-937b-a42c7340b620-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:53:09 devstack sudo[103405]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431.c3788c74-2e40-40de-b7d1-ed946d5551b3" returned: 0 in 0.278s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:09 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Lock "cinder-quobyte-c3788c74-2e40-40de-b7d1-ed946d5551b3" released by "_delete_snapshot" :: held 2.250s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:53:09 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Lock "cinder-quobyte-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431" released by "delete_snapshot" :: held 2.290s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:53:09 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Created reservations ['0e0c2ce1-33d1-4d69-bf71-15e4d2c9a1ff', '00104ba0-529a-4f29-b908-399ad79e7a67', 'd1172e7b-ac55-48dd-936b-5037f5a240f5', '7030a2a4-423e-44c6-9a00-9f7f7b06f309'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:53:09 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Delete snapshot completed successfully. Jul 31 10:53:09 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Lock "cinder-c3788c74-2e40-40de-b7d1-ed946d5551b3-delete_snapshot" released by "delete_snapshot" :: held 2.511s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:53:09 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Snapshots deleted, issuing volume delete {{(pid=89090) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 31 10:53:09 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Acquiring lock "cinder-quobyte-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:53:09 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Lock "cinder-quobyte-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431" acquired by "delete_volume" :: waited 0.016s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:53:09 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ac7865-1f4b-413e-9237-ce13f302d88e]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:53:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:09 devstack sudo[103409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431 Jul 31 10:53:09 devstack sudo[103409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:10 devstack sudo[103409]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431" returned: 0 in 0.461s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:10 devstack sudo[103414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431 Jul 31 10:53:10 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e53652fb-1eaa-43f2-82f5-5838dccfa495 tempest-TestStampPattern-862817097 None] Acquiring lock "cinder-40cee1b8-ac13-4e92-89ab-5c914968c66a-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:53:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e53652fb-1eaa-43f2-82f5-5838dccfa495 tempest-TestStampPattern-862817097 None] Lock "cinder-40cee1b8-ac13-4e92-89ab-5c914968c66a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:53:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e53652fb-1eaa-43f2-82f5-5838dccfa495 tempest-TestStampPattern-862817097 None] Acquiring lock "cinder-quobyte-fd9a48ef-b8f0-44b8-b07e-dde0069cc670" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:53:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e53652fb-1eaa-43f2-82f5-5838dccfa495 tempest-TestStampPattern-862817097 None] Lock "cinder-quobyte-fd9a48ef-b8f0-44b8-b07e-dde0069cc670" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:53:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e53652fb-1eaa-43f2-82f5-5838dccfa495 tempest-TestStampPattern-862817097 None] Acquiring lock "cinder-quobyte-40cee1b8-ac13-4e92-89ab-5c914968c66a" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:53:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e53652fb-1eaa-43f2-82f5-5838dccfa495 tempest-TestStampPattern-862817097 None] Lock "cinder-quobyte-40cee1b8-ac13-4e92-89ab-5c914968c66a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:53:10 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-e53652fb-1eaa-43f2-82f5-5838dccfa495 tempest-TestStampPattern-862817097 None] Deleting offline snapshot 40cee1b8-ac13-4e92-89ab-5c914968c66a of volume fd9a48ef-b8f0-44b8-b07e-dde0069cc670 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:53:10 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-e53652fb-1eaa-43f2-82f5-5838dccfa495 tempest-TestStampPattern-862817097 None] snapshot_file for this snap is: volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670.40cee1b8-ac13-4e92-89ab-5c914968c66a {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:53:10 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfb378f-b4fa-4b51-a48d-0de3cc1647a9]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:53:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e53652fb-1eaa-43f2-82f5-5838dccfa495 tempest-TestStampPattern-862817097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670.40cee1b8-ac13-4e92-89ab-5c914968c66a {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:10 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431" returned: 0 in 0.294s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Lock "cinder-quobyte-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431" released by "delete_volume" :: held 0.822s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:53:10 devstack sudo[103416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670.40cee1b8-ac13-4e92-89ab-5c914968c66a Jul 31 10:53:10 devstack sudo[103416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:10 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Created reservations ['502faad4-5bc8-4920-a899-7747f1f967af', 'eafc9c8a-edff-41d5-81ae-d3b0833c22f4', '06eaaae6-d883-4e98-ab48-5f95d5618f9e', 'e4f19e5e-82e9-4c0f-b1f3-e69b8327f6b0'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:53:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:10 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:53:10 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:53:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:10 devstack sudo[103419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:53:10 devstack sudo[103419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:10 devstack sudo[103416]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e53652fb-1eaa-43f2-82f5-5838dccfa495 tempest-TestStampPattern-862817097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670.40cee1b8-ac13-4e92-89ab-5c914968c66a" returned: 0 in 0.446s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:10 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-e53652fb-1eaa-43f2-82f5-5838dccfa495 tempest-TestStampPattern-862817097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:53:11 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c751a0-31c3-4002-8439-d85524192f9e]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:53:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e53652fb-1eaa-43f2-82f5-5838dccfa495 tempest-TestStampPattern-862817097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:11 devstack sudo[103419]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.319s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:11 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:53:11 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Deleted volume successfully. Jul 31 10:53:11 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9368bf14-4feb-429c-870f-965678c6d861 tempest-VolumesDeleteCascade-644998590 None] Lock "cinder-8b6dfdb8-6c36-43ba-a46a-4e2f3f6ed431-delete_volume" released by "delete_volume" :: held 9.112s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:53:11 devstack sudo[103425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670 Jul 31 10:53:11 devstack sudo[103425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:11 devstack sudo[103425]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e53652fb-1eaa-43f2-82f5-5838dccfa495 tempest-TestStampPattern-862817097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670" returned: 0 in 0.699s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e53652fb-1eaa-43f2-82f5-5838dccfa495 tempest-TestStampPattern-862817097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670.40cee1b8-ac13-4e92-89ab-5c914968c66a {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:11 devstack sudo[103436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670.40cee1b8-ac13-4e92-89ab-5c914968c66a Jul 31 10:53:11 devstack sudo[103436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:11 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-c621d608-a1b5-4dc8-90b2-421ed1649e0d tempest-VolumesDeleteCascade-644998590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:53:11 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c621d608-a1b5-4dc8-90b2-421ed1649e0d tempest-VolumesDeleteCascade-644998590 None] Flow 'volume_create_manager' (51b55833-a9c7-40ce-a0e2-5e2d86a1a7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:53:11 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c621d608-a1b5-4dc8-90b2-421ed1649e0d tempest-VolumesDeleteCascade-644998590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (003fc81d-cb1b-44b7-b634-716616b089e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:11 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c621d608-a1b5-4dc8-90b2-421ed1649e0d tempest-VolumesDeleteCascade-644998590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (003fc81d-cb1b-44b7-b634-716616b089e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-250189143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2191b2b-5a43-4c33-b850-9ecef31761be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ea02cee7def4d1dbbb7d1131818ccf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:53:12Z,use_quota=True,user_id='ef8f5360df4f409fb83c3e9f5a54e1a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:11 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c621d608-a1b5-4dc8-90b2-421ed1649e0d tempest-VolumesDeleteCascade-644998590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56a936ac-19f0-402c-8075-fad3b5e18a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:11 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c621d608-a1b5-4dc8-90b2-421ed1649e0d tempest-VolumesDeleteCascade-644998590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56a936ac-19f0-402c-8075-fad3b5e18a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:11 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c621d608-a1b5-4dc8-90b2-421ed1649e0d tempest-VolumesDeleteCascade-644998590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (815a6288-5e53-410f-bb04-ab828eea25e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:11 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c621d608-a1b5-4dc8-90b2-421ed1649e0d tempest-VolumesDeleteCascade-644998590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (815a6288-5e53-410f-bb04-ab828eea25e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2191b2b-5a43-4c33-b850-9ecef31761be', 'volume_name': 'volume-c2191b2b-5a43-4c33-b850-9ecef31761be', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:11 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c621d608-a1b5-4dc8-90b2-421ed1649e0d tempest-VolumesDeleteCascade-644998590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a205f862-fcc9-4287-812c-d9147fbd58d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:11 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c621d608-a1b5-4dc8-90b2-421ed1649e0d tempest-VolumesDeleteCascade-644998590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a205f862-fcc9-4287-812c-d9147fbd58d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:11 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c621d608-a1b5-4dc8-90b2-421ed1649e0d tempest-VolumesDeleteCascade-644998590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dab1635-0ef4-4e29-b45b-4de7bb6ae4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:11 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-c621d608-a1b5-4dc8-90b2-421ed1649e0d tempest-VolumesDeleteCascade-644998590 None] Volume c2191b2b-5a43-4c33-b850-9ecef31761be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2191b2b-5a43-4c33-b850-9ecef31761be', 'volume_size': 1} Jul 31 10:53:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c621d608-a1b5-4dc8-90b2-421ed1649e0d tempest-VolumesDeleteCascade-644998590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c621d608-a1b5-4dc8-90b2-421ed1649e0d tempest-VolumesDeleteCascade-644998590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:11 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c621d608-a1b5-4dc8-90b2-421ed1649e0d tempest-VolumesDeleteCascade-644998590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-250189143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2191b2b-5a43-4c33-b850-9ecef31761be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ea02cee7def4d1dbbb7d1131818ccf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:53:12Z,use_quota=True,user_id='ef8f5360df4f409fb83c3e9f5a54e1a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:53:11 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-c621d608-a1b5-4dc8-90b2-421ed1649e0d tempest-VolumesDeleteCascade-644998590 None] Creating volume c2191b2b-5a43-4c33-b850-9ecef31761be {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:53:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c621d608-a1b5-4dc8-90b2-421ed1649e0d tempest-VolumesDeleteCascade-644998590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c621d608-a1b5-4dc8-90b2-421ed1649e0d tempest-VolumesDeleteCascade-644998590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:11 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c621d608-a1b5-4dc8-90b2-421ed1649e0d tempest-VolumesDeleteCascade-644998590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:53:11 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c621d608-a1b5-4dc8-90b2-421ed1649e0d tempest-VolumesDeleteCascade-644998590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:53:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c621d608-a1b5-4dc8-90b2-421ed1649e0d tempest-VolumesDeleteCascade-644998590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:11 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c621d608-a1b5-4dc8-90b2-421ed1649e0d tempest-VolumesDeleteCascade-644998590 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:53:11 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-c621d608-a1b5-4dc8-90b2-421ed1649e0d tempest-VolumesDeleteCascade-644998590 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:53:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c621d608-a1b5-4dc8-90b2-421ed1649e0d tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:11 devstack sudo[103438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be 1073741824 Jul 31 10:53:11 devstack sudo[103438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:12 devstack sudo[103436]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e53652fb-1eaa-43f2-82f5-5838dccfa495 tempest-TestStampPattern-862817097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670.40cee1b8-ac13-4e92-89ab-5c914968c66a" returned: 0 in 0.396s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e53652fb-1eaa-43f2-82f5-5838dccfa495 tempest-TestStampPattern-862817097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670.40cee1b8-ac13-4e92-89ab-5c914968c66a {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:12 devstack sudo[103443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670.40cee1b8-ac13-4e92-89ab-5c914968c66a Jul 31 10:53:12 devstack sudo[103443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:12 devstack sudo[103443]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e53652fb-1eaa-43f2-82f5-5838dccfa495 tempest-TestStampPattern-862817097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670.40cee1b8-ac13-4e92-89ab-5c914968c66a" returned: 0 in 0.326s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:12 devstack sudo[103438]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:12 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e53652fb-1eaa-43f2-82f5-5838dccfa495 tempest-TestStampPattern-862817097 None] Lock "cinder-quobyte-40cee1b8-ac13-4e92-89ab-5c914968c66a" released by "_delete_snapshot" :: held 2.032s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:53:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c621d608-a1b5-4dc8-90b2-421ed1649e0d tempest-VolumesDeleteCascade-644998590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be 1073741824" returned: 0 in 0.555s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:12 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e53652fb-1eaa-43f2-82f5-5838dccfa495 tempest-TestStampPattern-862817097 None] Lock "cinder-quobyte-fd9a48ef-b8f0-44b8-b07e-dde0069cc670" released by "delete_snapshot" :: held 2.068s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:53:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c621d608-a1b5-4dc8-90b2-421ed1649e0d tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:12 devstack sudo[103452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be Jul 31 10:53:12 devstack sudo[103452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:12 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-e53652fb-1eaa-43f2-82f5-5838dccfa495 tempest-TestStampPattern-862817097 None] Created reservations ['d738fcdc-3b40-45ef-b157-5f7a61e133e7', '993f68a5-5469-4486-901f-74e238fe51c1', 'f90b424b-9c26-4327-a686-11472a340c2a', '6d318371-e429-48ac-a5a2-730c8a216dd5'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:53:12 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-e53652fb-1eaa-43f2-82f5-5838dccfa495 tempest-TestStampPattern-862817097 None] Delete snapshot completed successfully. Jul 31 10:53:12 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e53652fb-1eaa-43f2-82f5-5838dccfa495 tempest-TestStampPattern-862817097 None] Lock "cinder-40cee1b8-ac13-4e92-89ab-5c914968c66a-delete_snapshot" released by "delete_snapshot" :: held 2.319s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:53:12 devstack sudo[103452]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c621d608-a1b5-4dc8-90b2-421ed1649e0d tempest-VolumesDeleteCascade-644998590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be" returned: 0 in 0.309s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:12 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c621d608-a1b5-4dc8-90b2-421ed1649e0d tempest-VolumesDeleteCascade-644998590 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:53:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c621d608-a1b5-4dc8-90b2-421ed1649e0d tempest-VolumesDeleteCascade-644998590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c621d608-a1b5-4dc8-90b2-421ed1649e0d tempest-VolumesDeleteCascade-644998590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dab1635-0ef4-4e29-b45b-4de7bb6ae4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2191b2b-5a43-4c33-b850-9ecef31761be', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c621d608-a1b5-4dc8-90b2-421ed1649e0d tempest-VolumesDeleteCascade-644998590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db8e53bf-6f48-493c-b04c-201488ca1ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:12 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-c621d608-a1b5-4dc8-90b2-421ed1649e0d tempest-VolumesDeleteCascade-644998590 None] Volume volume-c2191b2b-5a43-4c33-b850-9ecef31761be (c2191b2b-5a43-4c33-b850-9ecef31761be): created successfully Jul 31 10:53:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c621d608-a1b5-4dc8-90b2-421ed1649e0d tempest-VolumesDeleteCascade-644998590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db8e53bf-6f48-493c-b04c-201488ca1ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c621d608-a1b5-4dc8-90b2-421ed1649e0d tempest-VolumesDeleteCascade-644998590 None] Flow 'volume_create_manager' (51b55833-a9c7-40ce-a0e2-5e2d86a1a7e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:53:12 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-c621d608-a1b5-4dc8-90b2-421ed1649e0d tempest-VolumesDeleteCascade-644998590 None] Created volume successfully. Jul 31 10:53:13 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-677f365b-db37-4780-9d26-71383aa2dc45 tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:53:13 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-677f365b-db37-4780-9d26-71383aa2dc45 tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Flow 'volume_create_manager' (5818ce54-66af-4801-9907-07af455c9dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:53:13 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-677f365b-db37-4780-9d26-71383aa2dc45 tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24c04b9a-6256-42d1-b20b-e77e410823f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:13 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-677f365b-db37-4780-9d26-71383aa2dc45 tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24c04b9a-6256-42d1-b20b-e77e410823f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:53:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-610223610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4628ac9-4aa8-45ac-a744-6bcb0052d688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='813d5a42e23344d79a9560ed9536f9bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:53:14Z,use_quota=True,user_id='6b1912c7fb79413bb8bd914c74d5e7dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:13 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-677f365b-db37-4780-9d26-71383aa2dc45 tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e06ecc8-9d6e-4e9a-8e2e-444200718101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:13 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-677f365b-db37-4780-9d26-71383aa2dc45 tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e06ecc8-9d6e-4e9a-8e2e-444200718101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:13 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-677f365b-db37-4780-9d26-71383aa2dc45 tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e194d1e4-61a5-476f-bbe0-e98c0cd0e9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:13 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-677f365b-db37-4780-9d26-71383aa2dc45 tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e194d1e4-61a5-476f-bbe0-e98c0cd0e9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4628ac9-4aa8-45ac-a744-6bcb0052d688', 'volume_name': 'volume-d4628ac9-4aa8-45ac-a744-6bcb0052d688', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:13 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-677f365b-db37-4780-9d26-71383aa2dc45 tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f42b012-82eb-4947-932d-8f4465910d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:13 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-677f365b-db37-4780-9d26-71383aa2dc45 tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f42b012-82eb-4947-932d-8f4465910d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:13 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-677f365b-db37-4780-9d26-71383aa2dc45 tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2338fe2-e0c3-4274-a57a-8850dcfd8e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:13 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-677f365b-db37-4780-9d26-71383aa2dc45 tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Volume d4628ac9-4aa8-45ac-a744-6bcb0052d688: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4628ac9-4aa8-45ac-a744-6bcb0052d688', 'volume_size': 1} Jul 31 10:53:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-677f365b-db37-4780-9d26-71383aa2dc45 tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-677f365b-db37-4780-9d26-71383aa2dc45 tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:13 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-677f365b-db37-4780-9d26-71383aa2dc45 tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:53:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-610223610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4628ac9-4aa8-45ac-a744-6bcb0052d688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='813d5a42e23344d79a9560ed9536f9bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:53:14Z,use_quota=True,user_id='6b1912c7fb79413bb8bd914c74d5e7dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:53:13 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-677f365b-db37-4780-9d26-71383aa2dc45 tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Creating volume d4628ac9-4aa8-45ac-a744-6bcb0052d688 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:53:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-677f365b-db37-4780-9d26-71383aa2dc45 tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-677f365b-db37-4780-9d26-71383aa2dc45 tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:13 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-677f365b-db37-4780-9d26-71383aa2dc45 tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:53:13 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-677f365b-db37-4780-9d26-71383aa2dc45 tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:53:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-677f365b-db37-4780-9d26-71383aa2dc45 tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:13 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-677f365b-db37-4780-9d26-71383aa2dc45 tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:53:13 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-677f365b-db37-4780-9d26-71383aa2dc45 tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:53:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-677f365b-db37-4780-9d26-71383aa2dc45 tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d4628ac9-4aa8-45ac-a744-6bcb0052d688 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:13 devstack sudo[103455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d4628ac9-4aa8-45ac-a744-6bcb0052d688 1073741824 Jul 31 10:53:13 devstack sudo[103455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-fd467e88-f0f5-4025-a6c9-7cce8015e85c tempest-VolumesDeleteCascade-644998590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:14 devstack sudo[103455]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-677f365b-db37-4780-9d26-71383aa2dc45 tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d4628ac9-4aa8-45ac-a744-6bcb0052d688 1073741824" returned: 0 in 0.618s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-677f365b-db37-4780-9d26-71383aa2dc45 tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d4628ac9-4aa8-45ac-a744-6bcb0052d688 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:14 devstack sudo[103461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d4628ac9-4aa8-45ac-a744-6bcb0052d688 Jul 31 10:53:14 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:14 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-677f365b-db37-4780-9d26-71383aa2dc45 tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d4628ac9-4aa8-45ac-a744-6bcb0052d688" returned: 0 in 0.393s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:14 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-677f365b-db37-4780-9d26-71383aa2dc45 tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:53:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-677f365b-db37-4780-9d26-71383aa2dc45 tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-fd467e88-f0f5-4025-a6c9-7cce8015e85c tempest-VolumesDeleteCascade-644998590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.564s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-677f365b-db37-4780-9d26-71383aa2dc45 tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2338fe2-e0c3-4274-a57a-8850dcfd8e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4628ac9-4aa8-45ac-a744-6bcb0052d688', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-677f365b-db37-4780-9d26-71383aa2dc45 tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (690e538e-78e5-4c73-afca-ed91ac833a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:14 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-fd467e88-f0f5-4025-a6c9-7cce8015e85c tempest-VolumesDeleteCascade-644998590 None] Creating offline snapshot 27ec20c4-6b85-449a-889d-befa043b5cfd of volume c2191b2b-5a43-4c33-b850-9ecef31761be {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:53:14 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-677f365b-db37-4780-9d26-71383aa2dc45 tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Volume volume-d4628ac9-4aa8-45ac-a744-6bcb0052d688 (d4628ac9-4aa8-45ac-a744-6bcb0052d688): created successfully Jul 31 10:53:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-677f365b-db37-4780-9d26-71383aa2dc45 tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (690e538e-78e5-4c73-afca-ed91ac833a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-677f365b-db37-4780-9d26-71383aa2dc45 tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Flow 'volume_create_manager' (5818ce54-66af-4801-9907-07af455c9dfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:53:14 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[85171f01-e7eb-48b8-a2a3-05fb707cc48d]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:53:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fd467e88-f0f5-4025-a6c9-7cce8015e85c tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:14 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-677f365b-db37-4780-9d26-71383aa2dc45 tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Created volume successfully. Jul 31 10:53:15 devstack sudo[103466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be Jul 31 10:53:15 devstack sudo[103466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:15 devstack sudo[103466]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fd467e88-f0f5-4025-a6c9-7cce8015e85c tempest-VolumesDeleteCascade-644998590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be" returned: 0 in 0.675s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fd467e88-f0f5-4025-a6c9-7cce8015e85c tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be.27ec20c4-6b85-449a-889d-befa043b5cfd 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:15 devstack sudo[103476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be.27ec20c4-6b85-449a-889d-befa043b5cfd 1G Jul 31 10:53:15 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:16 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fd467e88-f0f5-4025-a6c9-7cce8015e85c tempest-VolumesDeleteCascade-644998590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be.27ec20c4-6b85-449a-889d-befa043b5cfd 1G" returned: 0 in 0.982s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fd467e88-f0f5-4025-a6c9-7cce8015e85c tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2191b2b-5a43-4c33-b850-9ecef31761be -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be.27ec20c4-6b85-449a-889d-befa043b5cfd {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:16 devstack sudo[103504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2191b2b-5a43-4c33-b850-9ecef31761be -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be.27ec20c4-6b85-449a-889d-befa043b5cfd Jul 31 10:53:16 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:17 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fd467e88-f0f5-4025-a6c9-7cce8015e85c tempest-VolumesDeleteCascade-644998590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2191b2b-5a43-4c33-b850-9ecef31761be -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be.27ec20c4-6b85-449a-889d-befa043b5cfd" returned: 0 in 0.569s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:17 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-fd467e88-f0f5-4025-a6c9-7cce8015e85c tempest-VolumesDeleteCascade-644998590 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be.27ec20c4-6b85-449a-889d-befa043b5cfd is being set with open permissions: ugo+rw Jul 31 10:53:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fd467e88-f0f5-4025-a6c9-7cce8015e85c tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be.27ec20c4-6b85-449a-889d-befa043b5cfd {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:17 devstack sudo[103521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be.27ec20c4-6b85-449a-889d-befa043b5cfd Jul 31 10:53:17 devstack sudo[103521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-bea7cfa7-9905-4760-928a-4309c1d1f331 req-d5381c2a-a954-4870-bef6-773536f58ccd tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:17 devstack sudo[103521]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fd467e88-f0f5-4025-a6c9-7cce8015e85c tempest-VolumesDeleteCascade-644998590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be.27ec20c4-6b85-449a-889d-befa043b5cfd" returned: 0 in 0.413s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fd467e88-f0f5-4025-a6c9-7cce8015e85c tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:17 devstack sudo[103526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be.info Jul 31 10:53:17 devstack sudo[103526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:17 devstack sudo[103526]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fd467e88-f0f5-4025-a6c9-7cce8015e85c tempest-VolumesDeleteCascade-644998590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be.info" returned: 0 in 0.350s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:17 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-fd467e88-f0f5-4025-a6c9-7cce8015e85c tempest-VolumesDeleteCascade-644998590 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be.info is being set with open permissions: ugo+rw Jul 31 10:53:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fd467e88-f0f5-4025-a6c9-7cce8015e85c tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:17 devstack sudo[103534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be.info Jul 31 10:53:17 devstack sudo[103534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:18 devstack sudo[103534]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fd467e88-f0f5-4025-a6c9-7cce8015e85c tempest-VolumesDeleteCascade-644998590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be.info" returned: 0 in 0.381s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-fd467e88-f0f5-4025-a6c9-7cce8015e85c tempest-VolumesDeleteCascade-644998590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.579s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-bea7cfa7-9905-4760-928a-4309c1d1f331 req-d5381c2a-a954-4870-bef6-773536f58ccd tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.118s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-bea7cfa7-9905-4760-928a-4309c1d1f331 req-d5381c2a-a954-4870-bef6-773536f58ccd tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:18 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-fd467e88-f0f5-4025-a6c9-7cce8015e85c tempest-VolumesDeleteCascade-644998590 None] Create snapshot completed successfully Jul 31 10:53:18 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-bea7cfa7-9905-4760-928a-4309c1d1f331 req-d5381c2a-a954-4870-bef6-773536f58ccd tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c', 'name': 'volume-d4628ac9-4aa8-45ac-a744-6bcb0052d688', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1da698df-749e-47f9-ae1f-2735c20b2739', 'enforce_multipath': True} {{(pid=89090) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:53:18 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-bea7cfa7-9905-4760-928a-4309c1d1f331 req-d5381c2a-a954-4870-bef6-773536f58ccd tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] attachment_update completed successfully. Jul 31 10:53:19 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:53:19 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Flow 'volume_create_manager' (bbd6c8c4-30a4-469f-b1c0-6363833345f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:53:19 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89c07bc7-56fc-46d1-9de4-22fe9d0efae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:19 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89c07bc7-56fc-46d1-9de4-22fe9d0efae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-402289261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b890526f-2551-4a74-921a-c623e91db4bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ea02cee7def4d1dbbb7d1131818ccf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=27ec20c4-6b85-449a-889d-befa043b5cfd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:53:19Z,use_quota=True,user_id='ef8f5360df4f409fb83c3e9f5a54e1a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:19 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8648857f-2a1e-44c8-89aa-4cfa5410ca0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:19 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8648857f-2a1e-44c8-89aa-4cfa5410ca0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:19 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99ca9fbf-a0f8-4484-9b48-98c43e61b657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:19 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99ca9fbf-a0f8-4484-9b48-98c43e61b657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b890526f-2551-4a74-921a-c623e91db4bf', 'volume_name': 'volume-b890526f-2551-4a74-921a-c623e91db4bf', 'volume_size': 1, 'snapshot_id': '27ec20c4-6b85-449a-889d-befa043b5cfd'}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:19 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16259cbb-83f0-4630-964e-37324d56f52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:19 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16259cbb-83f0-4630-964e-37324d56f52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:19 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0569929-bc85-4733-ac8a-e0ab97633e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:19 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Volume b890526f-2551-4a74-921a-c623e91db4bf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b890526f-2551-4a74-921a-c623e91db4bf', 'volume_size': 1, 'snapshot_id': '27ec20c4-6b85-449a-889d-befa043b5cfd'} Jul 31 10:53:19 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-62e883d2-0151-4561-8c78-5eabd848514d tempest-TestStampPattern-862817097 None] Acquiring lock "cinder-fd9a48ef-b8f0-44b8-b07e-dde0069cc670-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:53:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:19 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Acquiring lock "cinder-quobyte-27ec20c4-6b85-449a-889d-befa043b5cfd-b890526f-2551-4a74-921a-c623e91db4bf" by "_create_volume_from_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:53:19 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-62e883d2-0151-4561-8c78-5eabd848514d tempest-TestStampPattern-862817097 None] Lock "cinder-fd9a48ef-b8f0-44b8-b07e-dde0069cc670-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:53:19 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Lock "cinder-quobyte-27ec20c4-6b85-449a-889d-befa043b5cfd-b890526f-2551-4a74-921a-c623e91db4bf" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:53:19 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Creating volume b890526f-2551-4a74-921a-c623e91db4bf from snapshot 27ec20c4-6b85-449a-889d-befa043b5cfd {{(pid=89090) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 10:53:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:19 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:53:19 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:53:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:19 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:53:19 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Acquiring lock "cinder-quobyte-b890526f-2551-4a74-921a-c623e91db4bf" by "_copy_volume_from_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:53:19 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Lock "cinder-quobyte-b890526f-2551-4a74-921a-c623e91db4bf" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:53:19 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] snapshot: 27ec20c4-6b85-449a-889d-befa043b5cfd, volume: b890526f-2551-4a74-921a-c623e91db4bf, {{(pid=89090) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 10:53:19 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-62e883d2-0151-4561-8c78-5eabd848514d tempest-TestStampPattern-862817097 None] Acquiring lock "cinder-quobyte-fd9a48ef-b8f0-44b8-b07e-dde0069cc670" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:53:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:19 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:53:19 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:53:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:19 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-62e883d2-0151-4561-8c78-5eabd848514d tempest-TestStampPattern-862817097 None] Lock "cinder-quobyte-fd9a48ef-b8f0-44b8-b07e-dde0069cc670" acquired by "delete_volume" :: waited 0.059s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:53:19 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[84634ccd-b04e-45f5-b375-16d3c9ef219a]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:53:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be.27ec20c4-6b85-449a-889d-befa043b5cfd {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:19 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fc7720-376c-47fb-aa7e-36e761c4bb2a]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:53:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-62e883d2-0151-4561-8c78-5eabd848514d tempest-TestStampPattern-862817097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:19 devstack sudo[103550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be.27ec20c4-6b85-449a-889d-befa043b5cfd Jul 31 10:53:19 devstack sudo[103550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:19 devstack sudo[103551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670 Jul 31 10:53:19 devstack sudo[103551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:20 devstack sudo[103550]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be.27ec20c4-6b85-449a-889d-befa043b5cfd" returned: 0 in 0.459s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:20 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2191b2b-5a43-4c33-b850-9ecef31761be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:53:20 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc95557-5bca-4573-8749-7a217d5c7f19]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:53:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:20 devstack sudo[103551]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-62e883d2-0151-4561-8c78-5eabd848514d tempest-TestStampPattern-862817097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670" returned: 0 in 0.565s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-62e883d2-0151-4561-8c78-5eabd848514d tempest-TestStampPattern-862817097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:20 devstack sudo[103562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670 Jul 31 10:53:20 devstack sudo[103562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:20 devstack sudo[103561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be Jul 31 10:53:20 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:20 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be" returned: 0 in 0.518s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:20 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be {{(pid=89090) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 10:53:20 devstack sudo[103562]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:20 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Creating direct copy from snapshot {{(pid=89090) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 10:53:20 devstack cinder-volume[89090]: DEBUG cinder.utils [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Path /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b890526f-2551-4a74-921a-c623e91db4bf not found in is_blk_device check {{(pid=89090) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 10:53:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b890526f-2551-4a74-921a-c623e91db4bf {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-62e883d2-0151-4561-8c78-5eabd848514d tempest-TestStampPattern-862817097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fd9a48ef-b8f0-44b8-b07e-dde0069cc670" returned: 0 in 0.444s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:20 devstack sudo[103569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b890526f-2551-4a74-921a-c623e91db4bf Jul 31 10:53:20 devstack sudo[103569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:20 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-62e883d2-0151-4561-8c78-5eabd848514d tempest-TestStampPattern-862817097 None] Lock "cinder-quobyte-fd9a48ef-b8f0-44b8-b07e-dde0069cc670" released by "delete_volume" :: held 1.114s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:53:20 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-62e883d2-0151-4561-8c78-5eabd848514d tempest-TestStampPattern-862817097 None] Created reservations ['2c8a15e9-9e54-47e9-a64e-e2d418732dd5', '241da053-9b6c-4e5a-a26f-5faa209e135c', '2f70ed11-fcb7-4bd8-a113-3254e130ef85', 'c0334e4c-3915-4c3c-aa44-3fcb033e24fe'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:53:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-62e883d2-0151-4561-8c78-5eabd848514d tempest-TestStampPattern-862817097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-62e883d2-0151-4561-8c78-5eabd848514d tempest-TestStampPattern-862817097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:21 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-62e883d2-0151-4561-8c78-5eabd848514d tempest-TestStampPattern-862817097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:53:21 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-62e883d2-0151-4561-8c78-5eabd848514d tempest-TestStampPattern-862817097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:53:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-62e883d2-0151-4561-8c78-5eabd848514d tempest-TestStampPattern-862817097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-62e883d2-0151-4561-8c78-5eabd848514d tempest-TestStampPattern-862817097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:21 devstack sudo[103573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:53:21 devstack sudo[103573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:21 devstack sudo[103573]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-62e883d2-0151-4561-8c78-5eabd848514d tempest-TestStampPattern-862817097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.392s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:21 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-62e883d2-0151-4561-8c78-5eabd848514d tempest-TestStampPattern-862817097 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:53:21 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-62e883d2-0151-4561-8c78-5eabd848514d tempest-TestStampPattern-862817097 None] Deleted volume successfully. Jul 31 10:53:21 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-62e883d2-0151-4561-8c78-5eabd848514d tempest-TestStampPattern-862817097 None] Lock "cinder-fd9a48ef-b8f0-44b8-b07e-dde0069cc670-delete_volume" released by "delete_volume" :: held 2.033s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:53:22 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-48531b04-929c-4d60-a956-23f5a319767c req-b2c80118-aa55-4e6f-a1ed-b17ed60c6302 tempest-TestShelveInstance-693135770 None] Terminate volume connection completed successfully. Jul 31 10:53:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-48531b04-929c-4d60-a956-23f5a319767c req-b2c80118-aa55-4e6f-a1ed-b17ed60c6302 tempest-TestShelveInstance-693135770 None] Deleting attachment 087d18e7-b818-4e10-8f77-cdc1e90028fd. {{(pid=89090) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:53:23 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-71b09330-1881-4d18-816e-4a487e829872 req-9a88f4d8-cd85-4be5-baac-0b7c43de2e66 tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Terminate volume connection completed successfully. Jul 31 10:53:23 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-71b09330-1881-4d18-816e-4a487e829872 req-9a88f4d8-cd85-4be5-baac-0b7c43de2e66 tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Deleting attachment 1da698df-749e-47f9-ae1f-2735c20b2739. {{(pid=89090) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:53:24 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-470c4e00-4dcf-4904-a739-87e2fe5c158b tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Acquiring lock "cinder-d4628ac9-4aa8-45ac-a744-6bcb0052d688-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:53:24 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-470c4e00-4dcf-4904-a739-87e2fe5c158b tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Lock "cinder-d4628ac9-4aa8-45ac-a744-6bcb0052d688-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:53:24 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-470c4e00-4dcf-4904-a739-87e2fe5c158b tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Acquiring lock "cinder-quobyte-d4628ac9-4aa8-45ac-a744-6bcb0052d688" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:53:24 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-470c4e00-4dcf-4904-a739-87e2fe5c158b tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Lock "cinder-quobyte-d4628ac9-4aa8-45ac-a744-6bcb0052d688" acquired by "delete_volume" :: waited 0.039s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:53:25 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[45636e62-f41c-4b8a-bf3e-0df152032ad1]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:53:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-470c4e00-4dcf-4904-a739-87e2fe5c158b tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d4628ac9-4aa8-45ac-a744-6bcb0052d688 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:25 devstack sudo[103609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d4628ac9-4aa8-45ac-a744-6bcb0052d688 Jul 31 10:53:25 devstack sudo[103609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:25 devstack sudo[103609]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-470c4e00-4dcf-4904-a739-87e2fe5c158b tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d4628ac9-4aa8-45ac-a744-6bcb0052d688" returned: 0 in 0.771s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-470c4e00-4dcf-4904-a739-87e2fe5c158b tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d4628ac9-4aa8-45ac-a744-6bcb0052d688 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:25 devstack sudo[103614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d4628ac9-4aa8-45ac-a744-6bcb0052d688 Jul 31 10:53:25 devstack sudo[103614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:26 devstack sudo[103614]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-470c4e00-4dcf-4904-a739-87e2fe5c158b tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d4628ac9-4aa8-45ac-a744-6bcb0052d688" returned: 0 in 0.709s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:26 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-470c4e00-4dcf-4904-a739-87e2fe5c158b tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Lock "cinder-quobyte-d4628ac9-4aa8-45ac-a744-6bcb0052d688" released by "delete_volume" :: held 1.614s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:53:26 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-470c4e00-4dcf-4904-a739-87e2fe5c158b tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Created reservations ['49ee092a-02d4-45f6-8203-ab1060dd7052', 'ab50c797-fc07-4955-aa8f-93d3890f405a', '9a47045e-f3ef-4467-a817-f3e24c4e236b', '011440d6-18d8-42b1-950d-8c391a4c54b3'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:53:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-470c4e00-4dcf-4904-a739-87e2fe5c158b tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-470c4e00-4dcf-4904-a739-87e2fe5c158b tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-470c4e00-4dcf-4904-a739-87e2fe5c158b tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:53:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-470c4e00-4dcf-4904-a739-87e2fe5c158b tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:53:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-470c4e00-4dcf-4904-a739-87e2fe5c158b tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-470c4e00-4dcf-4904-a739-87e2fe5c158b tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:26 devstack sudo[103617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:53:26 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:27 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-470c4e00-4dcf-4904-a739-87e2fe5c158b tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.880s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:27 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-470c4e00-4dcf-4904-a739-87e2fe5c158b tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:53:27 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-470c4e00-4dcf-4904-a739-87e2fe5c158b tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Deleted volume successfully. Jul 31 10:53:27 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-470c4e00-4dcf-4904-a739-87e2fe5c158b tempest-TestServerVolumeAttachScenarioOldVersion-2113599937 None] Lock "cinder-d4628ac9-4aa8-45ac-a744-6bcb0052d688-delete_volume" released by "delete_volume" :: held 3.065s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:53:28 devstack sudo[103569]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b890526f-2551-4a74-921a-c623e91db4bf" returned: 0 in 7.350s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:28 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Image conversion details: src /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be, size 1024.00 MB, duration 7.35 sec, destination /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b890526f-2551-4a74-921a-c623e91db4bf {{(pid=89090) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 10:53:28 devstack cinder-volume[89090]: INFO cinder.image.image_utils [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Converted 1024.00 MB image at 139.31 MB/s Jul 31 10:53:28 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b890526f-2551-4a74-921a-c623e91db4bf is being set with open permissions: ugo+rw Jul 31 10:53:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b890526f-2551-4a74-921a-c623e91db4bf {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:28 devstack sudo[103622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b890526f-2551-4a74-921a-c623e91db4bf Jul 31 10:53:28 devstack sudo[103622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:28 devstack sudo[103622]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b890526f-2551-4a74-921a-c623e91db4bf" returned: 0 in 0.381s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:28 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Lock "cinder-quobyte-b890526f-2551-4a74-921a-c623e91db4bf" released by "_copy_volume_from_snapshot" :: held 8.868s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:53:28 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Lock "cinder-quobyte-27ec20c4-6b85-449a-889d-befa043b5cfd-b890526f-2551-4a74-921a-c623e91db4bf" released by "_create_volume_from_snapshot" :: held 8.986s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:53:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.020s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0569929-bc85-4733-ac8a-e0ab97633e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b890526f-2551-4a74-921a-c623e91db4bf', 'volume_size': 1, 'snapshot_id': '27ec20c4-6b85-449a-889d-befa043b5cfd'}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f783635-9995-4537-a370-ac05f9bf2b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:28 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Volume volume-b890526f-2551-4a74-921a-c623e91db4bf (b890526f-2551-4a74-921a-c623e91db4bf): created successfully Jul 31 10:53:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f783635-9995-4537-a370-ac05f9bf2b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Flow 'volume_create_manager' (bbd6c8c4-30a4-469f-b1c0-6363833345f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:53:28 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-4d5b3c1b-d4df-4a4c-929c-5b09073376d9 tempest-VolumesDeleteCascade-644998590 None] Created volume successfully. Jul 31 10:53:29 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] Acquiring lock "cinder-c2191b2b-5a43-4c33-b850-9ecef31761be-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:53:29 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] Lock "cinder-c2191b2b-5a43-4c33-b850-9ecef31761be-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:53:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] Performing cascade delete. {{(pid=89090) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 31 10:53:29 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] Acquiring lock "cinder-27ec20c4-6b85-449a-889d-befa043b5cfd-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:53:29 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] Lock "cinder-27ec20c4-6b85-449a-889d-befa043b5cfd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:53:29 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] Acquiring lock "cinder-quobyte-c2191b2b-5a43-4c33-b850-9ecef31761be" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:53:29 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] Lock "cinder-quobyte-c2191b2b-5a43-4c33-b850-9ecef31761be" acquired by "delete_snapshot" :: waited 0.041s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:53:29 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] Acquiring lock "cinder-quobyte-27ec20c4-6b85-449a-889d-befa043b5cfd" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:53:29 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] Lock "cinder-quobyte-27ec20c4-6b85-449a-889d-befa043b5cfd" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:53:29 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] Deleting offline snapshot 27ec20c4-6b85-449a-889d-befa043b5cfd of volume c2191b2b-5a43-4c33-b850-9ecef31761be {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:53:29 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] snapshot_file for this snap is: volume-c2191b2b-5a43-4c33-b850-9ecef31761be.27ec20c4-6b85-449a-889d-befa043b5cfd {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:53:29 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4be425-b23d-4ace-8621-d812da606833]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:53:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be.27ec20c4-6b85-449a-889d-befa043b5cfd {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:29 devstack sudo[103652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be.27ec20c4-6b85-449a-889d-befa043b5cfd Jul 31 10:53:29 devstack sudo[103652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:30 devstack sudo[103652]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be.27ec20c4-6b85-449a-889d-befa043b5cfd" returned: 0 in 0.562s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:30 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2191b2b-5a43-4c33-b850-9ecef31761be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:53:30 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[385d145a-ce21-41c4-aaeb-6d95353c16de]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:53:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-82fd7d76-4a49-44c4-8649-3610c4544c70 req-4deac753-34f3-4aef-aec9-e95eac8d6418 tempest-TestShelveInstance-693135770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-82fd7d76-4a49-44c4-8649-3610c4544c70 req-4deac753-34f3-4aef-aec9-e95eac8d6418 tempest-TestShelveInstance-693135770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-82fd7d76-4a49-44c4-8649-3610c4544c70 req-4deac753-34f3-4aef-aec9-e95eac8d6418 tempest-TestShelveInstance-693135770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:30 devstack sudo[103665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be Jul 31 10:53:30 devstack sudo[103665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-82fd7d76-4a49-44c4-8649-3610c4544c70 req-4deac753-34f3-4aef-aec9-e95eac8d6418 tempest-TestShelveInstance-693135770 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c', 'name': 'volume-8c4dd065-1621-4cd9-b081-5223550da237', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '02bdc665-56b6-44fb-84b4-bc2911cb8c17', 'enforce_multipath': True} {{(pid=89090) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:53:30 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-82fd7d76-4a49-44c4-8649-3610c4544c70 req-4deac753-34f3-4aef-aec9-e95eac8d6418 tempest-TestShelveInstance-693135770 None] attachment_update completed successfully. Jul 31 10:53:31 devstack sudo[103665]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be" returned: 0 in 0.972s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be.27ec20c4-6b85-449a-889d-befa043b5cfd {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:31 devstack sudo[103673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be.27ec20c4-6b85-449a-889d-befa043b5cfd Jul 31 10:53:31 devstack sudo[103673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:31 devstack sudo[103673]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be.27ec20c4-6b85-449a-889d-befa043b5cfd" returned: 0 in 0.704s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be.27ec20c4-6b85-449a-889d-befa043b5cfd {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:31 devstack sudo[103678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be.27ec20c4-6b85-449a-889d-befa043b5cfd Jul 31 10:53:31 devstack sudo[103678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:32 devstack sudo[103678]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be.27ec20c4-6b85-449a-889d-befa043b5cfd" returned: 0 in 0.314s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:32 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] Lock "cinder-quobyte-27ec20c4-6b85-449a-889d-befa043b5cfd" released by "_delete_snapshot" :: held 2.740s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:53:32 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] Lock "cinder-quobyte-c2191b2b-5a43-4c33-b850-9ecef31761be" released by "delete_snapshot" :: held 2.791s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:53:32 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] Created reservations ['7fcf0716-2248-4280-a889-2d86695af5e9', '42c21a2e-dc1c-413e-8a0d-452efd1b353c', '1ac733ae-e705-43d4-a1fd-355b1c4efb83', 'd81c410f-0d47-4cf6-8086-03400da34164'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:53:32 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] Delete snapshot completed successfully. Jul 31 10:53:32 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] Lock "cinder-27ec20c4-6b85-449a-889d-befa043b5cfd-delete_snapshot" released by "delete_snapshot" :: held 3.083s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:53:32 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] Snapshots deleted, issuing volume delete {{(pid=89090) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 31 10:53:32 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] Acquiring lock "cinder-quobyte-c2191b2b-5a43-4c33-b850-9ecef31761be" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:53:32 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] Lock "cinder-quobyte-c2191b2b-5a43-4c33-b850-9ecef31761be" acquired by "delete_volume" :: waited 0.019s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:53:32 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac3cde0-3ce2-45e5-bfbe-48e449d77b15]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:53:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:32 devstack sudo[103681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be Jul 31 10:53:32 devstack sudo[103681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:33 devstack sudo[103681]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be" returned: 0 in 0.466s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:33 devstack sudo[103686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be Jul 31 10:53:33 devstack sudo[103686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:33 devstack sudo[103686]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c2191b2b-5a43-4c33-b850-9ecef31761be" returned: 0 in 0.346s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:33 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] Lock "cinder-quobyte-c2191b2b-5a43-4c33-b850-9ecef31761be" released by "delete_volume" :: held 0.907s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:53:33 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] Created reservations ['a303afdb-a273-4e2a-b3d2-ba5593a9d624', 'dc70540c-0ea5-4249-a295-04c485246a59', '2a12ff8e-0320-41d7-834e-1826b1b2af03', '63c0371d-929d-4248-9e4b-03954b4254b0'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:53:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:33 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:53:33 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:53:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:33 devstack sudo[103690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:53:33 devstack sudo[103690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:33 devstack sudo[103690]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.325s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:33 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:53:33 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] Deleted volume successfully. Jul 31 10:53:34 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2c51bc6b-9c33-449d-ab91-50145de2ba39 tempest-VolumesDeleteCascade-644998590 None] Acquiring lock "cinder-b890526f-2551-4a74-921a-c623e91db4bf-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:53:34 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-17f74c51-c4b0-4942-83d3-dd588cdbda52 tempest-VolumesDeleteCascade-644998590 None] Lock "cinder-c2191b2b-5a43-4c33-b850-9ecef31761be-delete_volume" released by "delete_volume" :: held 4.777s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:53:34 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2c51bc6b-9c33-449d-ab91-50145de2ba39 tempest-VolumesDeleteCascade-644998590 None] Lock "cinder-b890526f-2551-4a74-921a-c623e91db4bf-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:53:34 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2c51bc6b-9c33-449d-ab91-50145de2ba39 tempest-VolumesDeleteCascade-644998590 None] Acquiring lock "cinder-quobyte-b890526f-2551-4a74-921a-c623e91db4bf" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:53:34 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2c51bc6b-9c33-449d-ab91-50145de2ba39 tempest-VolumesDeleteCascade-644998590 None] Lock "cinder-quobyte-b890526f-2551-4a74-921a-c623e91db4bf" acquired by "delete_volume" :: waited 0.030s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:53:34 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[67af57e3-6130-4d0d-a35d-a13e71d06cda]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:53:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2c51bc6b-9c33-449d-ab91-50145de2ba39 tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b890526f-2551-4a74-921a-c623e91db4bf {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:34 devstack sudo[103695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b890526f-2551-4a74-921a-c623e91db4bf Jul 31 10:53:34 devstack sudo[103695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:34 devstack sudo[103695]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2c51bc6b-9c33-449d-ab91-50145de2ba39 tempest-VolumesDeleteCascade-644998590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b890526f-2551-4a74-921a-c623e91db4bf" returned: 0 in 0.443s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2c51bc6b-9c33-449d-ab91-50145de2ba39 tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b890526f-2551-4a74-921a-c623e91db4bf {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:34 devstack sudo[103701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b890526f-2551-4a74-921a-c623e91db4bf Jul 31 10:53:34 devstack sudo[103701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:35 devstack sudo[103701]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2c51bc6b-9c33-449d-ab91-50145de2ba39 tempest-VolumesDeleteCascade-644998590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b890526f-2551-4a74-921a-c623e91db4bf" returned: 0 in 0.367s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:35 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2c51bc6b-9c33-449d-ab91-50145de2ba39 tempest-VolumesDeleteCascade-644998590 None] Lock "cinder-quobyte-b890526f-2551-4a74-921a-c623e91db4bf" released by "delete_volume" :: held 0.901s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:53:35 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-2c51bc6b-9c33-449d-ab91-50145de2ba39 tempest-VolumesDeleteCascade-644998590 None] Created reservations ['64ac63dd-78f6-4777-b193-1c82ceadd3e5', '401ddd82-3d6f-48c9-ab9e-56fb3daa6edc', 'bf579765-ecdb-4134-a840-fe1992d11ea4', '8cb0d2a0-d44c-4e16-9562-dba91c42ec8f'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:53:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2c51bc6b-9c33-449d-ab91-50145de2ba39 tempest-VolumesDeleteCascade-644998590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2c51bc6b-9c33-449d-ab91-50145de2ba39 tempest-VolumesDeleteCascade-644998590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:35 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2c51bc6b-9c33-449d-ab91-50145de2ba39 tempest-VolumesDeleteCascade-644998590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:53:35 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2c51bc6b-9c33-449d-ab91-50145de2ba39 tempest-VolumesDeleteCascade-644998590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:53:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2c51bc6b-9c33-449d-ab91-50145de2ba39 tempest-VolumesDeleteCascade-644998590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2c51bc6b-9c33-449d-ab91-50145de2ba39 tempest-VolumesDeleteCascade-644998590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:35 devstack sudo[103704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:53:35 devstack sudo[103704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2c51bc6b-9c33-449d-ab91-50145de2ba39 tempest-VolumesDeleteCascade-644998590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.321s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:35 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-2c51bc6b-9c33-449d-ab91-50145de2ba39 tempest-VolumesDeleteCascade-644998590 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:53:35 devstack sudo[103704]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:35 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-2c51bc6b-9c33-449d-ab91-50145de2ba39 tempest-VolumesDeleteCascade-644998590 None] Deleted volume successfully. Jul 31 10:53:35 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2c51bc6b-9c33-449d-ab91-50145de2ba39 tempest-VolumesDeleteCascade-644998590 None] Lock "cinder-b890526f-2551-4a74-921a-c623e91db4bf-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:53:42 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-50a03450-3299-48b9-ac70-d40d5285b742 tempest-VolumesMetadataTest-612957777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:53:42 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50a03450-3299-48b9-ac70-d40d5285b742 tempest-VolumesMetadataTest-612957777 None] Flow 'volume_create_manager' (94d3ff29-b8f9-4f2b-8add-2f29276471ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:53:42 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50a03450-3299-48b9-ac70-d40d5285b742 tempest-VolumesMetadataTest-612957777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1f58239-973e-4f83-bd29-5b5ac3d84593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:42 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50a03450-3299-48b9-ac70-d40d5285b742 tempest-VolumesMetadataTest-612957777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1f58239-973e-4f83-bd29-5b5ac3d84593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-985908246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e1c42b3-0c64-431e-8a4c-0ed9e27c5542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc9283409c4446ea947bd814d69bd997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:53:42Z,use_quota=True,user_id='c230169444eb42efa5a0869a1f4562ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:42 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50a03450-3299-48b9-ac70-d40d5285b742 tempest-VolumesMetadataTest-612957777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16cd7d4b-75e4-4082-82f0-457112e0df8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:42 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50a03450-3299-48b9-ac70-d40d5285b742 tempest-VolumesMetadataTest-612957777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16cd7d4b-75e4-4082-82f0-457112e0df8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:42 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50a03450-3299-48b9-ac70-d40d5285b742 tempest-VolumesMetadataTest-612957777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35f6a20e-2099-4252-bdbd-3d87158ef29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:42 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50a03450-3299-48b9-ac70-d40d5285b742 tempest-VolumesMetadataTest-612957777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35f6a20e-2099-4252-bdbd-3d87158ef29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e1c42b3-0c64-431e-8a4c-0ed9e27c5542', 'volume_name': 'volume-0e1c42b3-0c64-431e-8a4c-0ed9e27c5542', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:42 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50a03450-3299-48b9-ac70-d40d5285b742 tempest-VolumesMetadataTest-612957777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b8e3bc8-9d87-43ff-bc1d-625120bf3a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:42 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50a03450-3299-48b9-ac70-d40d5285b742 tempest-VolumesMetadataTest-612957777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b8e3bc8-9d87-43ff-bc1d-625120bf3a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:42 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50a03450-3299-48b9-ac70-d40d5285b742 tempest-VolumesMetadataTest-612957777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a8e8303-e0fe-44f4-a9ec-de4d592ef4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:42 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-50a03450-3299-48b9-ac70-d40d5285b742 tempest-VolumesMetadataTest-612957777 None] Volume 0e1c42b3-0c64-431e-8a4c-0ed9e27c5542: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e1c42b3-0c64-431e-8a4c-0ed9e27c5542', 'volume_size': 1} Jul 31 10:53:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-50a03450-3299-48b9-ac70-d40d5285b742 tempest-VolumesMetadataTest-612957777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-50a03450-3299-48b9-ac70-d40d5285b742 tempest-VolumesMetadataTest-612957777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:42 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-50a03450-3299-48b9-ac70-d40d5285b742 tempest-VolumesMetadataTest-612957777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-985908246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e1c42b3-0c64-431e-8a4c-0ed9e27c5542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc9283409c4446ea947bd814d69bd997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:53:42Z,use_quota=True,user_id='c230169444eb42efa5a0869a1f4562ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:53:42 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-50a03450-3299-48b9-ac70-d40d5285b742 tempest-VolumesMetadataTest-612957777 None] Creating volume 0e1c42b3-0c64-431e-8a4c-0ed9e27c5542 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:53:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-50a03450-3299-48b9-ac70-d40d5285b742 tempest-VolumesMetadataTest-612957777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-50a03450-3299-48b9-ac70-d40d5285b742 tempest-VolumesMetadataTest-612957777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:42 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-50a03450-3299-48b9-ac70-d40d5285b742 tempest-VolumesMetadataTest-612957777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:53:42 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-50a03450-3299-48b9-ac70-d40d5285b742 tempest-VolumesMetadataTest-612957777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:53:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-50a03450-3299-48b9-ac70-d40d5285b742 tempest-VolumesMetadataTest-612957777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:42 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-50a03450-3299-48b9-ac70-d40d5285b742 tempest-VolumesMetadataTest-612957777 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:53:42 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-50a03450-3299-48b9-ac70-d40d5285b742 tempest-VolumesMetadataTest-612957777 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:53:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-50a03450-3299-48b9-ac70-d40d5285b742 tempest-VolumesMetadataTest-612957777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0e1c42b3-0c64-431e-8a4c-0ed9e27c5542 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:42 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0e1c42b3-0c64-431e-8a4c-0ed9e27c5542 1073741824 Jul 31 10:53:42 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:43 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-50a03450-3299-48b9-ac70-d40d5285b742 tempest-VolumesMetadataTest-612957777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0e1c42b3-0c64-431e-8a4c-0ed9e27c5542 1073741824" returned: 0 in 0.908s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-50a03450-3299-48b9-ac70-d40d5285b742 tempest-VolumesMetadataTest-612957777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0e1c42b3-0c64-431e-8a4c-0ed9e27c5542 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:43 devstack sudo[104182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0e1c42b3-0c64-431e-8a4c-0ed9e27c5542 Jul 31 10:53:43 devstack sudo[104182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:44 devstack sudo[104182]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-50a03450-3299-48b9-ac70-d40d5285b742 tempest-VolumesMetadataTest-612957777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0e1c42b3-0c64-431e-8a4c-0ed9e27c5542" returned: 0 in 0.511s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:44 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-50a03450-3299-48b9-ac70-d40d5285b742 tempest-VolumesMetadataTest-612957777 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:53:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-50a03450-3299-48b9-ac70-d40d5285b742 tempest-VolumesMetadataTest-612957777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:44 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50a03450-3299-48b9-ac70-d40d5285b742 tempest-VolumesMetadataTest-612957777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a8e8303-e0fe-44f4-a9ec-de4d592ef4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e1c42b3-0c64-431e-8a4c-0ed9e27c5542', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:44 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50a03450-3299-48b9-ac70-d40d5285b742 tempest-VolumesMetadataTest-612957777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bf18947-9d08-4fb9-a48f-cdddee9a5de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:44 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-50a03450-3299-48b9-ac70-d40d5285b742 tempest-VolumesMetadataTest-612957777 None] Volume volume-0e1c42b3-0c64-431e-8a4c-0ed9e27c5542 (0e1c42b3-0c64-431e-8a4c-0ed9e27c5542): created successfully Jul 31 10:53:44 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50a03450-3299-48b9-ac70-d40d5285b742 tempest-VolumesMetadataTest-612957777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bf18947-9d08-4fb9-a48f-cdddee9a5de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:44 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50a03450-3299-48b9-ac70-d40d5285b742 tempest-VolumesMetadataTest-612957777 None] Flow 'volume_create_manager' (94d3ff29-b8f9-4f2b-8add-2f29276471ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:53:44 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-50a03450-3299-48b9-ac70-d40d5285b742 tempest-VolumesMetadataTest-612957777 None] Created volume successfully. Jul 31 10:53:45 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-49841557-f9b2-422e-a347-9270aafa8ba2 tempest-VolumesMetadataTest-612957777 None] Acquiring lock "cinder-0e1c42b3-0c64-431e-8a4c-0ed9e27c5542-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:53:45 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-49841557-f9b2-422e-a347-9270aafa8ba2 tempest-VolumesMetadataTest-612957777 None] Lock "cinder-0e1c42b3-0c64-431e-8a4c-0ed9e27c5542-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:53:45 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:53:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:53:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:53:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:46 devstack sudo[104189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:53:46 devstack sudo[104189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:46 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-49841557-f9b2-422e-a347-9270aafa8ba2 tempest-VolumesMetadataTest-612957777 None] Acquiring lock "cinder-quobyte-0e1c42b3-0c64-431e-8a4c-0ed9e27c5542" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:53:46 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-49841557-f9b2-422e-a347-9270aafa8ba2 tempest-VolumesMetadataTest-612957777 None] Lock "cinder-quobyte-0e1c42b3-0c64-431e-8a4c-0ed9e27c5542" acquired by "delete_volume" :: waited 0.045s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:53:46 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41253d5-b01c-4d61-984e-0b421c5004da]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:53:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-49841557-f9b2-422e-a347-9270aafa8ba2 tempest-VolumesMetadataTest-612957777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0e1c42b3-0c64-431e-8a4c-0ed9e27c5542 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:46 devstack sudo[104191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0e1c42b3-0c64-431e-8a4c-0ed9e27c5542 Jul 31 10:53:46 devstack sudo[104191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:46 devstack sudo[104189]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.632s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:46 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:53:46 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager._thread_info {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:53:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread count: 28 {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:53:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread info: [<_MainThread(MainThread, started 134005426110592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:53:46 devstack sudo[104191]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-49841557-f9b2-422e-a347-9270aafa8ba2 tempest-VolumesMetadataTest-612957777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0e1c42b3-0c64-431e-8a4c-0ed9e27c5542" returned: 0 in 0.721s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-49841557-f9b2-422e-a347-9270aafa8ba2 tempest-VolumesMetadataTest-612957777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0e1c42b3-0c64-431e-8a4c-0ed9e27c5542 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:46 devstack sudo[104198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0e1c42b3-0c64-431e-8a4c-0ed9e27c5542 Jul 31 10:53:46 devstack sudo[104198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:47 devstack sudo[104198]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-49841557-f9b2-422e-a347-9270aafa8ba2 tempest-VolumesMetadataTest-612957777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0e1c42b3-0c64-431e-8a4c-0ed9e27c5542" returned: 0 in 0.463s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:47 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-49841557-f9b2-422e-a347-9270aafa8ba2 tempest-VolumesMetadataTest-612957777 None] Lock "cinder-quobyte-0e1c42b3-0c64-431e-8a4c-0ed9e27c5542" released by "delete_volume" :: held 1.255s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:53:47 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=100,cinder:UPDATE=94,cinder:INSERT=23,cinder:DELETE=5 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:53:47 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:UPDATE=94,cinder:SELECT=94,cinder:INSERT=24,cinder:DELETE=9 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:53:47 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-49841557-f9b2-422e-a347-9270aafa8ba2 tempest-VolumesMetadataTest-612957777 None] Created reservations ['39895534-2312-4f54-a975-7abbda6c4bdc', 'e541767d-b9f6-49fa-a43c-4efdfc6cdaaa', '8f539a50-0bac-421e-a3fb-98fdcd581933', '534cfccf-1b27-4fac-a1f6-bf454bb7d74c'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:53:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-49841557-f9b2-422e-a347-9270aafa8ba2 tempest-VolumesMetadataTest-612957777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-49841557-f9b2-422e-a347-9270aafa8ba2 tempest-VolumesMetadataTest-612957777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:47 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-49841557-f9b2-422e-a347-9270aafa8ba2 tempest-VolumesMetadataTest-612957777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:53:47 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-49841557-f9b2-422e-a347-9270aafa8ba2 tempest-VolumesMetadataTest-612957777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:53:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-49841557-f9b2-422e-a347-9270aafa8ba2 tempest-VolumesMetadataTest-612957777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-49841557-f9b2-422e-a347-9270aafa8ba2 tempest-VolumesMetadataTest-612957777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:47 devstack sudo[104202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:53:47 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:47 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-c33bc4d8-5494-4f57-90c2-6c979d538028 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:53:47 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c33bc4d8-5494-4f57-90c2-6c979d538028 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Flow 'volume_create_manager' (86cedffa-0352-4857-97a5-5f9f6805949f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:53:47 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c33bc4d8-5494-4f57-90c2-6c979d538028 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (778114a4-446d-4d39-afb5-5df4aac2b4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:47 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c33bc4d8-5494-4f57-90c2-6c979d538028 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (778114a4-446d-4d39-afb5-5df4aac2b4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-698333156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a37147b-e652-4c36-b6bc-2f9b0f2b40c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='393937bdf9974f43947b87b1e3bac7da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:53:48Z,use_quota=True,user_id='562167e244bf4aaba969e554f68e593f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:47 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c33bc4d8-5494-4f57-90c2-6c979d538028 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (848855c7-b889-4625-8d0b-93569a7d4d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:47 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c33bc4d8-5494-4f57-90c2-6c979d538028 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (848855c7-b889-4625-8d0b-93569a7d4d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:47 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c33bc4d8-5494-4f57-90c2-6c979d538028 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce922cfe-e754-47e5-86e8-34d10ed9a07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:47 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c33bc4d8-5494-4f57-90c2-6c979d538028 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce922cfe-e754-47e5-86e8-34d10ed9a07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a37147b-e652-4c36-b6bc-2f9b0f2b40c0', 'volume_name': 'volume-8a37147b-e652-4c36-b6bc-2f9b0f2b40c0', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:47 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c33bc4d8-5494-4f57-90c2-6c979d538028 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebbce8a6-d6f2-47ac-8cf1-117479454a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:47 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c33bc4d8-5494-4f57-90c2-6c979d538028 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebbce8a6-d6f2-47ac-8cf1-117479454a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:47 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c33bc4d8-5494-4f57-90c2-6c979d538028 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afb10ca7-c39a-4c9c-a49b-4da9b6091170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:47 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-c33bc4d8-5494-4f57-90c2-6c979d538028 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Volume 8a37147b-e652-4c36-b6bc-2f9b0f2b40c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a37147b-e652-4c36-b6bc-2f9b0f2b40c0', 'volume_size': 1} Jul 31 10:53:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c33bc4d8-5494-4f57-90c2-6c979d538028 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c33bc4d8-5494-4f57-90c2-6c979d538028 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:47 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c33bc4d8-5494-4f57-90c2-6c979d538028 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-698333156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a37147b-e652-4c36-b6bc-2f9b0f2b40c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='393937bdf9974f43947b87b1e3bac7da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:53:48Z,use_quota=True,user_id='562167e244bf4aaba969e554f68e593f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:53:47 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-c33bc4d8-5494-4f57-90c2-6c979d538028 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Creating volume 8a37147b-e652-4c36-b6bc-2f9b0f2b40c0 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:53:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c33bc4d8-5494-4f57-90c2-6c979d538028 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c33bc4d8-5494-4f57-90c2-6c979d538028 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:47 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c33bc4d8-5494-4f57-90c2-6c979d538028 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:53:47 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c33bc4d8-5494-4f57-90c2-6c979d538028 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:53:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c33bc4d8-5494-4f57-90c2-6c979d538028 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:47 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c33bc4d8-5494-4f57-90c2-6c979d538028 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:53:47 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-c33bc4d8-5494-4f57-90c2-6c979d538028 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:53:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c33bc4d8-5494-4f57-90c2-6c979d538028 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8a37147b-e652-4c36-b6bc-2f9b0f2b40c0 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:47 devstack sudo[104204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8a37147b-e652-4c36-b6bc-2f9b0f2b40c0 1073741824 Jul 31 10:53:47 devstack sudo[104204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:48 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-49841557-f9b2-422e-a347-9270aafa8ba2 tempest-VolumesMetadataTest-612957777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.387s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:48 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-49841557-f9b2-422e-a347-9270aafa8ba2 tempest-VolumesMetadataTest-612957777 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:53:48 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-49841557-f9b2-422e-a347-9270aafa8ba2 tempest-VolumesMetadataTest-612957777 None] Deleted volume successfully. Jul 31 10:53:48 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-49841557-f9b2-422e-a347-9270aafa8ba2 tempest-VolumesMetadataTest-612957777 None] Lock "cinder-0e1c42b3-0c64-431e-8a4c-0ed9e27c5542-delete_volume" released by "delete_volume" :: held 2.164s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:53:48 devstack sudo[104204]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c33bc4d8-5494-4f57-90c2-6c979d538028 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8a37147b-e652-4c36-b6bc-2f9b0f2b40c0 1073741824" returned: 0 in 0.717s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c33bc4d8-5494-4f57-90c2-6c979d538028 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8a37147b-e652-4c36-b6bc-2f9b0f2b40c0 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:48 devstack sudo[104211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8a37147b-e652-4c36-b6bc-2f9b0f2b40c0 Jul 31 10:53:48 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:49 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c33bc4d8-5494-4f57-90c2-6c979d538028 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8a37147b-e652-4c36-b6bc-2f9b0f2b40c0" returned: 0 in 0.438s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c33bc4d8-5494-4f57-90c2-6c979d538028 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:53:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c33bc4d8-5494-4f57-90c2-6c979d538028 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c33bc4d8-5494-4f57-90c2-6c979d538028 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afb10ca7-c39a-4c9c-a49b-4da9b6091170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a37147b-e652-4c36-b6bc-2f9b0f2b40c0', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c33bc4d8-5494-4f57-90c2-6c979d538028 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31bc9730-66c8-4b4f-aa39-6af030a4e86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:49 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-c33bc4d8-5494-4f57-90c2-6c979d538028 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Volume volume-8a37147b-e652-4c36-b6bc-2f9b0f2b40c0 (8a37147b-e652-4c36-b6bc-2f9b0f2b40c0): created successfully Jul 31 10:53:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c33bc4d8-5494-4f57-90c2-6c979d538028 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31bc9730-66c8-4b4f-aa39-6af030a4e86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c33bc4d8-5494-4f57-90c2-6c979d538028 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Flow 'volume_create_manager' (86cedffa-0352-4857-97a5-5f9f6805949f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:53:49 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-c33bc4d8-5494-4f57-90c2-6c979d538028 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Created volume successfully. Jul 31 10:53:50 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-19c58d46-9a41-4b21-901a-13f343a0fa34 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:53:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-19c58d46-9a41-4b21-901a-13f343a0fa34 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Flow 'volume_create_manager' (edfcca85-ce67-46ee-8601-788e8f865fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:53:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-19c58d46-9a41-4b21-901a-13f343a0fa34 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (307d471c-ec47-44c5-8be9-3d8fad4813a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-19c58d46-9a41-4b21-901a-13f343a0fa34 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (307d471c-ec47-44c5-8be9-3d8fad4813a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-680706924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f65e8356-ebd5-466c-bda0-7ec464137920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='393937bdf9974f43947b87b1e3bac7da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:53:51Z,use_quota=True,user_id='562167e244bf4aaba969e554f68e593f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-19c58d46-9a41-4b21-901a-13f343a0fa34 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa16671b-0cd7-4655-89ec-b9e816107abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-19c58d46-9a41-4b21-901a-13f343a0fa34 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa16671b-0cd7-4655-89ec-b9e816107abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-19c58d46-9a41-4b21-901a-13f343a0fa34 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b80b7c1-d349-4e4a-96fc-fa85b873b950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-19c58d46-9a41-4b21-901a-13f343a0fa34 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b80b7c1-d349-4e4a-96fc-fa85b873b950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f65e8356-ebd5-466c-bda0-7ec464137920', 'volume_name': 'volume-f65e8356-ebd5-466c-bda0-7ec464137920', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-19c58d46-9a41-4b21-901a-13f343a0fa34 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb38e4e4-32ed-4f87-8649-6c120c408c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-19c58d46-9a41-4b21-901a-13f343a0fa34 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb38e4e4-32ed-4f87-8649-6c120c408c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-19c58d46-9a41-4b21-901a-13f343a0fa34 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9d14a13-a764-47e1-acd9-21fb5de51e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:50 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-19c58d46-9a41-4b21-901a-13f343a0fa34 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Volume f65e8356-ebd5-466c-bda0-7ec464137920: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f65e8356-ebd5-466c-bda0-7ec464137920', 'volume_size': 1} Jul 31 10:53:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-19c58d46-9a41-4b21-901a-13f343a0fa34 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-19c58d46-9a41-4b21-901a-13f343a0fa34 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:50 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-19c58d46-9a41-4b21-901a-13f343a0fa34 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-680706924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f65e8356-ebd5-466c-bda0-7ec464137920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='393937bdf9974f43947b87b1e3bac7da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:53:51Z,use_quota=True,user_id='562167e244bf4aaba969e554f68e593f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:53:50 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-19c58d46-9a41-4b21-901a-13f343a0fa34 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Creating volume f65e8356-ebd5-466c-bda0-7ec464137920 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:53:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-19c58d46-9a41-4b21-901a-13f343a0fa34 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-19c58d46-9a41-4b21-901a-13f343a0fa34 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:50 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-19c58d46-9a41-4b21-901a-13f343a0fa34 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:53:50 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-19c58d46-9a41-4b21-901a-13f343a0fa34 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:53:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-19c58d46-9a41-4b21-901a-13f343a0fa34 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:50 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-19c58d46-9a41-4b21-901a-13f343a0fa34 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:53:50 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-19c58d46-9a41-4b21-901a-13f343a0fa34 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:53:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-19c58d46-9a41-4b21-901a-13f343a0fa34 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f65e8356-ebd5-466c-bda0-7ec464137920 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:51 devstack sudo[104214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f65e8356-ebd5-466c-bda0-7ec464137920 1073741824 Jul 31 10:53:51 devstack sudo[104214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:51 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-f24fc0f7-b38c-4f9d-812b-7e3aa9d7392d tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:53:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f24fc0f7-b38c-4f9d-812b-7e3aa9d7392d tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Flow 'volume_create_manager' (6e3c1699-cc21-4ef5-85e0-f4ac359f7800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:53:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f24fc0f7-b38c-4f9d-812b-7e3aa9d7392d tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5407162-6b11-4976-a444-6694e8797715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f24fc0f7-b38c-4f9d-812b-7e3aa9d7392d tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5407162-6b11-4976-a444-6694e8797715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1255871690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=729de07e-e68a-4f39-adf7-3d303dd11796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='393937bdf9974f43947b87b1e3bac7da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:53:52Z,use_quota=True,user_id='562167e244bf4aaba969e554f68e593f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f24fc0f7-b38c-4f9d-812b-7e3aa9d7392d tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57b28524-d1c7-42f9-a962-4cac80ce7c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f24fc0f7-b38c-4f9d-812b-7e3aa9d7392d tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57b28524-d1c7-42f9-a962-4cac80ce7c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f24fc0f7-b38c-4f9d-812b-7e3aa9d7392d tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cbddfeb-8e63-4d99-b8d7-b4ae70072f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f24fc0f7-b38c-4f9d-812b-7e3aa9d7392d tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cbddfeb-8e63-4d99-b8d7-b4ae70072f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '729de07e-e68a-4f39-adf7-3d303dd11796', 'volume_name': 'volume-729de07e-e68a-4f39-adf7-3d303dd11796', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f24fc0f7-b38c-4f9d-812b-7e3aa9d7392d tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cbbc680-aff7-486b-96c6-9b3f24cfad61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f24fc0f7-b38c-4f9d-812b-7e3aa9d7392d tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cbbc680-aff7-486b-96c6-9b3f24cfad61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f24fc0f7-b38c-4f9d-812b-7e3aa9d7392d tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8568f14a-a676-4564-bfda-768806b5d4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:51 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-f24fc0f7-b38c-4f9d-812b-7e3aa9d7392d tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Volume 729de07e-e68a-4f39-adf7-3d303dd11796: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-729de07e-e68a-4f39-adf7-3d303dd11796', 'volume_size': 1} Jul 31 10:53:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f24fc0f7-b38c-4f9d-812b-7e3aa9d7392d tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:52 devstack sudo[104214]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-19c58d46-9a41-4b21-901a-13f343a0fa34 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f65e8356-ebd5-466c-bda0-7ec464137920 1073741824" returned: 0 in 1.140s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-19c58d46-9a41-4b21-901a-13f343a0fa34 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f65e8356-ebd5-466c-bda0-7ec464137920 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:52 devstack sudo[104221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f65e8356-ebd5-466c-bda0-7ec464137920 Jul 31 10:53:52 devstack sudo[104221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:52 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-fed1e3b7-bf33-4b5f-b5a9-678fef8753bd tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:53:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fed1e3b7-bf33-4b5f-b5a9-678fef8753bd tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Flow 'volume_create_manager' (b1d32d17-c25a-4d51-baec-1cc60fea461e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:53:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fed1e3b7-bf33-4b5f-b5a9-678fef8753bd tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90f4000b-72bf-488f-aa45-8258ad2f0101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fed1e3b7-bf33-4b5f-b5a9-678fef8753bd tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90f4000b-72bf-488f-aa45-8258ad2f0101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-46271866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52090664-8e82-4cf4-9f5e-2500b7454b41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='393937bdf9974f43947b87b1e3bac7da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:53:52Z,use_quota=True,user_id='562167e244bf4aaba969e554f68e593f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fed1e3b7-bf33-4b5f-b5a9-678fef8753bd tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45149c1c-6232-46b5-bbfe-495071d5f0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fed1e3b7-bf33-4b5f-b5a9-678fef8753bd tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45149c1c-6232-46b5-bbfe-495071d5f0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fed1e3b7-bf33-4b5f-b5a9-678fef8753bd tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f40375ce-7b47-4944-b1e6-d55504dda4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fed1e3b7-bf33-4b5f-b5a9-678fef8753bd tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f40375ce-7b47-4944-b1e6-d55504dda4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52090664-8e82-4cf4-9f5e-2500b7454b41', 'volume_name': 'volume-52090664-8e82-4cf4-9f5e-2500b7454b41', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fed1e3b7-bf33-4b5f-b5a9-678fef8753bd tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e941c0-2490-42ba-837a-a2f72015f84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fed1e3b7-bf33-4b5f-b5a9-678fef8753bd tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e941c0-2490-42ba-837a-a2f72015f84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fed1e3b7-bf33-4b5f-b5a9-678fef8753bd tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57744b18-4566-41b9-8f70-da19d53afc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:52 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-fed1e3b7-bf33-4b5f-b5a9-678fef8753bd tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Volume 52090664-8e82-4cf4-9f5e-2500b7454b41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52090664-8e82-4cf4-9f5e-2500b7454b41', 'volume_size': 1} Jul 31 10:53:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-fed1e3b7-bf33-4b5f-b5a9-678fef8753bd tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:52 devstack sudo[104221]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-19c58d46-9a41-4b21-901a-13f343a0fa34 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f65e8356-ebd5-466c-bda0-7ec464137920" returned: 0 in 0.652s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:52 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-19c58d46-9a41-4b21-901a-13f343a0fa34 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:53:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-19c58d46-9a41-4b21-901a-13f343a0fa34 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.880s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f24fc0f7-b38c-4f9d-812b-7e3aa9d7392d tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.861s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:52 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f24fc0f7-b38c-4f9d-812b-7e3aa9d7392d tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1255871690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=729de07e-e68a-4f39-adf7-3d303dd11796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='393937bdf9974f43947b87b1e3bac7da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:53:52Z,use_quota=True,user_id='562167e244bf4aaba969e554f68e593f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:53:52 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-f24fc0f7-b38c-4f9d-812b-7e3aa9d7392d tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Creating volume 729de07e-e68a-4f39-adf7-3d303dd11796 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:53:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f24fc0f7-b38c-4f9d-812b-7e3aa9d7392d tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f24fc0f7-b38c-4f9d-812b-7e3aa9d7392d tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:52 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f24fc0f7-b38c-4f9d-812b-7e3aa9d7392d tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:53:52 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f24fc0f7-b38c-4f9d-812b-7e3aa9d7392d tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:53:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f24fc0f7-b38c-4f9d-812b-7e3aa9d7392d tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:52 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f24fc0f7-b38c-4f9d-812b-7e3aa9d7392d tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:53:52 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-f24fc0f7-b38c-4f9d-812b-7e3aa9d7392d tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:53:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f24fc0f7-b38c-4f9d-812b-7e3aa9d7392d tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-729de07e-e68a-4f39-adf7-3d303dd11796 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-19c58d46-9a41-4b21-901a-13f343a0fa34 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9d14a13-a764-47e1-acd9-21fb5de51e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f65e8356-ebd5-466c-bda0-7ec464137920', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:52 devstack sudo[104224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-729de07e-e68a-4f39-adf7-3d303dd11796 1073741824 Jul 31 10:53:52 devstack sudo[104224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-19c58d46-9a41-4b21-901a-13f343a0fa34 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce12ef1-6b5c-4e9b-9fed-64df81ebeeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:52 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-19c58d46-9a41-4b21-901a-13f343a0fa34 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Volume volume-f65e8356-ebd5-466c-bda0-7ec464137920 (f65e8356-ebd5-466c-bda0-7ec464137920): created successfully Jul 31 10:53:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-19c58d46-9a41-4b21-901a-13f343a0fa34 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce12ef1-6b5c-4e9b-9fed-64df81ebeeae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-19c58d46-9a41-4b21-901a-13f343a0fa34 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Flow 'volume_create_manager' (edfcca85-ce67-46ee-8601-788e8f865fa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:53:52 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-19c58d46-9a41-4b21-901a-13f343a0fa34 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Created volume successfully. Jul 31 10:53:53 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-67f4c56f-a23d-41fa-8da2-1cda6f1a6e15 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:53:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-67f4c56f-a23d-41fa-8da2-1cda6f1a6e15 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Flow 'volume_create_manager' (fd35a58f-e6b5-4001-8813-810ce87261c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:53:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-67f4c56f-a23d-41fa-8da2-1cda6f1a6e15 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc08ac93-1298-4d78-8756-c6f0f8273e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-67f4c56f-a23d-41fa-8da2-1cda6f1a6e15 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc08ac93-1298-4d78-8756-c6f0f8273e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-204911670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fcd593b-bc8c-44f0-921e-caedeb9033aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='393937bdf9974f43947b87b1e3bac7da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:53:53Z,use_quota=True,user_id='562167e244bf4aaba969e554f68e593f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-67f4c56f-a23d-41fa-8da2-1cda6f1a6e15 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a632356-8a37-441d-a498-7fd2816304c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-67f4c56f-a23d-41fa-8da2-1cda6f1a6e15 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a632356-8a37-441d-a498-7fd2816304c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-67f4c56f-a23d-41fa-8da2-1cda6f1a6e15 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (284fb07c-5f0d-42a6-8d09-ed4b12b1c557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-67f4c56f-a23d-41fa-8da2-1cda6f1a6e15 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (284fb07c-5f0d-42a6-8d09-ed4b12b1c557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fcd593b-bc8c-44f0-921e-caedeb9033aa', 'volume_name': 'volume-5fcd593b-bc8c-44f0-921e-caedeb9033aa', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-67f4c56f-a23d-41fa-8da2-1cda6f1a6e15 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20e7984a-850f-4780-acce-dc425d436fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-67f4c56f-a23d-41fa-8da2-1cda6f1a6e15 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20e7984a-850f-4780-acce-dc425d436fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-67f4c56f-a23d-41fa-8da2-1cda6f1a6e15 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1abc1b6f-7e6e-4166-8b5d-966d6307865a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:53 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-67f4c56f-a23d-41fa-8da2-1cda6f1a6e15 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Volume 5fcd593b-bc8c-44f0-921e-caedeb9033aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fcd593b-bc8c-44f0-921e-caedeb9033aa', 'volume_size': 1} Jul 31 10:53:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-67f4c56f-a23d-41fa-8da2-1cda6f1a6e15 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:53 devstack sudo[104224]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f24fc0f7-b38c-4f9d-812b-7e3aa9d7392d tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-729de07e-e68a-4f39-adf7-3d303dd11796 1073741824" returned: 0 in 0.950s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:53 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a32df66-da62-436b-8111-23fa2fa3b17b tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:53:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2a32df66-da62-436b-8111-23fa2fa3b17b tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Flow 'volume_create_manager' (e4a255ec-2adc-4e23-be5c-45f0d33e9ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:53:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2a32df66-da62-436b-8111-23fa2fa3b17b tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27298052-60fc-4c50-b152-8f5cc728e0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2a32df66-da62-436b-8111-23fa2fa3b17b tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27298052-60fc-4c50-b152-8f5cc728e0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1217993904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c321b29-9abd-4c79-a0c8-830695ab6660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='393937bdf9974f43947b87b1e3bac7da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:53:54Z,use_quota=True,user_id='562167e244bf4aaba969e554f68e593f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2a32df66-da62-436b-8111-23fa2fa3b17b tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f66536d-66b0-4089-8a9b-a9ac66826e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2a32df66-da62-436b-8111-23fa2fa3b17b tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f66536d-66b0-4089-8a9b-a9ac66826e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2a32df66-da62-436b-8111-23fa2fa3b17b tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff1b847f-cf68-4aab-b191-78bc421e0561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2a32df66-da62-436b-8111-23fa2fa3b17b tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff1b847f-cf68-4aab-b191-78bc421e0561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c321b29-9abd-4c79-a0c8-830695ab6660', 'volume_name': 'volume-1c321b29-9abd-4c79-a0c8-830695ab6660', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2a32df66-da62-436b-8111-23fa2fa3b17b tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4595acc8-ab41-4eb9-9135-f015d1883d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2a32df66-da62-436b-8111-23fa2fa3b17b tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4595acc8-ab41-4eb9-9135-f015d1883d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2a32df66-da62-436b-8111-23fa2fa3b17b tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (265a4a79-5650-47dc-a02d-3984dc3e034a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:53 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-2a32df66-da62-436b-8111-23fa2fa3b17b tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Volume 1c321b29-9abd-4c79-a0c8-830695ab6660: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c321b29-9abd-4c79-a0c8-830695ab6660', 'volume_size': 1} Jul 31 10:53:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2a32df66-da62-436b-8111-23fa2fa3b17b tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f24fc0f7-b38c-4f9d-812b-7e3aa9d7392d tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-729de07e-e68a-4f39-adf7-3d303dd11796 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:53 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-729de07e-e68a-4f39-adf7-3d303dd11796 Jul 31 10:53:53 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:54 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f24fc0f7-b38c-4f9d-812b-7e3aa9d7392d tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-729de07e-e68a-4f39-adf7-3d303dd11796" returned: 0 in 0.380s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:54 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f24fc0f7-b38c-4f9d-812b-7e3aa9d7392d tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:53:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f24fc0f7-b38c-4f9d-812b-7e3aa9d7392d tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-fed1e3b7-bf33-4b5f-b5a9-678fef8753bd tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.690s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:54 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-fed1e3b7-bf33-4b5f-b5a9-678fef8753bd tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-46271866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52090664-8e82-4cf4-9f5e-2500b7454b41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='393937bdf9974f43947b87b1e3bac7da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:53:52Z,use_quota=True,user_id='562167e244bf4aaba969e554f68e593f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:53:54 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-fed1e3b7-bf33-4b5f-b5a9-678fef8753bd tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Creating volume 52090664-8e82-4cf4-9f5e-2500b7454b41 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:53:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-fed1e3b7-bf33-4b5f-b5a9-678fef8753bd tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-fed1e3b7-bf33-4b5f-b5a9-678fef8753bd tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:54 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-fed1e3b7-bf33-4b5f-b5a9-678fef8753bd tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:53:54 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-fed1e3b7-bf33-4b5f-b5a9-678fef8753bd tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:53:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-fed1e3b7-bf33-4b5f-b5a9-678fef8753bd tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:54 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-fed1e3b7-bf33-4b5f-b5a9-678fef8753bd tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:53:54 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-fed1e3b7-bf33-4b5f-b5a9-678fef8753bd tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:53:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fed1e3b7-bf33-4b5f-b5a9-678fef8753bd tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-52090664-8e82-4cf4-9f5e-2500b7454b41 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:54 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f24fc0f7-b38c-4f9d-812b-7e3aa9d7392d tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8568f14a-a676-4564-bfda-768806b5d4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-729de07e-e68a-4f39-adf7-3d303dd11796', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:54 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f24fc0f7-b38c-4f9d-812b-7e3aa9d7392d tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01cea01f-053d-41d1-be7b-82955bae1c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:54 devstack sudo[104233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-52090664-8e82-4cf4-9f5e-2500b7454b41 1073741824 Jul 31 10:53:54 devstack sudo[104233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:54 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-f24fc0f7-b38c-4f9d-812b-7e3aa9d7392d tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Volume volume-729de07e-e68a-4f39-adf7-3d303dd11796 (729de07e-e68a-4f39-adf7-3d303dd11796): created successfully Jul 31 10:53:54 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f24fc0f7-b38c-4f9d-812b-7e3aa9d7392d tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01cea01f-053d-41d1-be7b-82955bae1c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:54 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f24fc0f7-b38c-4f9d-812b-7e3aa9d7392d tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Flow 'volume_create_manager' (6e3c1699-cc21-4ef5-85e0-f4ac359f7800) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:53:54 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-f24fc0f7-b38c-4f9d-812b-7e3aa9d7392d tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Created volume successfully. Jul 31 10:53:55 devstack sudo[104233]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fed1e3b7-bf33-4b5f-b5a9-678fef8753bd tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-52090664-8e82-4cf4-9f5e-2500b7454b41 1073741824" returned: 0 in 0.758s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fed1e3b7-bf33-4b5f-b5a9-678fef8753bd tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-52090664-8e82-4cf4-9f5e-2500b7454b41 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:55 devstack sudo[104239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-52090664-8e82-4cf4-9f5e-2500b7454b41 Jul 31 10:53:55 devstack sudo[104239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:55 devstack sudo[104239]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fed1e3b7-bf33-4b5f-b5a9-678fef8753bd tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-52090664-8e82-4cf4-9f5e-2500b7454b41" returned: 0 in 0.363s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:55 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-fed1e3b7-bf33-4b5f-b5a9-678fef8753bd tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:53:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-fed1e3b7-bf33-4b5f-b5a9-678fef8753bd tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-67f4c56f-a23d-41fa-8da2-1cda6f1a6e15 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.929s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:55 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-67f4c56f-a23d-41fa-8da2-1cda6f1a6e15 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-204911670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fcd593b-bc8c-44f0-921e-caedeb9033aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='393937bdf9974f43947b87b1e3bac7da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:53:53Z,use_quota=True,user_id='562167e244bf4aaba969e554f68e593f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:53:55 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-67f4c56f-a23d-41fa-8da2-1cda6f1a6e15 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Creating volume 5fcd593b-bc8c-44f0-921e-caedeb9033aa {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:53:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-67f4c56f-a23d-41fa-8da2-1cda6f1a6e15 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-67f4c56f-a23d-41fa-8da2-1cda6f1a6e15 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:55 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-67f4c56f-a23d-41fa-8da2-1cda6f1a6e15 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:53:55 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-67f4c56f-a23d-41fa-8da2-1cda6f1a6e15 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:53:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-67f4c56f-a23d-41fa-8da2-1cda6f1a6e15 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:55 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-67f4c56f-a23d-41fa-8da2-1cda6f1a6e15 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:53:55 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-67f4c56f-a23d-41fa-8da2-1cda6f1a6e15 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:53:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-67f4c56f-a23d-41fa-8da2-1cda6f1a6e15 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5fcd593b-bc8c-44f0-921e-caedeb9033aa 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fed1e3b7-bf33-4b5f-b5a9-678fef8753bd tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57744b18-4566-41b9-8f70-da19d53afc3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52090664-8e82-4cf4-9f5e-2500b7454b41', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:55 devstack sudo[104242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5fcd593b-bc8c-44f0-921e-caedeb9033aa 1073741824 Jul 31 10:53:55 devstack sudo[104242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fed1e3b7-bf33-4b5f-b5a9-678fef8753bd tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f897c02-11af-4e5a-bb70-41d63bd3c60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:55 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-fed1e3b7-bf33-4b5f-b5a9-678fef8753bd tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Volume volume-52090664-8e82-4cf4-9f5e-2500b7454b41 (52090664-8e82-4cf4-9f5e-2500b7454b41): created successfully Jul 31 10:53:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fed1e3b7-bf33-4b5f-b5a9-678fef8753bd tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f897c02-11af-4e5a-bb70-41d63bd3c60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fed1e3b7-bf33-4b5f-b5a9-678fef8753bd tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Flow 'volume_create_manager' (b1d32d17-c25a-4d51-baec-1cc60fea461e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:53:55 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-fed1e3b7-bf33-4b5f-b5a9-678fef8753bd tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Created volume successfully. Jul 31 10:53:56 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:53:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Flow 'volume_create_manager' (b2b165bb-9d65-4e6f-af5a-a8ee41e235f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:53:56 devstack sudo[104242]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f79fcd13-5ca7-436b-aa1f-2134cc707d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-67f4c56f-a23d-41fa-8da2-1cda6f1a6e15 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5fcd593b-bc8c-44f0-921e-caedeb9033aa 1073741824" returned: 0 in 0.979s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f79fcd13-5ca7-436b-aa1f-2134cc707d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1940566620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c573de3-ad17-479c-bf57-5510ca5db986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c84a53da2fd404e924afdd6916f7be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:53:56Z,use_quota=True,user_id='b37ad9fb5a954606b89f212166efe9f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba8e47eb-257e-46c4-81de-6508d1ccfbe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba8e47eb-257e-46c4-81de-6508d1ccfbe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7e78f57-5f7f-4bb4-a260-d3632f8c99e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:56 devstack cinder-volume[89090]: DEBUG cinder.image.glance [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Creating Keystone auth plugin from conf {{(pid=89090) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 10:53:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-67f4c56f-a23d-41fa-8da2-1cda6f1a6e15 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5fcd593b-bc8c-44f0-921e-caedeb9033aa {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:56 devstack sudo[104248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5fcd593b-bc8c-44f0-921e-caedeb9033aa Jul 31 10:53:56 devstack sudo[104248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:56 devstack sudo[104248]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-67f4c56f-a23d-41fa-8da2-1cda6f1a6e15 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5fcd593b-bc8c-44f0-921e-caedeb9033aa" returned: 0 in 0.375s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:56 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-67f4c56f-a23d-41fa-8da2-1cda6f1a6e15 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] <== create_volume: return (1447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:53:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-67f4c56f-a23d-41fa-8da2-1cda6f1a6e15 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.452s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2a32df66-da62-436b-8111-23fa2fa3b17b tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.096s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:57 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2a32df66-da62-436b-8111-23fa2fa3b17b tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1217993904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c321b29-9abd-4c79-a0c8-830695ab6660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='393937bdf9974f43947b87b1e3bac7da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:53:54Z,use_quota=True,user_id='562167e244bf4aaba969e554f68e593f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:53:57 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-2a32df66-da62-436b-8111-23fa2fa3b17b tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Creating volume 1c321b29-9abd-4c79-a0c8-830695ab6660 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:53:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2a32df66-da62-436b-8111-23fa2fa3b17b tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2a32df66-da62-436b-8111-23fa2fa3b17b tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:57 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2a32df66-da62-436b-8111-23fa2fa3b17b tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:53:57 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2a32df66-da62-436b-8111-23fa2fa3b17b tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:53:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2a32df66-da62-436b-8111-23fa2fa3b17b tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:57 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2a32df66-da62-436b-8111-23fa2fa3b17b tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:53:57 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-2a32df66-da62-436b-8111-23fa2fa3b17b tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:53:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2a32df66-da62-436b-8111-23fa2fa3b17b tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c321b29-9abd-4c79-a0c8-830695ab6660 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-67f4c56f-a23d-41fa-8da2-1cda6f1a6e15 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1abc1b6f-7e6e-4166-8b5d-966d6307865a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fcd593b-bc8c-44f0-921e-caedeb9033aa', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-67f4c56f-a23d-41fa-8da2-1cda6f1a6e15 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8893f29-d823-41a4-bda2-c524e63a27ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:57 devstack sudo[104251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c321b29-9abd-4c79-a0c8-830695ab6660 1073741824 Jul 31 10:53:57 devstack sudo[104251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:57 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-67f4c56f-a23d-41fa-8da2-1cda6f1a6e15 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Volume volume-5fcd593b-bc8c-44f0-921e-caedeb9033aa (5fcd593b-bc8c-44f0-921e-caedeb9033aa): created successfully Jul 31 10:53:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-67f4c56f-a23d-41fa-8da2-1cda6f1a6e15 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8893f29-d823-41a4-bda2-c524e63a27ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-67f4c56f-a23d-41fa-8da2-1cda6f1a6e15 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Flow 'volume_create_manager' (fd35a58f-e6b5-4001-8813-810ce87261c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:53:57 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-67f4c56f-a23d-41fa-8da2-1cda6f1a6e15 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Created volume successfully. Jul 31 10:53:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7e78f57-5f7f-4bb4-a260-d3632f8c99e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6c573de3-ad17-479c-bf57-5510ca5db986', 'volume_name': 'volume-6c573de3-ad17-479c-bf57-5510ca5db986', 'volume_size': 1, 'image_id': 'b429196b-9072-49ce-b54e-9693a9fd5306', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b429196b-9072-49ce-b54e-9693a9fd5306', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c7e7a60bc5b640caa5ec5fc5df1bd573', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b429196b-9072-49ce-b54e-9693a9fd5306', 'created_at': datetime.datetime(2026, 7, 31, 8, 33, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 33, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b429196b-9072-49ce-b54e-9693a9fd5306/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3951ddfd-6e59-4d6f-a6ce-b4bc238152d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3951ddfd-6e59-4d6f-a6ce-b4bc238152d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fe5f8df-9f33-42a0-847a-f8c20c32ce8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:57 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Volume 6c573de3-ad17-479c-bf57-5510ca5db986: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6c573de3-ad17-479c-bf57-5510ca5db986', 'volume_size': 1, 'image_id': 'b429196b-9072-49ce-b54e-9693a9fd5306', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b429196b-9072-49ce-b54e-9693a9fd5306', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c7e7a60bc5b640caa5ec5fc5df1bd573', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b429196b-9072-49ce-b54e-9693a9fd5306', 'created_at': datetime.datetime(2026, 7, 31, 8, 33, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 33, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b429196b-9072-49ce-b54e-9693a9fd5306/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 31 10:53:57 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Trying to clone 6c573de3-ad17-479c-bf57-5510ca5db986 from image b429196b-9072-49ce-b54e-9693a9fd5306 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b429196b-9072-49ce-b54e-9693a9fd5306', 'metadata': {}}]). {{(pid=89090) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 10:53:57 devstack sudo[104251]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2a32df66-da62-436b-8111-23fa2fa3b17b tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c321b29-9abd-4c79-a0c8-830695ab6660 1073741824" returned: 0 in 0.754s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:57 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_u0vx1fzedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89090) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 10:53:57 devstack cinder-volume[89090]: INFO cinder.image.image_utils [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Image download 20.69 MB at 20.69 MB/s Jul 31 10:53:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2a32df66-da62-436b-8111-23fa2fa3b17b tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c321b29-9abd-4c79-a0c8-830695ab6660 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:57 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de20b5b-2b66-4460-bf8a-8e03d05f4574]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:53:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_u0vx1fzedevstack@QuobyteHD {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:57 devstack sudo[104259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c321b29-9abd-4c79-a0c8-830695ab6660 Jul 31 10:53:57 devstack sudo[104259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:58 devstack sudo[104260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_u0vx1fzedevstack@QuobyteHD Jul 31 10:53:58 devstack sudo[104260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:58 devstack sudo[104259]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2a32df66-da62-436b-8111-23fa2fa3b17b tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c321b29-9abd-4c79-a0c8-830695ab6660" returned: 0 in 0.379s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:58 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2a32df66-da62-436b-8111-23fa2fa3b17b tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:53:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2a32df66-da62-436b-8111-23fa2fa3b17b tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2a32df66-da62-436b-8111-23fa2fa3b17b tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (265a4a79-5650-47dc-a02d-3984dc3e034a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c321b29-9abd-4c79-a0c8-830695ab6660', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2a32df66-da62-436b-8111-23fa2fa3b17b tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fad9392-4ef2-417a-9083-1972ad777787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:58 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-2a32df66-da62-436b-8111-23fa2fa3b17b tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Volume volume-1c321b29-9abd-4c79-a0c8-830695ab6660 (1c321b29-9abd-4c79-a0c8-830695ab6660): created successfully Jul 31 10:53:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2a32df66-da62-436b-8111-23fa2fa3b17b tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fad9392-4ef2-417a-9083-1972ad777787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2a32df66-da62-436b-8111-23fa2fa3b17b tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Flow 'volume_create_manager' (e4a255ec-2adc-4e23-be5c-45f0d33e9ee9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:53:58 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-2a32df66-da62-436b-8111-23fa2fa3b17b tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Created volume successfully. Jul 31 10:53:58 devstack sudo[104260]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_u0vx1fzedevstack@QuobyteHD" returned: 0 in 0.465s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:58 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Temporary image b429196b-9072-49ce-b54e-9693a9fd5306 is fetched for user b37ad9fb5a954606b89f212166efe9f5. {{(pid=89090) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 10:53:58 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[427f6c79-53fe-4c1b-8195-11e5a48170eb]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:53:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_u0vx1fzedevstack@QuobyteHD {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:58 devstack sudo[104268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_u0vx1fzedevstack@QuobyteHD Jul 31 10:53:58 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:58 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-c3d98a29-dbcb-424f-84a6-246ee701c3e4 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Acquiring lock "cinder-1c321b29-9abd-4c79-a0c8-830695ab6660-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:53:58 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-c3d98a29-dbcb-424f-84a6-246ee701c3e4 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "cinder-1c321b29-9abd-4c79-a0c8-830695ab6660-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:53:58 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-c3d98a29-dbcb-424f-84a6-246ee701c3e4 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Acquiring lock "cinder-quobyte-1c321b29-9abd-4c79-a0c8-830695ab6660" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:53:58 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-c3d98a29-dbcb-424f-84a6-246ee701c3e4 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "cinder-quobyte-1c321b29-9abd-4c79-a0c8-830695ab6660" acquired by "delete_volume" :: waited 0.034s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:53:58 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[11dd8333-e03b-429e-9c52-e4e809ff3388]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:53:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c3d98a29-dbcb-424f-84a6-246ee701c3e4 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c321b29-9abd-4c79-a0c8-830695ab6660 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:59 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_u0vx1fzedevstack@QuobyteHD" returned: 0 in 0.498s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:59 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1940566620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c573de3-ad17-479c-bf57-5510ca5db986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c84a53da2fd404e924afdd6916f7be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:53:56Z,use_quota=True,user_id='b37ad9fb5a954606b89f212166efe9f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:53:59 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Creating volume 6c573de3-ad17-479c-bf57-5510ca5db986 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:53:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:59 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:53:59 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:53:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:59 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:53:59 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:53:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6c573de3-ad17-479c-bf57-5510ca5db986 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:59 devstack sudo[104275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6c573de3-ad17-479c-bf57-5510ca5db986 1073741824 Jul 31 10:53:59 devstack sudo[104275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:59 devstack sudo[104274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c321b29-9abd-4c79-a0c8-830695ab6660 Jul 31 10:53:59 devstack sudo[104274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:59 devstack sudo[104274]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c3d98a29-dbcb-424f-84a6-246ee701c3e4 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c321b29-9abd-4c79-a0c8-830695ab6660" returned: 0 in 0.546s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c3d98a29-dbcb-424f-84a6-246ee701c3e4 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c321b29-9abd-4c79-a0c8-830695ab6660 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:59 devstack sudo[104284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c321b29-9abd-4c79-a0c8-830695ab6660 Jul 31 10:53:59 devstack sudo[104284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:59 devstack sudo[104275]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6c573de3-ad17-479c-bf57-5510ca5db986 1073741824" returned: 0 in 0.826s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6c573de3-ad17-479c-bf57-5510ca5db986 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:00 devstack sudo[104284]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:00 devstack sudo[104287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6c573de3-ad17-479c-bf57-5510ca5db986 Jul 31 10:54:00 devstack sudo[104287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c3d98a29-dbcb-424f-84a6-246ee701c3e4 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1c321b29-9abd-4c79-a0c8-830695ab6660" returned: 0 in 0.483s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:00 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-c3d98a29-dbcb-424f-84a6-246ee701c3e4 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "cinder-quobyte-1c321b29-9abd-4c79-a0c8-830695ab6660" released by "delete_volume" :: held 1.106s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:54:00 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-c3d98a29-dbcb-424f-84a6-246ee701c3e4 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Created reservations ['28df9c8c-2add-469b-8dc0-48dbc7c755c6', 'df06e39d-7362-4343-be00-08b440497c25', 'bf476ca1-6f9d-452c-9215-57641b547c05', '0badfe03-d56e-43a1-9c67-f30893f7a069'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:54:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c3d98a29-dbcb-424f-84a6-246ee701c3e4 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c3d98a29-dbcb-424f-84a6-246ee701c3e4 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:00 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c3d98a29-dbcb-424f-84a6-246ee701c3e4 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:54:00 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c3d98a29-dbcb-424f-84a6-246ee701c3e4 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:54:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c3d98a29-dbcb-424f-84a6-246ee701c3e4 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c3d98a29-dbcb-424f-84a6-246ee701c3e4 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:00 devstack sudo[104289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:54:00 devstack sudo[104289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:00 devstack sudo[104287]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6c573de3-ad17-479c-bf57-5510ca5db986" returned: 0 in 0.435s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:00 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] <== create_volume: return (1349ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:54:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:00 devstack cinder-volume[89090]: DEBUG cinder.volume.volume_utils [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Attempting download of b429196b-9072-49ce-b54e-9693a9fd5306 ((None, [{'url': 'file:///opt/stack/data/glance/images/b429196b-9072-49ce-b54e-9693a9fd5306', 'metadata': {}}])) to volume 6c573de3-ad17-479c-bf57-5510ca5db986. {{(pid=89090) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 10:54:00 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[0535320b-21e9-4de6-b151-630a763f5814]: (4, 'raw') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b429196b-9072-49ce-b54e-9693a9fd5306_kk__ovv5 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:00 devstack sudo[104289]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c3d98a29-dbcb-424f-84a6-246ee701c3e4 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.335s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:00 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-c3d98a29-dbcb-424f-84a6-246ee701c3e4 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:54:00 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-c3d98a29-dbcb-424f-84a6-246ee701c3e4 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Deleted volume successfully. Jul 31 10:54:00 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-c3d98a29-dbcb-424f-84a6-246ee701c3e4 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "cinder-1c321b29-9abd-4c79-a0c8-830695ab6660-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:54:00 devstack sudo[104292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b429196b-9072-49ce-b54e-9693a9fd5306_kk__ovv5 Jul 31 10:54:00 devstack sudo[104292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:00 devstack sudo[104292]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b429196b-9072-49ce-b54e-9693a9fd5306_kk__ovv5" returned: 0 in 0.489s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b429196b-9072-49ce-b54e-9693a9fd5306_kk__ovv5 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:01 devstack sudo[104323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b429196b-9072-49ce-b54e-9693a9fd5306_kk__ovv5 Jul 31 10:54:01 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:01 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e2795798-6ea2-4ca5-880f-342a6f21cc9c tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Acquiring lock "cinder-5fcd593b-bc8c-44f0-921e-caedeb9033aa-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:54:01 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e2795798-6ea2-4ca5-880f-342a6f21cc9c tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "cinder-5fcd593b-bc8c-44f0-921e-caedeb9033aa-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:54:01 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e2795798-6ea2-4ca5-880f-342a6f21cc9c tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Acquiring lock "cinder-quobyte-5fcd593b-bc8c-44f0-921e-caedeb9033aa" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:54:01 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e2795798-6ea2-4ca5-880f-342a6f21cc9c tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "cinder-quobyte-5fcd593b-bc8c-44f0-921e-caedeb9033aa" acquired by "delete_volume" :: waited 0.026s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:54:01 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b7e06e-66cf-4b7a-b7a2-ddd73cbd95c5]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e2795798-6ea2-4ca5-880f-342a6f21cc9c tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5fcd593b-bc8c-44f0-921e-caedeb9033aa {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:01 devstack sudo[104334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5fcd593b-bc8c-44f0-921e-caedeb9033aa Jul 31 10:54:01 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:01 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b429196b-9072-49ce-b54e-9693a9fd5306_kk__ovv5" returned: 1 in 0.538s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b429196b-9072-49ce-b54e-9693a9fd5306_kk__ovv5' failed. Not Retrying. {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 10:54:01 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba1504b-ec4f-4a6c-922f-f20bfc8af2ae]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_u0vx1fzedevstack@QuobyteHD {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:01 devstack sudo[104338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_u0vx1fzedevstack@QuobyteHD Jul 31 10:54:01 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:01 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e2795798-6ea2-4ca5-880f-342a6f21cc9c tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5fcd593b-bc8c-44f0-921e-caedeb9033aa" returned: 0 in 0.544s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e2795798-6ea2-4ca5-880f-342a6f21cc9c tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5fcd593b-bc8c-44f0-921e-caedeb9033aa {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:01 devstack sudo[104344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5fcd593b-bc8c-44f0-921e-caedeb9033aa Jul 31 10:54:01 devstack sudo[104344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:02 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_u0vx1fzedevstack@QuobyteHD" returned: 0 in 0.481s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:02 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] b429196b-9072-49ce-b54e-9693a9fd5306 was qcow2, converting to qcow2 {{(pid=89090) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 10:54:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_u0vx1fzedevstack@QuobyteHD /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6c573de3-ad17-479c-bf57-5510ca5db986 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:02 devstack sudo[104349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_u0vx1fzedevstack@QuobyteHD /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6c573de3-ad17-479c-bf57-5510ca5db986 Jul 31 10:54:02 devstack sudo[104349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:02 devstack sudo[104344]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e2795798-6ea2-4ca5-880f-342a6f21cc9c tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5fcd593b-bc8c-44f0-921e-caedeb9033aa" returned: 0 in 0.287s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:02 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e2795798-6ea2-4ca5-880f-342a6f21cc9c tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "cinder-quobyte-5fcd593b-bc8c-44f0-921e-caedeb9033aa" released by "delete_volume" :: held 0.908s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:54:02 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-e2795798-6ea2-4ca5-880f-342a6f21cc9c tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Created reservations ['c7ce89d0-45f1-4631-a42a-be6d7579eeaf', '83cb07bd-3de7-434f-aacf-745295723313', '5611c2a3-e42c-4677-8da1-2b97552f1f19', '8c1f5ef6-e9be-4346-abf3-bf48b1a5e58b'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:54:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e2795798-6ea2-4ca5-880f-342a6f21cc9c tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e2795798-6ea2-4ca5-880f-342a6f21cc9c tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:02 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-e2795798-6ea2-4ca5-880f-342a6f21cc9c tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:54:02 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-e2795798-6ea2-4ca5-880f-342a6f21cc9c tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:54:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e2795798-6ea2-4ca5-880f-342a6f21cc9c tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e2795798-6ea2-4ca5-880f-342a6f21cc9c tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:02 devstack sudo[104355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:54:02 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:02 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e2795798-6ea2-4ca5-880f-342a6f21cc9c tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.374s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:02 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-e2795798-6ea2-4ca5-880f-342a6f21cc9c tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:54:02 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-e2795798-6ea2-4ca5-880f-342a6f21cc9c tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Deleted volume successfully. Jul 31 10:54:02 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e2795798-6ea2-4ca5-880f-342a6f21cc9c tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "cinder-5fcd593b-bc8c-44f0-921e-caedeb9033aa-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:54:03 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a6107dc6-1f8d-43c6-8088-eab03ddc16d2 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Acquiring lock "cinder-52090664-8e82-4cf4-9f5e-2500b7454b41-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:54:03 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a6107dc6-1f8d-43c6-8088-eab03ddc16d2 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "cinder-52090664-8e82-4cf4-9f5e-2500b7454b41-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:54:03 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a6107dc6-1f8d-43c6-8088-eab03ddc16d2 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Acquiring lock "cinder-quobyte-52090664-8e82-4cf4-9f5e-2500b7454b41" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:54:03 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a6107dc6-1f8d-43c6-8088-eab03ddc16d2 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "cinder-quobyte-52090664-8e82-4cf4-9f5e-2500b7454b41" acquired by "delete_volume" :: waited 0.025s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:54:03 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a7da37-e676-48c0-a08c-9ac90e141eac]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a6107dc6-1f8d-43c6-8088-eab03ddc16d2 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-52090664-8e82-4cf4-9f5e-2500b7454b41 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:03 devstack sudo[104363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-52090664-8e82-4cf4-9f5e-2500b7454b41 Jul 31 10:54:03 devstack sudo[104363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:04 devstack sudo[104363]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a6107dc6-1f8d-43c6-8088-eab03ddc16d2 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-52090664-8e82-4cf4-9f5e-2500b7454b41" returned: 0 in 0.535s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a6107dc6-1f8d-43c6-8088-eab03ddc16d2 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-52090664-8e82-4cf4-9f5e-2500b7454b41 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:04 devstack sudo[104368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-52090664-8e82-4cf4-9f5e-2500b7454b41 Jul 31 10:54:04 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:04 devstack sudo[104349]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_u0vx1fzedevstack@QuobyteHD /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6c573de3-ad17-479c-bf57-5510ca5db986" returned: 0 in 2.544s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:04 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b429196b-9072-49ce-b54e-9693a9fd5306_u0vx1fzedevstack@QuobyteHD, size 112.00 MB, duration 2.55 sec, destination /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6c573de3-ad17-479c-bf57-5510ca5db986 {{(pid=89090) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 10:54:04 devstack cinder-volume[89090]: INFO cinder.image.image_utils [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Converted 112.00 MB image at 44.00 MB/s Jul 31 10:54:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6c573de3-ad17-479c-bf57-5510ca5db986 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:04 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a6107dc6-1f8d-43c6-8088-eab03ddc16d2 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-52090664-8e82-4cf4-9f5e-2500b7454b41" returned: 0 in 0.399s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:04 devstack sudo[104371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6c573de3-ad17-479c-bf57-5510ca5db986 1G Jul 31 10:54:04 devstack sudo[104371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:04 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a6107dc6-1f8d-43c6-8088-eab03ddc16d2 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "cinder-quobyte-52090664-8e82-4cf4-9f5e-2500b7454b41" released by "delete_volume" :: held 1.006s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:54:04 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-a6107dc6-1f8d-43c6-8088-eab03ddc16d2 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Created reservations ['dcaab6c7-2c09-4f3e-866b-47a714522f30', '7525a098-71cd-4117-bb03-298e07d93351', 'f78f9a04-1362-45ed-8b81-9e62e1b4271f', 'b7859385-833f-40e1-8030-9186601c8a35'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:54:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a6107dc6-1f8d-43c6-8088-eab03ddc16d2 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a6107dc6-1f8d-43c6-8088-eab03ddc16d2 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a6107dc6-1f8d-43c6-8088-eab03ddc16d2 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:54:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a6107dc6-1f8d-43c6-8088-eab03ddc16d2 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:54:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a6107dc6-1f8d-43c6-8088-eab03ddc16d2 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a6107dc6-1f8d-43c6-8088-eab03ddc16d2 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:04 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:54:04 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:05 devstack sudo[104371]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6c573de3-ad17-479c-bf57-5510ca5db986 1G" returned: 0 in 0.453s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:05 devstack cinder-volume[89090]: DEBUG cinder.volume.volume_utils [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Downloaded image b429196b-9072-49ce-b54e-9693a9fd5306 ((None, [{'url': 'file:///opt/stack/data/glance/images/b429196b-9072-49ce-b54e-9693a9fd5306', 'metadata': {}}])) to volume 6c573de3-ad17-479c-bf57-5510ca5db986 successfully. {{(pid=89090) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 10:54:05 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Temporary image b429196b-9072-49ce-b54e-9693a9fd5306 for user b37ad9fb5a954606b89f212166efe9f5 is deleted. {{(pid=89090) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 10:54:05 devstack cinder-volume[89090]: DEBUG cinder.volume.volume_utils [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Marking volume 6c573de3-ad17-479c-bf57-5510ca5db986 as bootable. {{(pid=89090) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 10:54:05 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Copying metadata from image b429196b-9072-49ce-b54e-9693a9fd5306 to 6c573de3-ad17-479c-bf57-5510ca5db986. {{(pid=89090) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 10:54:05 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Creating volume glance metadata for volume 6c573de3-ad17-479c-bf57-5510ca5db986 backed by image b429196b-9072-49ce-b54e-9693a9fd5306 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b429196b-9072-49ce-b54e-9693a9fd5306', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89090) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 10:54:05 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:05 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fe5f8df-9f33-42a0-847a-f8c20c32ce8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c573de3-ad17-479c-bf57-5510ca5db986', 'volume_size': 1, 'image_id': 'b429196b-9072-49ce-b54e-9693a9fd5306', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b429196b-9072-49ce-b54e-9693a9fd5306', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c7e7a60bc5b640caa5ec5fc5df1bd573', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b429196b-9072-49ce-b54e-9693a9fd5306', 'created_at': datetime.datetime(2026, 7, 31, 8, 33, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 33, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b429196b-9072-49ce-b54e-9693a9fd5306/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:05 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abc881b0-7854-421e-95e3-8e0938d62418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a6107dc6-1f8d-43c6-8088-eab03ddc16d2 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.374s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:05 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-a6107dc6-1f8d-43c6-8088-eab03ddc16d2 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:54:05 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-a6107dc6-1f8d-43c6-8088-eab03ddc16d2 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Deleted volume successfully. Jul 31 10:54:05 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Volume volume-6c573de3-ad17-479c-bf57-5510ca5db986 (6c573de3-ad17-479c-bf57-5510ca5db986): created successfully Jul 31 10:54:05 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abc881b0-7854-421e-95e3-8e0938d62418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:05 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Flow 'volume_create_manager' (b2b165bb-9d65-4e6f-af5a-a8ee41e235f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:54:05 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-c0872ebc-fe41-49ee-ba64-c8182caac930 tempest-VolumesExtendTest-1894311800 None] Created volume successfully. Jul 31 10:54:05 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a6107dc6-1f8d-43c6-8088-eab03ddc16d2 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "cinder-52090664-8e82-4cf4-9f5e-2500b7454b41-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:54:05 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-beb25343-fab1-459a-a993-cfb5495ad8f4 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Acquiring lock "cinder-729de07e-e68a-4f39-adf7-3d303dd11796-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:54:05 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-beb25343-fab1-459a-a993-cfb5495ad8f4 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "cinder-729de07e-e68a-4f39-adf7-3d303dd11796-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:54:05 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-beb25343-fab1-459a-a993-cfb5495ad8f4 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Acquiring lock "cinder-quobyte-729de07e-e68a-4f39-adf7-3d303dd11796" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:54:05 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-beb25343-fab1-459a-a993-cfb5495ad8f4 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "cinder-quobyte-729de07e-e68a-4f39-adf7-3d303dd11796" acquired by "delete_volume" :: waited 0.017s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:54:06 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff15e42-980b-426f-9daf-43a6c2325c9a]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-beb25343-fab1-459a-a993-cfb5495ad8f4 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-729de07e-e68a-4f39-adf7-3d303dd11796 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:06 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-729de07e-e68a-4f39-adf7-3d303dd11796 Jul 31 10:54:06 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a2a6adad-ff0d-418c-b904-19cc89baf3b6 tempest-VolumesExtendTest-1894311800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a2a6adad-ff0d-418c-b904-19cc89baf3b6 tempest-VolumesExtendTest-1894311800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:06 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5630ba9-af83-44ce-a1e1-d0f671e0f011]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a2a6adad-ff0d-418c-b904-19cc89baf3b6 tempest-VolumesExtendTest-1894311800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6c573de3-ad17-479c-bf57-5510ca5db986 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:06 devstack sudo[104382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6c573de3-ad17-479c-bf57-5510ca5db986 Jul 31 10:54:06 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:06 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-beb25343-fab1-459a-a993-cfb5495ad8f4 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-729de07e-e68a-4f39-adf7-3d303dd11796" returned: 0 in 0.623s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-beb25343-fab1-459a-a993-cfb5495ad8f4 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-729de07e-e68a-4f39-adf7-3d303dd11796 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:06 devstack sudo[104387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-729de07e-e68a-4f39-adf7-3d303dd11796 Jul 31 10:54:06 devstack sudo[104387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:07 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a2a6adad-ff0d-418c-b904-19cc89baf3b6 tempest-VolumesExtendTest-1894311800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6c573de3-ad17-479c-bf57-5510ca5db986" returned: 0 in 0.594s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a2a6adad-ff0d-418c-b904-19cc89baf3b6 tempest-VolumesExtendTest-1894311800 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6c573de3-ad17-479c-bf57-5510ca5db986 2G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:07 devstack sudo[104387]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-beb25343-fab1-459a-a993-cfb5495ad8f4 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-729de07e-e68a-4f39-adf7-3d303dd11796" returned: 0 in 0.453s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:07 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-beb25343-fab1-459a-a993-cfb5495ad8f4 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "cinder-quobyte-729de07e-e68a-4f39-adf7-3d303dd11796" released by "delete_volume" :: held 1.153s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:54:07 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-beb25343-fab1-459a-a993-cfb5495ad8f4 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Created reservations ['f6e16f1c-40e4-43f8-9093-1cb81149eb26', 'efc5d149-ee91-4e88-af13-a81ee314d287', 'd4577658-577a-4df6-9171-352a50477a63', '7e210d96-e2a0-4279-839a-abbf9a245d04'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:54:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a2a6adad-ff0d-418c-b904-19cc89baf3b6 tempest-VolumesExtendTest-1894311800 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6c573de3-ad17-479c-bf57-5510ca5db986 2G" returned: 0 in 0.181s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a2a6adad-ff0d-418c-b904-19cc89baf3b6 tempest-VolumesExtendTest-1894311800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.833s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:07 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-a2a6adad-ff0d-418c-b904-19cc89baf3b6 tempest-VolumesExtendTest-1894311800 None] Extend volume completed successfully. Jul 31 10:54:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-beb25343-fab1-459a-a993-cfb5495ad8f4 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-beb25343-fab1-459a-a993-cfb5495ad8f4 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:07 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-beb25343-fab1-459a-a993-cfb5495ad8f4 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:54:07 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-beb25343-fab1-459a-a993-cfb5495ad8f4 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:54:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-beb25343-fab1-459a-a993-cfb5495ad8f4 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-beb25343-fab1-459a-a993-cfb5495ad8f4 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:07 devstack sudo[104431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:54:07 devstack sudo[104431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:07 devstack sudo[104431]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-beb25343-fab1-459a-a993-cfb5495ad8f4 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.424s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:07 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-beb25343-fab1-459a-a993-cfb5495ad8f4 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:54:07 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-beb25343-fab1-459a-a993-cfb5495ad8f4 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Deleted volume successfully. Jul 31 10:54:07 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-beb25343-fab1-459a-a993-cfb5495ad8f4 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "cinder-729de07e-e68a-4f39-adf7-3d303dd11796-delete_volume" released by "delete_volume" :: held 1.948s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:54:07 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-905a74a0-0bcc-4584-a15d-3f3e499c7ebd tempest-VolumesExtendTest-1894311800 None] Acquiring lock "cinder-6c573de3-ad17-479c-bf57-5510ca5db986-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:54:07 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-905a74a0-0bcc-4584-a15d-3f3e499c7ebd tempest-VolumesExtendTest-1894311800 None] Lock "cinder-6c573de3-ad17-479c-bf57-5510ca5db986-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:54:08 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-905a74a0-0bcc-4584-a15d-3f3e499c7ebd tempest-VolumesExtendTest-1894311800 None] Acquiring lock "cinder-quobyte-6c573de3-ad17-479c-bf57-5510ca5db986" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:54:08 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-905a74a0-0bcc-4584-a15d-3f3e499c7ebd tempest-VolumesExtendTest-1894311800 None] Lock "cinder-quobyte-6c573de3-ad17-479c-bf57-5510ca5db986" acquired by "delete_volume" :: waited 0.027s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:54:08 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2250132-f0e2-445e-8047-0689d90867cb]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-905a74a0-0bcc-4584-a15d-3f3e499c7ebd tempest-VolumesExtendTest-1894311800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6c573de3-ad17-479c-bf57-5510ca5db986 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:08 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-08c1a3fd-d355-4139-8230-451f487aa2e6 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Acquiring lock "cinder-f65e8356-ebd5-466c-bda0-7ec464137920-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:54:08 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-08c1a3fd-d355-4139-8230-451f487aa2e6 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "cinder-f65e8356-ebd5-466c-bda0-7ec464137920-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:54:08 devstack sudo[104437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6c573de3-ad17-479c-bf57-5510ca5db986 Jul 31 10:54:08 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:08 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-08c1a3fd-d355-4139-8230-451f487aa2e6 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Acquiring lock "cinder-quobyte-f65e8356-ebd5-466c-bda0-7ec464137920" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:54:08 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-08c1a3fd-d355-4139-8230-451f487aa2e6 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "cinder-quobyte-f65e8356-ebd5-466c-bda0-7ec464137920" acquired by "delete_volume" :: waited 0.031s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:54:08 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8818dd-b43c-4fc6-a40b-688ba5fa578a]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-08c1a3fd-d355-4139-8230-451f487aa2e6 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f65e8356-ebd5-466c-bda0-7ec464137920 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:08 devstack sudo[104440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f65e8356-ebd5-466c-bda0-7ec464137920 Jul 31 10:54:08 devstack sudo[104440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:08 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-905a74a0-0bcc-4584-a15d-3f3e499c7ebd tempest-VolumesExtendTest-1894311800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6c573de3-ad17-479c-bf57-5510ca5db986" returned: 0 in 0.773s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-905a74a0-0bcc-4584-a15d-3f3e499c7ebd tempest-VolumesExtendTest-1894311800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6c573de3-ad17-479c-bf57-5510ca5db986 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:08 devstack sudo[104446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6c573de3-ad17-479c-bf57-5510ca5db986 Jul 31 10:54:08 devstack sudo[104446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:09 devstack sudo[104440]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-08c1a3fd-d355-4139-8230-451f487aa2e6 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f65e8356-ebd5-466c-bda0-7ec464137920" returned: 0 in 0.721s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-08c1a3fd-d355-4139-8230-451f487aa2e6 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f65e8356-ebd5-466c-bda0-7ec464137920 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:09 devstack sudo[104451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f65e8356-ebd5-466c-bda0-7ec464137920 Jul 31 10:54:09 devstack sudo[104451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:09 devstack sudo[104446]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-905a74a0-0bcc-4584-a15d-3f3e499c7ebd tempest-VolumesExtendTest-1894311800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6c573de3-ad17-479c-bf57-5510ca5db986" returned: 0 in 0.530s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:09 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-905a74a0-0bcc-4584-a15d-3f3e499c7ebd tempest-VolumesExtendTest-1894311800 None] Lock "cinder-quobyte-6c573de3-ad17-479c-bf57-5510ca5db986" released by "delete_volume" :: held 1.369s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:54:09 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-905a74a0-0bcc-4584-a15d-3f3e499c7ebd tempest-VolumesExtendTest-1894311800 None] Created reservations ['9c42622d-451f-4f6b-a8b2-e6f204fad65f', '84e2abf3-b673-430c-a83d-03c664e0aa6a', '30fe3f4c-4aad-4692-8176-2103b8e25b75', '5c2d831a-02e5-459f-841e-80633f0a8efd'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:54:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-905a74a0-0bcc-4584-a15d-3f3e499c7ebd tempest-VolumesExtendTest-1894311800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-905a74a0-0bcc-4584-a15d-3f3e499c7ebd tempest-VolumesExtendTest-1894311800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:09 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-905a74a0-0bcc-4584-a15d-3f3e499c7ebd tempest-VolumesExtendTest-1894311800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:54:09 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-905a74a0-0bcc-4584-a15d-3f3e499c7ebd tempest-VolumesExtendTest-1894311800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:54:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-905a74a0-0bcc-4584-a15d-3f3e499c7ebd tempest-VolumesExtendTest-1894311800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-905a74a0-0bcc-4584-a15d-3f3e499c7ebd tempest-VolumesExtendTest-1894311800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:09 devstack sudo[104455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:54:09 devstack sudo[104455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:09 devstack sudo[104451]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-08c1a3fd-d355-4139-8230-451f487aa2e6 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f65e8356-ebd5-466c-bda0-7ec464137920" returned: 0 in 0.596s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:09 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-08c1a3fd-d355-4139-8230-451f487aa2e6 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "cinder-quobyte-f65e8356-ebd5-466c-bda0-7ec464137920" released by "delete_volume" :: held 1.426s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:54:09 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-08c1a3fd-d355-4139-8230-451f487aa2e6 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Created reservations ['b8361841-2a58-43ef-95ff-569d711ba218', '6be741c2-e3b5-46e0-8e3e-5a46025aa1de', 'e94ab4c6-3ef4-40d5-a09e-47f0b493f2c6', '4f9b6061-6ec3-4318-8baa-06ab8aecea85'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:54:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-08c1a3fd-d355-4139-8230-451f487aa2e6 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-08c1a3fd-d355-4139-8230-451f487aa2e6 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:10 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-08c1a3fd-d355-4139-8230-451f487aa2e6 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:54:10 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-08c1a3fd-d355-4139-8230-451f487aa2e6 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:54:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-08c1a3fd-d355-4139-8230-451f487aa2e6 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-08c1a3fd-d355-4139-8230-451f487aa2e6 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:10 devstack sudo[104455]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-905a74a0-0bcc-4584-a15d-3f3e499c7ebd tempest-VolumesExtendTest-1894311800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.474s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:10 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-905a74a0-0bcc-4584-a15d-3f3e499c7ebd tempest-VolumesExtendTest-1894311800 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:54:10 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-905a74a0-0bcc-4584-a15d-3f3e499c7ebd tempest-VolumesExtendTest-1894311800 None] Deleted volume successfully. Jul 31 10:54:10 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:54:10 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-905a74a0-0bcc-4584-a15d-3f3e499c7ebd tempest-VolumesExtendTest-1894311800 None] Lock "cinder-6c573de3-ad17-479c-bf57-5510ca5db986-delete_volume" released by "delete_volume" :: held 2.207s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:54:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ef0b087a-5b29-4beb-9192-0dad3310a7df tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Acquiring lock "cinder-8a37147b-e652-4c36-b6bc-2f9b0f2b40c0-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:54:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ef0b087a-5b29-4beb-9192-0dad3310a7df tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "cinder-8a37147b-e652-4c36-b6bc-2f9b0f2b40c0-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:54:10 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-08c1a3fd-d355-4139-8230-451f487aa2e6 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.696s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:10 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-08c1a3fd-d355-4139-8230-451f487aa2e6 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:54:10 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-08c1a3fd-d355-4139-8230-451f487aa2e6 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Deleted volume successfully. Jul 31 10:54:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ef0b087a-5b29-4beb-9192-0dad3310a7df tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Acquiring lock "cinder-quobyte-8a37147b-e652-4c36-b6bc-2f9b0f2b40c0" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:54:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ef0b087a-5b29-4beb-9192-0dad3310a7df tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "cinder-quobyte-8a37147b-e652-4c36-b6bc-2f9b0f2b40c0" acquired by "delete_volume" :: waited 0.043s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:54:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-08c1a3fd-d355-4139-8230-451f487aa2e6 tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "cinder-f65e8356-ebd5-466c-bda0-7ec464137920-delete_volume" released by "delete_volume" :: held 2.741s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:54:10 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[acaf2e93-cb6d-42a0-beec-731ffc1c6f5a]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ef0b087a-5b29-4beb-9192-0dad3310a7df tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8a37147b-e652-4c36-b6bc-2f9b0f2b40c0 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:11 devstack sudo[104461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8a37147b-e652-4c36-b6bc-2f9b0f2b40c0 Jul 31 10:54:11 devstack sudo[104461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:11 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-db4a5108-9e7f-40cd-8397-98ac776107d6 tempest-VolumesExtendTest-1894311800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:54:11 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-db4a5108-9e7f-40cd-8397-98ac776107d6 tempest-VolumesExtendTest-1894311800 None] Flow 'volume_create_manager' (7b22d1cf-8077-4b95-bd37-69defbf7b5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:54:11 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-db4a5108-9e7f-40cd-8397-98ac776107d6 tempest-VolumesExtendTest-1894311800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85fb6f5f-b14a-4fd6-ba73-683927cca451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:11 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-db4a5108-9e7f-40cd-8397-98ac776107d6 tempest-VolumesExtendTest-1894311800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85fb6f5f-b14a-4fd6-ba73-683927cca451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1736505727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3c5cd63-18bb-4367-966f-b64517511570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c84a53da2fd404e924afdd6916f7be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:54:11Z,use_quota=True,user_id='b37ad9fb5a954606b89f212166efe9f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:11 devstack sudo[104461]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:11 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-db4a5108-9e7f-40cd-8397-98ac776107d6 tempest-VolumesExtendTest-1894311800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d36d19fe-adbd-4001-81d2-cc8648bd6a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:11 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-db4a5108-9e7f-40cd-8397-98ac776107d6 tempest-VolumesExtendTest-1894311800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d36d19fe-adbd-4001-81d2-cc8648bd6a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:11 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-db4a5108-9e7f-40cd-8397-98ac776107d6 tempest-VolumesExtendTest-1894311800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d4f35b4-039b-4649-875c-d1a89731f9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:11 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-db4a5108-9e7f-40cd-8397-98ac776107d6 tempest-VolumesExtendTest-1894311800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d4f35b4-039b-4649-875c-d1a89731f9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3c5cd63-18bb-4367-966f-b64517511570', 'volume_name': 'volume-f3c5cd63-18bb-4367-966f-b64517511570', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:11 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-db4a5108-9e7f-40cd-8397-98ac776107d6 tempest-VolumesExtendTest-1894311800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (388fac0b-279e-462c-b08b-5451499e1e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:11 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-db4a5108-9e7f-40cd-8397-98ac776107d6 tempest-VolumesExtendTest-1894311800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (388fac0b-279e-462c-b08b-5451499e1e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:11 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-db4a5108-9e7f-40cd-8397-98ac776107d6 tempest-VolumesExtendTest-1894311800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efdbb246-1bf2-4089-9cfa-5ac3a1552cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:11 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-db4a5108-9e7f-40cd-8397-98ac776107d6 tempest-VolumesExtendTest-1894311800 None] Volume f3c5cd63-18bb-4367-966f-b64517511570: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3c5cd63-18bb-4367-966f-b64517511570', 'volume_size': 1} Jul 31 10:54:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-db4a5108-9e7f-40cd-8397-98ac776107d6 tempest-VolumesExtendTest-1894311800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-db4a5108-9e7f-40cd-8397-98ac776107d6 tempest-VolumesExtendTest-1894311800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:11 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-db4a5108-9e7f-40cd-8397-98ac776107d6 tempest-VolumesExtendTest-1894311800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1736505727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3c5cd63-18bb-4367-966f-b64517511570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c84a53da2fd404e924afdd6916f7be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:54:11Z,use_quota=True,user_id='b37ad9fb5a954606b89f212166efe9f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:54:11 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-db4a5108-9e7f-40cd-8397-98ac776107d6 tempest-VolumesExtendTest-1894311800 None] Creating volume f3c5cd63-18bb-4367-966f-b64517511570 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:54:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-db4a5108-9e7f-40cd-8397-98ac776107d6 tempest-VolumesExtendTest-1894311800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-db4a5108-9e7f-40cd-8397-98ac776107d6 tempest-VolumesExtendTest-1894311800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:11 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-db4a5108-9e7f-40cd-8397-98ac776107d6 tempest-VolumesExtendTest-1894311800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:54:11 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-db4a5108-9e7f-40cd-8397-98ac776107d6 tempest-VolumesExtendTest-1894311800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:54:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-db4a5108-9e7f-40cd-8397-98ac776107d6 tempest-VolumesExtendTest-1894311800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:11 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-db4a5108-9e7f-40cd-8397-98ac776107d6 tempest-VolumesExtendTest-1894311800 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:54:11 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-db4a5108-9e7f-40cd-8397-98ac776107d6 tempest-VolumesExtendTest-1894311800 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:54:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-db4a5108-9e7f-40cd-8397-98ac776107d6 tempest-VolumesExtendTest-1894311800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ef0b087a-5b29-4beb-9192-0dad3310a7df tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8a37147b-e652-4c36-b6bc-2f9b0f2b40c0" returned: 0 in 0.618s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ef0b087a-5b29-4beb-9192-0dad3310a7df tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8a37147b-e652-4c36-b6bc-2f9b0f2b40c0 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:11 devstack sudo[104472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570 1073741824 Jul 31 10:54:11 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:11 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8a37147b-e652-4c36-b6bc-2f9b0f2b40c0 Jul 31 10:54:11 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:11 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ef0b087a-5b29-4beb-9192-0dad3310a7df tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8a37147b-e652-4c36-b6bc-2f9b0f2b40c0" returned: 0 in 0.401s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:11 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ef0b087a-5b29-4beb-9192-0dad3310a7df tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "cinder-quobyte-8a37147b-e652-4c36-b6bc-2f9b0f2b40c0" released by "delete_volume" :: held 1.101s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:54:12 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-ef0b087a-5b29-4beb-9192-0dad3310a7df tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Created reservations ['de0a9399-f8c1-4ffe-b10c-445036e2f3ff', '28cdd772-a4cc-4ee6-80ba-62ec03840db6', '5f2bb49a-1726-4e12-b208-30e8d5a533be', '0f5f4cb1-8bae-4593-99b7-6e58b4b3f977'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:54:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ef0b087a-5b29-4beb-9192-0dad3310a7df tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ef0b087a-5b29-4beb-9192-0dad3310a7df tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:12 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ef0b087a-5b29-4beb-9192-0dad3310a7df tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:54:12 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ef0b087a-5b29-4beb-9192-0dad3310a7df tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:54:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ef0b087a-5b29-4beb-9192-0dad3310a7df tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ef0b087a-5b29-4beb-9192-0dad3310a7df tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:12 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-db4a5108-9e7f-40cd-8397-98ac776107d6 tempest-VolumesExtendTest-1894311800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570 1073741824" returned: 0 in 0.649s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:12 devstack sudo[104483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:54:12 devstack sudo[104483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-db4a5108-9e7f-40cd-8397-98ac776107d6 tempest-VolumesExtendTest-1894311800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:12 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570 Jul 31 10:54:12 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:12 devstack sudo[104483]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ef0b087a-5b29-4beb-9192-0dad3310a7df tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.333s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:12 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-ef0b087a-5b29-4beb-9192-0dad3310a7df tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:54:12 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-ef0b087a-5b29-4beb-9192-0dad3310a7df tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Deleted volume successfully. Jul 31 10:54:12 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ef0b087a-5b29-4beb-9192-0dad3310a7df tempest-CreateVolumesFromSourceVolumeTest-1202922448 None] Lock "cinder-8a37147b-e652-4c36-b6bc-2f9b0f2b40c0-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:54:12 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-db4a5108-9e7f-40cd-8397-98ac776107d6 tempest-VolumesExtendTest-1894311800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570" returned: 0 in 0.341s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:12 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-db4a5108-9e7f-40cd-8397-98ac776107d6 tempest-VolumesExtendTest-1894311800 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:54:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-db4a5108-9e7f-40cd-8397-98ac776107d6 tempest-VolumesExtendTest-1894311800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-db4a5108-9e7f-40cd-8397-98ac776107d6 tempest-VolumesExtendTest-1894311800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efdbb246-1bf2-4089-9cfa-5ac3a1552cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3c5cd63-18bb-4367-966f-b64517511570', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-db4a5108-9e7f-40cd-8397-98ac776107d6 tempest-VolumesExtendTest-1894311800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42c0b971-bc57-481b-ab86-5c9afc473a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:12 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-db4a5108-9e7f-40cd-8397-98ac776107d6 tempest-VolumesExtendTest-1894311800 None] Volume volume-f3c5cd63-18bb-4367-966f-b64517511570 (f3c5cd63-18bb-4367-966f-b64517511570): created successfully Jul 31 10:54:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-db4a5108-9e7f-40cd-8397-98ac776107d6 tempest-VolumesExtendTest-1894311800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42c0b971-bc57-481b-ab86-5c9afc473a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-db4a5108-9e7f-40cd-8397-98ac776107d6 tempest-VolumesExtendTest-1894311800 None] Flow 'volume_create_manager' (7b22d1cf-8077-4b95-bd37-69defbf7b5ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:54:12 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-db4a5108-9e7f-40cd-8397-98ac776107d6 tempest-VolumesExtendTest-1894311800 None] Created volume successfully. Jul 31 10:54:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6f8045e8-3db8-4f29-9fbf-2f1c7744c8dc tempest-VolumesExtendTest-1894311800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6f8045e8-3db8-4f29-9fbf-2f1c7744c8dc tempest-VolumesExtendTest-1894311800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:13 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-6f8045e8-3db8-4f29-9fbf-2f1c7744c8dc tempest-VolumesExtendTest-1894311800 None] Creating offline snapshot 46158819-abb4-40ad-9c7e-c75251128465 of volume f3c5cd63-18bb-4367-966f-b64517511570 {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:54:13 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e38212e-1283-4982-a563-8f15afc00a3b]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6f8045e8-3db8-4f29-9fbf-2f1c7744c8dc tempest-VolumesExtendTest-1894311800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:13 devstack sudo[104489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570 Jul 31 10:54:13 devstack sudo[104489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:14 devstack sudo[104489]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6f8045e8-3db8-4f29-9fbf-2f1c7744c8dc tempest-VolumesExtendTest-1894311800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570" returned: 0 in 0.482s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6f8045e8-3db8-4f29-9fbf-2f1c7744c8dc tempest-VolumesExtendTest-1894311800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570.46158819-abb4-40ad-9c7e-c75251128465 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:14 devstack sudo[104494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570.46158819-abb4-40ad-9c7e-c75251128465 1G Jul 31 10:54:14 devstack sudo[104494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:14 devstack sudo[104494]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6f8045e8-3db8-4f29-9fbf-2f1c7744c8dc tempest-VolumesExtendTest-1894311800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570.46158819-abb4-40ad-9c7e-c75251128465 1G" returned: 0 in 0.573s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6f8045e8-3db8-4f29-9fbf-2f1c7744c8dc tempest-VolumesExtendTest-1894311800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3c5cd63-18bb-4367-966f-b64517511570 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570.46158819-abb4-40ad-9c7e-c75251128465 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:14 devstack sudo[104499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3c5cd63-18bb-4367-966f-b64517511570 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570.46158819-abb4-40ad-9c7e-c75251128465 Jul 31 10:54:14 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:15 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6f8045e8-3db8-4f29-9fbf-2f1c7744c8dc tempest-VolumesExtendTest-1894311800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3c5cd63-18bb-4367-966f-b64517511570 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570.46158819-abb4-40ad-9c7e-c75251128465" returned: 0 in 0.374s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:15 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-6f8045e8-3db8-4f29-9fbf-2f1c7744c8dc tempest-VolumesExtendTest-1894311800 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570.46158819-abb4-40ad-9c7e-c75251128465 is being set with open permissions: ugo+rw Jul 31 10:54:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6f8045e8-3db8-4f29-9fbf-2f1c7744c8dc tempest-VolumesExtendTest-1894311800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570.46158819-abb4-40ad-9c7e-c75251128465 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:15 devstack sudo[104504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570.46158819-abb4-40ad-9c7e-c75251128465 Jul 31 10:54:15 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:15 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6f8045e8-3db8-4f29-9fbf-2f1c7744c8dc tempest-VolumesExtendTest-1894311800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570.46158819-abb4-40ad-9c7e-c75251128465" returned: 0 in 0.326s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6f8045e8-3db8-4f29-9fbf-2f1c7744c8dc tempest-VolumesExtendTest-1894311800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:15 devstack sudo[104507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570.info Jul 31 10:54:15 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:15 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6f8045e8-3db8-4f29-9fbf-2f1c7744c8dc tempest-VolumesExtendTest-1894311800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570.info" returned: 0 in 0.319s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:15 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-6f8045e8-3db8-4f29-9fbf-2f1c7744c8dc tempest-VolumesExtendTest-1894311800 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570.info is being set with open permissions: ugo+rw Jul 31 10:54:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6f8045e8-3db8-4f29-9fbf-2f1c7744c8dc tempest-VolumesExtendTest-1894311800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:15 devstack sudo[104511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570.info Jul 31 10:54:15 devstack sudo[104511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:16 devstack sudo[104511]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6f8045e8-3db8-4f29-9fbf-2f1c7744c8dc tempest-VolumesExtendTest-1894311800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570.info" returned: 0 in 0.288s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6f8045e8-3db8-4f29-9fbf-2f1c7744c8dc tempest-VolumesExtendTest-1894311800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.494s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:16 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-6f8045e8-3db8-4f29-9fbf-2f1c7744c8dc tempest-VolumesExtendTest-1894311800 None] Create snapshot completed successfully Jul 31 10:54:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-879e065e-4bd2-4d2e-8081-3cc5a0c399f5 tempest-VolumesExtendTest-1894311800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-879e065e-4bd2-4d2e-8081-3cc5a0c399f5 tempest-VolumesExtendTest-1894311800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.005s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:17 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da7b8db-95b5-4b94-acb0-76cc092dece3]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-879e065e-4bd2-4d2e-8081-3cc5a0c399f5 tempest-VolumesExtendTest-1894311800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:17 devstack sudo[104514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570 Jul 31 10:54:17 devstack sudo[104514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:17 devstack sudo[104514]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-879e065e-4bd2-4d2e-8081-3cc5a0c399f5 tempest-VolumesExtendTest-1894311800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570" returned: 0 in 0.487s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-879e065e-4bd2-4d2e-8081-3cc5a0c399f5 tempest-VolumesExtendTest-1894311800 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570.46158819-abb4-40ad-9c7e-c75251128465 2G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-879e065e-4bd2-4d2e-8081-3cc5a0c399f5 tempest-VolumesExtendTest-1894311800 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570.46158819-abb4-40ad-9c7e-c75251128465 2G" returned: 0 in 0.320s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-879e065e-4bd2-4d2e-8081-3cc5a0c399f5 tempest-VolumesExtendTest-1894311800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.858s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:18 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-879e065e-4bd2-4d2e-8081-3cc5a0c399f5 tempest-VolumesExtendTest-1894311800 None] Extend volume completed successfully. Jul 31 10:54:18 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-54fb4765-bce7-4017-a5b0-37123b662ba5 tempest-VolumesExtendTest-1894311800 None] Acquiring lock "cinder-46158819-abb4-40ad-9c7e-c75251128465-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:54:18 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-54fb4765-bce7-4017-a5b0-37123b662ba5 tempest-VolumesExtendTest-1894311800 None] Lock "cinder-46158819-abb4-40ad-9c7e-c75251128465-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:54:18 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-54fb4765-bce7-4017-a5b0-37123b662ba5 tempest-VolumesExtendTest-1894311800 None] Acquiring lock "cinder-quobyte-f3c5cd63-18bb-4367-966f-b64517511570" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:54:18 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-54fb4765-bce7-4017-a5b0-37123b662ba5 tempest-VolumesExtendTest-1894311800 None] Lock "cinder-quobyte-f3c5cd63-18bb-4367-966f-b64517511570" acquired by "delete_snapshot" :: waited 0.030s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:54:18 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-54fb4765-bce7-4017-a5b0-37123b662ba5 tempest-VolumesExtendTest-1894311800 None] Acquiring lock "cinder-quobyte-46158819-abb4-40ad-9c7e-c75251128465" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:54:18 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-54fb4765-bce7-4017-a5b0-37123b662ba5 tempest-VolumesExtendTest-1894311800 None] Lock "cinder-quobyte-46158819-abb4-40ad-9c7e-c75251128465" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:54:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-54fb4765-bce7-4017-a5b0-37123b662ba5 tempest-VolumesExtendTest-1894311800 None] Deleting offline snapshot 46158819-abb4-40ad-9c7e-c75251128465 of volume f3c5cd63-18bb-4367-966f-b64517511570 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:54:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-54fb4765-bce7-4017-a5b0-37123b662ba5 tempest-VolumesExtendTest-1894311800 None] snapshot_file for this snap is: volume-f3c5cd63-18bb-4367-966f-b64517511570.46158819-abb4-40ad-9c7e-c75251128465 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:54:18 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d1668d-b1f4-470b-a077-2c3e31d84512]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-54fb4765-bce7-4017-a5b0-37123b662ba5 tempest-VolumesExtendTest-1894311800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570.46158819-abb4-40ad-9c7e-c75251128465 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:18 devstack sudo[104523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570.46158819-abb4-40ad-9c7e-c75251128465 Jul 31 10:54:18 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:19 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-54fb4765-bce7-4017-a5b0-37123b662ba5 tempest-VolumesExtendTest-1894311800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570.46158819-abb4-40ad-9c7e-c75251128465" returned: 0 in 0.524s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:19 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-54fb4765-bce7-4017-a5b0-37123b662ba5 tempest-VolumesExtendTest-1894311800 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3c5cd63-18bb-4367-966f-b64517511570(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:54:19 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[f124eb24-2b5c-4bbb-b170-fdb07e260b75]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-54fb4765-bce7-4017-a5b0-37123b662ba5 tempest-VolumesExtendTest-1894311800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:19 devstack sudo[104530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570 Jul 31 10:54:19 devstack sudo[104530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:19 devstack sudo[104530]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-54fb4765-bce7-4017-a5b0-37123b662ba5 tempest-VolumesExtendTest-1894311800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570" returned: 0 in 0.457s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-54fb4765-bce7-4017-a5b0-37123b662ba5 tempest-VolumesExtendTest-1894311800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570.46158819-abb4-40ad-9c7e-c75251128465 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:19 devstack sudo[104535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570.46158819-abb4-40ad-9c7e-c75251128465 Jul 31 10:54:19 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:20 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-54fb4765-bce7-4017-a5b0-37123b662ba5 tempest-VolumesExtendTest-1894311800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570.46158819-abb4-40ad-9c7e-c75251128465" returned: 0 in 0.519s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-54fb4765-bce7-4017-a5b0-37123b662ba5 tempest-VolumesExtendTest-1894311800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570.46158819-abb4-40ad-9c7e-c75251128465 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:20 devstack sudo[104540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570.46158819-abb4-40ad-9c7e-c75251128465 Jul 31 10:54:20 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:20 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-54fb4765-bce7-4017-a5b0-37123b662ba5 tempest-VolumesExtendTest-1894311800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570.46158819-abb4-40ad-9c7e-c75251128465" returned: 0 in 0.348s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:20 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-54fb4765-bce7-4017-a5b0-37123b662ba5 tempest-VolumesExtendTest-1894311800 None] Lock "cinder-quobyte-46158819-abb4-40ad-9c7e-c75251128465" released by "_delete_snapshot" :: held 2.028s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:54:20 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-54fb4765-bce7-4017-a5b0-37123b662ba5 tempest-VolumesExtendTest-1894311800 None] Lock "cinder-quobyte-f3c5cd63-18bb-4367-966f-b64517511570" released by "delete_snapshot" :: held 2.066s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:54:20 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-54fb4765-bce7-4017-a5b0-37123b662ba5 tempest-VolumesExtendTest-1894311800 None] Created reservations ['54f67cd0-171c-40ea-8887-8d2054e90148', '8ddb7b7e-a352-4294-a74f-89bd65036f3b', '5f629730-f159-465b-bf39-0f7c810fcf6d', '59d26c98-dc33-425d-bf62-737f7d9ad957'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:54:20 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-54fb4765-bce7-4017-a5b0-37123b662ba5 tempest-VolumesExtendTest-1894311800 None] Delete snapshot completed successfully. Jul 31 10:54:20 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-54fb4765-bce7-4017-a5b0-37123b662ba5 tempest-VolumesExtendTest-1894311800 None] Lock "cinder-46158819-abb4-40ad-9c7e-c75251128465-delete_snapshot" released by "delete_snapshot" :: held 2.325s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:54:21 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ba14c85e-acde-4c19-b507-1ca386faba19 tempest-VolumesExtendTest-1894311800 None] Acquiring lock "cinder-f3c5cd63-18bb-4367-966f-b64517511570-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:54:21 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ba14c85e-acde-4c19-b507-1ca386faba19 tempest-VolumesExtendTest-1894311800 None] Lock "cinder-f3c5cd63-18bb-4367-966f-b64517511570-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:54:21 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ba14c85e-acde-4c19-b507-1ca386faba19 tempest-VolumesExtendTest-1894311800 None] Acquiring lock "cinder-quobyte-f3c5cd63-18bb-4367-966f-b64517511570" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:54:21 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ba14c85e-acde-4c19-b507-1ca386faba19 tempest-VolumesExtendTest-1894311800 None] Lock "cinder-quobyte-f3c5cd63-18bb-4367-966f-b64517511570" acquired by "delete_volume" :: waited 0.021s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:54:22 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba62d94-2f72-4897-88b8-359e51181079]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ba14c85e-acde-4c19-b507-1ca386faba19 tempest-VolumesExtendTest-1894311800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:22 devstack sudo[104544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570 Jul 31 10:54:22 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:22 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ba14c85e-acde-4c19-b507-1ca386faba19 tempest-VolumesExtendTest-1894311800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570" returned: 0 in 0.463s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ba14c85e-acde-4c19-b507-1ca386faba19 tempest-VolumesExtendTest-1894311800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:22 devstack sudo[104551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570 Jul 31 10:54:22 devstack sudo[104551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:22 devstack sudo[104551]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ba14c85e-acde-4c19-b507-1ca386faba19 tempest-VolumesExtendTest-1894311800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f3c5cd63-18bb-4367-966f-b64517511570" returned: 0 in 0.409s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:22 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ba14c85e-acde-4c19-b507-1ca386faba19 tempest-VolumesExtendTest-1894311800 None] Lock "cinder-quobyte-f3c5cd63-18bb-4367-966f-b64517511570" released by "delete_volume" :: held 0.969s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:54:23 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-ba14c85e-acde-4c19-b507-1ca386faba19 tempest-VolumesExtendTest-1894311800 None] Created reservations ['af5db5de-0226-47f0-a06d-d352fef18165', '0ee95d48-9b17-4453-8685-5a1b1df4814d', '0dc8f265-5142-469e-a0a8-8f6b296ec455', 'ad8d1360-fd79-466a-80cc-3531f8dbe747'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:54:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ba14c85e-acde-4c19-b507-1ca386faba19 tempest-VolumesExtendTest-1894311800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ba14c85e-acde-4c19-b507-1ca386faba19 tempest-VolumesExtendTest-1894311800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:23 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ba14c85e-acde-4c19-b507-1ca386faba19 tempest-VolumesExtendTest-1894311800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:54:23 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ba14c85e-acde-4c19-b507-1ca386faba19 tempest-VolumesExtendTest-1894311800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:54:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ba14c85e-acde-4c19-b507-1ca386faba19 tempest-VolumesExtendTest-1894311800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ba14c85e-acde-4c19-b507-1ca386faba19 tempest-VolumesExtendTest-1894311800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:23 devstack sudo[104556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:54:23 devstack sudo[104556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:23 devstack sudo[104556]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ba14c85e-acde-4c19-b507-1ca386faba19 tempest-VolumesExtendTest-1894311800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.374s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:23 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-ba14c85e-acde-4c19-b507-1ca386faba19 tempest-VolumesExtendTest-1894311800 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:54:23 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-ba14c85e-acde-4c19-b507-1ca386faba19 tempest-VolumesExtendTest-1894311800 None] Deleted volume successfully. Jul 31 10:54:23 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ba14c85e-acde-4c19-b507-1ca386faba19 tempest-VolumesExtendTest-1894311800 None] Lock "cinder-f3c5cd63-18bb-4367-966f-b64517511570-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:54:25 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2d9b76d-e74f-49cb-9093-bdc8fa15bb80 tempest-TestImageHashVerification-1976946938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:54:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b2d9b76d-e74f-49cb-9093-bdc8fa15bb80 tempest-TestImageHashVerification-1976946938 None] Flow 'volume_create_manager' (32aed9b3-c930-4418-aa4e-de4dc7a412de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:54:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b2d9b76d-e74f-49cb-9093-bdc8fa15bb80 tempest-TestImageHashVerification-1976946938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0fb84d2-8db4-4c8e-b440-a3738990da28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b2d9b76d-e74f-49cb-9093-bdc8fa15bb80 tempest-TestImageHashVerification-1976946938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0fb84d2-8db4-4c8e-b440-a3738990da28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-168302089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a01c9c86-4b66-4737-a15f-a916669a4694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd43bcd637734fcea5009c2f6b8fc83c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:54:26Z,use_quota=True,user_id='9b9d6e1fab1e4df9adf2d76ce71ed46c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b2d9b76d-e74f-49cb-9093-bdc8fa15bb80 tempest-TestImageHashVerification-1976946938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad2df3a9-e402-4518-8782-02ff01b18246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b2d9b76d-e74f-49cb-9093-bdc8fa15bb80 tempest-TestImageHashVerification-1976946938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad2df3a9-e402-4518-8782-02ff01b18246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b2d9b76d-e74f-49cb-9093-bdc8fa15bb80 tempest-TestImageHashVerification-1976946938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a41ecee7-4fa9-4113-aa7c-0a32ee77c02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b2d9b76d-e74f-49cb-9093-bdc8fa15bb80 tempest-TestImageHashVerification-1976946938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a41ecee7-4fa9-4113-aa7c-0a32ee77c02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a01c9c86-4b66-4737-a15f-a916669a4694', 'volume_name': 'volume-a01c9c86-4b66-4737-a15f-a916669a4694', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b2d9b76d-e74f-49cb-9093-bdc8fa15bb80 tempest-TestImageHashVerification-1976946938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42b998f6-c7b7-4fa3-891c-7379e45510d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b2d9b76d-e74f-49cb-9093-bdc8fa15bb80 tempest-TestImageHashVerification-1976946938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42b998f6-c7b7-4fa3-891c-7379e45510d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b2d9b76d-e74f-49cb-9093-bdc8fa15bb80 tempest-TestImageHashVerification-1976946938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d7185d4-c02d-42ad-a343-63ee9de15235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:25 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-b2d9b76d-e74f-49cb-9093-bdc8fa15bb80 tempest-TestImageHashVerification-1976946938 None] Volume a01c9c86-4b66-4737-a15f-a916669a4694: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a01c9c86-4b66-4737-a15f-a916669a4694', 'volume_size': 1} Jul 31 10:54:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b2d9b76d-e74f-49cb-9093-bdc8fa15bb80 tempest-TestImageHashVerification-1976946938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b2d9b76d-e74f-49cb-9093-bdc8fa15bb80 tempest-TestImageHashVerification-1976946938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:25 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-b2d9b76d-e74f-49cb-9093-bdc8fa15bb80 tempest-TestImageHashVerification-1976946938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-168302089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a01c9c86-4b66-4737-a15f-a916669a4694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd43bcd637734fcea5009c2f6b8fc83c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:54:26Z,use_quota=True,user_id='9b9d6e1fab1e4df9adf2d76ce71ed46c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:54:25 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-b2d9b76d-e74f-49cb-9093-bdc8fa15bb80 tempest-TestImageHashVerification-1976946938 None] Creating volume a01c9c86-4b66-4737-a15f-a916669a4694 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:54:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b2d9b76d-e74f-49cb-9093-bdc8fa15bb80 tempest-TestImageHashVerification-1976946938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b2d9b76d-e74f-49cb-9093-bdc8fa15bb80 tempest-TestImageHashVerification-1976946938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:25 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-b2d9b76d-e74f-49cb-9093-bdc8fa15bb80 tempest-TestImageHashVerification-1976946938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:54:25 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-b2d9b76d-e74f-49cb-9093-bdc8fa15bb80 tempest-TestImageHashVerification-1976946938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:54:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b2d9b76d-e74f-49cb-9093-bdc8fa15bb80 tempest-TestImageHashVerification-1976946938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:25 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-b2d9b76d-e74f-49cb-9093-bdc8fa15bb80 tempest-TestImageHashVerification-1976946938 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:54:25 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-b2d9b76d-e74f-49cb-9093-bdc8fa15bb80 tempest-TestImageHashVerification-1976946938 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:54:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b2d9b76d-e74f-49cb-9093-bdc8fa15bb80 tempest-TestImageHashVerification-1976946938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a01c9c86-4b66-4737-a15f-a916669a4694 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:25 devstack sudo[104560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a01c9c86-4b66-4737-a15f-a916669a4694 1073741824 Jul 31 10:54:25 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:26 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b2d9b76d-e74f-49cb-9093-bdc8fa15bb80 tempest-TestImageHashVerification-1976946938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a01c9c86-4b66-4737-a15f-a916669a4694 1073741824" returned: 0 in 0.717s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b2d9b76d-e74f-49cb-9093-bdc8fa15bb80 tempest-TestImageHashVerification-1976946938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a01c9c86-4b66-4737-a15f-a916669a4694 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:26 devstack sudo[104586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a01c9c86-4b66-4737-a15f-a916669a4694 Jul 31 10:54:26 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:27 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b2d9b76d-e74f-49cb-9093-bdc8fa15bb80 tempest-TestImageHashVerification-1976946938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a01c9c86-4b66-4737-a15f-a916669a4694" returned: 0 in 0.384s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:27 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-b2d9b76d-e74f-49cb-9093-bdc8fa15bb80 tempest-TestImageHashVerification-1976946938 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:54:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b2d9b76d-e74f-49cb-9093-bdc8fa15bb80 tempest-TestImageHashVerification-1976946938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b2d9b76d-e74f-49cb-9093-bdc8fa15bb80 tempest-TestImageHashVerification-1976946938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d7185d4-c02d-42ad-a343-63ee9de15235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a01c9c86-4b66-4737-a15f-a916669a4694', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b2d9b76d-e74f-49cb-9093-bdc8fa15bb80 tempest-TestImageHashVerification-1976946938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46be3e27-7c72-4599-975e-c18b2fe10ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:27 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-b2d9b76d-e74f-49cb-9093-bdc8fa15bb80 tempest-TestImageHashVerification-1976946938 None] Volume volume-a01c9c86-4b66-4737-a15f-a916669a4694 (a01c9c86-4b66-4737-a15f-a916669a4694): created successfully Jul 31 10:54:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b2d9b76d-e74f-49cb-9093-bdc8fa15bb80 tempest-TestImageHashVerification-1976946938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46be3e27-7c72-4599-975e-c18b2fe10ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b2d9b76d-e74f-49cb-9093-bdc8fa15bb80 tempest-TestImageHashVerification-1976946938 None] Flow 'volume_create_manager' (32aed9b3-c930-4418-aa4e-de4dc7a412de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:54:27 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-b2d9b76d-e74f-49cb-9093-bdc8fa15bb80 tempest-TestImageHashVerification-1976946938 None] Created volume successfully. Jul 31 10:54:28 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-69efa7f7-4e1f-4520-987a-6100ab4ad4a7 req-1dde7d24-31cc-4181-9c18-bc9e3c5346f0 tempest-TestShelveInstance-693135770 None] Terminate volume connection completed successfully. Jul 31 10:54:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-69efa7f7-4e1f-4520-987a-6100ab4ad4a7 req-1dde7d24-31cc-4181-9c18-bc9e3c5346f0 tempest-TestShelveInstance-693135770 None] Deleting attachment 02bdc665-56b6-44fb-84b4-bc2911cb8c17. {{(pid=89090) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:54:29 devstack cinder-volume[89090]: DEBUG cinder.coordination [req-69efa7f7-4e1f-4520-987a-6100ab4ad4a7 req-44ce8c54-a5ad-468d-b45e-c56f83551478 tempest-TestShelveInstance-693135770 None] Acquiring lock "cinder-8c4dd065-1621-4cd9-b081-5223550da237-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:54:29 devstack cinder-volume[89090]: DEBUG cinder.coordination [req-69efa7f7-4e1f-4520-987a-6100ab4ad4a7 req-44ce8c54-a5ad-468d-b45e-c56f83551478 tempest-TestShelveInstance-693135770 None] Lock "cinder-8c4dd065-1621-4cd9-b081-5223550da237-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:54:29 devstack cinder-volume[89090]: DEBUG cinder.coordination [req-69efa7f7-4e1f-4520-987a-6100ab4ad4a7 req-44ce8c54-a5ad-468d-b45e-c56f83551478 tempest-TestShelveInstance-693135770 None] Acquiring lock "cinder-quobyte-8c4dd065-1621-4cd9-b081-5223550da237" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:54:29 devstack cinder-volume[89090]: DEBUG cinder.coordination [req-69efa7f7-4e1f-4520-987a-6100ab4ad4a7 req-44ce8c54-a5ad-468d-b45e-c56f83551478 tempest-TestShelveInstance-693135770 None] Lock "cinder-quobyte-8c4dd065-1621-4cd9-b081-5223550da237" acquired by "delete_volume" :: waited 0.053s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:54:29 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[954608eb-27f6-4c9a-8f0f-4407879c5d2a]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-69efa7f7-4e1f-4520-987a-6100ab4ad4a7 req-44ce8c54-a5ad-468d-b45e-c56f83551478 tempest-TestShelveInstance-693135770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8c4dd065-1621-4cd9-b081-5223550da237 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:29 devstack sudo[104597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8c4dd065-1621-4cd9-b081-5223550da237 Jul 31 10:54:29 devstack sudo[104597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ba8fb7df-d60d-4d19-985d-98cd899a3183 tempest-TestImageHashVerification-1976946938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ba8fb7df-d60d-4d19-985d-98cd899a3183 tempest-TestImageHashVerification-1976946938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:29 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ee7efa-2f65-43fb-9538-30013466dcb0]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ba8fb7df-d60d-4d19-985d-98cd899a3183 tempest-TestImageHashVerification-1976946938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a01c9c86-4b66-4737-a15f-a916669a4694 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:29 devstack sudo[104599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a01c9c86-4b66-4737-a15f-a916669a4694 Jul 31 10:54:29 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:30 devstack sudo[104597]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-69efa7f7-4e1f-4520-987a-6100ab4ad4a7 req-44ce8c54-a5ad-468d-b45e-c56f83551478 tempest-TestShelveInstance-693135770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8c4dd065-1621-4cd9-b081-5223550da237" returned: 0 in 0.638s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-69efa7f7-4e1f-4520-987a-6100ab4ad4a7 req-44ce8c54-a5ad-468d-b45e-c56f83551478 tempest-TestShelveInstance-693135770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8c4dd065-1621-4cd9-b081-5223550da237 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:30 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8c4dd065-1621-4cd9-b081-5223550da237 Jul 31 10:54:30 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:30 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ba8fb7df-d60d-4d19-985d-98cd899a3183 tempest-TestImageHashVerification-1976946938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a01c9c86-4b66-4737-a15f-a916669a4694" returned: 0 in 0.500s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:30 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf4fb5b-7a00-48dd-bf59-c3a81697617c]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ba8fb7df-d60d-4d19-985d-98cd899a3183 tempest-TestImageHashVerification-1976946938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a01c9c86-4b66-4737-a15f-a916669a4694 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:30 devstack sudo[104610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a01c9c86-4b66-4737-a15f-a916669a4694 Jul 31 10:54:30 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:30 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-69efa7f7-4e1f-4520-987a-6100ab4ad4a7 req-44ce8c54-a5ad-468d-b45e-c56f83551478 tempest-TestShelveInstance-693135770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8c4dd065-1621-4cd9-b081-5223550da237" returned: 0 in 0.446s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:30 devstack cinder-volume[89090]: DEBUG cinder.coordination [req-69efa7f7-4e1f-4520-987a-6100ab4ad4a7 req-44ce8c54-a5ad-468d-b45e-c56f83551478 tempest-TestShelveInstance-693135770 None] Lock "cinder-quobyte-8c4dd065-1621-4cd9-b081-5223550da237" released by "delete_volume" :: held 1.163s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:54:30 devstack cinder-volume[89090]: DEBUG cinder.quota [req-69efa7f7-4e1f-4520-987a-6100ab4ad4a7 req-44ce8c54-a5ad-468d-b45e-c56f83551478 tempest-TestShelveInstance-693135770 None] Created reservations ['f2481dfc-f834-42e8-a466-c22c206bf083', '02c98cec-58d6-418a-a102-7558781666bb', 'f9ac0edc-3d71-4b03-9441-a656fae3d97e', 'bf3e40af-b68a-4994-91f9-2882edc29b37'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:54:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-69efa7f7-4e1f-4520-987a-6100ab4ad4a7 req-44ce8c54-a5ad-468d-b45e-c56f83551478 tempest-TestShelveInstance-693135770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-69efa7f7-4e1f-4520-987a-6100ab4ad4a7 req-44ce8c54-a5ad-468d-b45e-c56f83551478 tempest-TestShelveInstance-693135770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:30 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [req-69efa7f7-4e1f-4520-987a-6100ab4ad4a7 req-44ce8c54-a5ad-468d-b45e-c56f83551478 tempest-TestShelveInstance-693135770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:54:30 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [req-69efa7f7-4e1f-4520-987a-6100ab4ad4a7 req-44ce8c54-a5ad-468d-b45e-c56f83551478 tempest-TestShelveInstance-693135770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:54:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-69efa7f7-4e1f-4520-987a-6100ab4ad4a7 req-44ce8c54-a5ad-468d-b45e-c56f83551478 tempest-TestShelveInstance-693135770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-69efa7f7-4e1f-4520-987a-6100ab4ad4a7 req-44ce8c54-a5ad-468d-b45e-c56f83551478 tempest-TestShelveInstance-693135770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:30 devstack sudo[104616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:54:30 devstack sudo[104616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:30 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ba8fb7df-d60d-4d19-985d-98cd899a3183 tempest-TestImageHashVerification-1976946938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a01c9c86-4b66-4737-a15f-a916669a4694" returned: 0 in 0.644s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ba8fb7df-d60d-4d19-985d-98cd899a3183 tempest-TestImageHashVerification-1976946938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a01c9c86-4b66-4737-a15f-a916669a4694 /opt/stack/data/cinder/conversion/a01c9c86-4b66-4737-a15f-a916669a4694.temp_image.351a418c-f311-4bcb-b56a-cf03b784822cuuvjrr4l.img {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:30 devstack sudo[104618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a01c9c86-4b66-4737-a15f-a916669a4694 /opt/stack/data/cinder/conversion/a01c9c86-4b66-4737-a15f-a916669a4694.temp_image.351a418c-f311-4bcb-b56a-cf03b784822cuuvjrr4l.img Jul 31 10:54:30 devstack sudo[104618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:31 devstack sudo[104616]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [req-69efa7f7-4e1f-4520-987a-6100ab4ad4a7 req-44ce8c54-a5ad-468d-b45e-c56f83551478 tempest-TestShelveInstance-693135770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.439s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:31 devstack cinder-volume[89090]: DEBUG cinder.manager [req-69efa7f7-4e1f-4520-987a-6100ab4ad4a7 req-44ce8c54-a5ad-468d-b45e-c56f83551478 tempest-TestShelveInstance-693135770 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:54:31 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-69efa7f7-4e1f-4520-987a-6100ab4ad4a7 req-44ce8c54-a5ad-468d-b45e-c56f83551478 tempest-TestShelveInstance-693135770 None] Deleted volume successfully. Jul 31 10:54:31 devstack cinder-volume[89090]: DEBUG cinder.coordination [req-69efa7f7-4e1f-4520-987a-6100ab4ad4a7 req-44ce8c54-a5ad-468d-b45e-c56f83551478 tempest-TestShelveInstance-693135770 None] Lock "cinder-8c4dd065-1621-4cd9-b081-5223550da237-delete_volume" released by "delete_volume" :: held 2.092s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:54:36 devstack sudo[104618]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ba8fb7df-d60d-4d19-985d-98cd899a3183 tempest-TestImageHashVerification-1976946938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a01c9c86-4b66-4737-a15f-a916669a4694 /opt/stack/data/cinder/conversion/a01c9c86-4b66-4737-a15f-a916669a4694.temp_image.351a418c-f311-4bcb-b56a-cf03b784822cuuvjrr4l.img" returned: 0 in 5.923s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:36 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc935acd-2f39-434e-ab17-898a25bb0c87]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ba8fb7df-d60d-4d19-985d-98cd899a3183 tempest-TestImageHashVerification-1976946938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a01c9c86-4b66-4737-a15f-a916669a4694 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:36 devstack sudo[104636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a01c9c86-4b66-4737-a15f-a916669a4694 Jul 31 10:54:36 devstack sudo[104636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:37 devstack sudo[104636]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ba8fb7df-d60d-4d19-985d-98cd899a3183 tempest-TestImageHashVerification-1976946938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a01c9c86-4b66-4737-a15f-a916669a4694" returned: 0 in 0.666s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:37 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-ba8fb7df-d60d-4d19-985d-98cd899a3183 tempest-TestImageHashVerification-1976946938 None] Image conversion details: src /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a01c9c86-4b66-4737-a15f-a916669a4694, size 1024.00 MB, duration 5.93 sec, destination /opt/stack/data/cinder/conversion/a01c9c86-4b66-4737-a15f-a916669a4694.temp_image.351a418c-f311-4bcb-b56a-cf03b784822cuuvjrr4l.img {{(pid=89090) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 10:54:37 devstack cinder-volume[89090]: INFO cinder.image.image_utils [None req-ba8fb7df-d60d-4d19-985d-98cd899a3183 tempest-TestImageHashVerification-1976946938 None] Converted 1024.00 MB image at 172.75 MB/s Jul 31 10:54:37 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-ba8fb7df-d60d-4d19-985d-98cd899a3183 tempest-TestImageHashVerification-1976946938 None] 351a418c-f311-4bcb-b56a-cf03b784822c was raw, no need to convert to raw {{(pid=89090) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 31 10:54:40 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ef8aa64-afe1-46ee-9b39-cde850143784 tempest-VolumesSnapshotListTestJSON-1057808077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:54:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3ef8aa64-afe1-46ee-9b39-cde850143784 tempest-VolumesSnapshotListTestJSON-1057808077 None] Flow 'volume_create_manager' (a2fcf9c3-b556-4770-86e1-7b2849d54b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:54:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3ef8aa64-afe1-46ee-9b39-cde850143784 tempest-VolumesSnapshotListTestJSON-1057808077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ff46aac-4956-4f91-a038-44124af9bba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3ef8aa64-afe1-46ee-9b39-cde850143784 tempest-VolumesSnapshotListTestJSON-1057808077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ff46aac-4956-4f91-a038-44124af9bba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1441160050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b112411-a782-430d-9605-bbfef0a21c84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b877abc5a0c4c8bbff520424a15aaed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:54:40Z,use_quota=True,user_id='a68b35f043db44c2a8ad1906ca19ec20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3ef8aa64-afe1-46ee-9b39-cde850143784 tempest-VolumesSnapshotListTestJSON-1057808077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33019c01-8a59-4e74-b3a8-3e2b4d624289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3ef8aa64-afe1-46ee-9b39-cde850143784 tempest-VolumesSnapshotListTestJSON-1057808077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33019c01-8a59-4e74-b3a8-3e2b4d624289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3ef8aa64-afe1-46ee-9b39-cde850143784 tempest-VolumesSnapshotListTestJSON-1057808077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (815b369f-abd9-4f5b-aeed-1250cbdd4d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3ef8aa64-afe1-46ee-9b39-cde850143784 tempest-VolumesSnapshotListTestJSON-1057808077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (815b369f-abd9-4f5b-aeed-1250cbdd4d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b112411-a782-430d-9605-bbfef0a21c84', 'volume_name': 'volume-3b112411-a782-430d-9605-bbfef0a21c84', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3ef8aa64-afe1-46ee-9b39-cde850143784 tempest-VolumesSnapshotListTestJSON-1057808077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d08ec9d-3a32-4c8d-a226-3437dd9a27af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3ef8aa64-afe1-46ee-9b39-cde850143784 tempest-VolumesSnapshotListTestJSON-1057808077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d08ec9d-3a32-4c8d-a226-3437dd9a27af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3ef8aa64-afe1-46ee-9b39-cde850143784 tempest-VolumesSnapshotListTestJSON-1057808077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a86b83c-024e-45a4-83a8-f1bc23afa2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:40 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-3ef8aa64-afe1-46ee-9b39-cde850143784 tempest-VolumesSnapshotListTestJSON-1057808077 None] Volume 3b112411-a782-430d-9605-bbfef0a21c84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b112411-a782-430d-9605-bbfef0a21c84', 'volume_size': 1} Jul 31 10:54:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3ef8aa64-afe1-46ee-9b39-cde850143784 tempest-VolumesSnapshotListTestJSON-1057808077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:45 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:54:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:54:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:54:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:46 devstack sudo[104645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:54:46 devstack sudo[104645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:46 devstack sudo[104645]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.386s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:46 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:54:46 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager._thread_info {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:54:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread count: 28 {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:54:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread info: [<_MainThread(MainThread, started 134005426110592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:54:50 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:INSERT=30,cinder:UPDATE=116,cinder:SELECT=91,cinder:DELETE=8 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:54:50 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=88,cinder:INSERT=37,cinder:UPDATE=126,cinder:DELETE=12 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:54:53 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-2853cfef-a080-448b-a4ba-bc0d0f68eef1 tempest-CreateVolumesFromImageTest-727387812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:54:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2853cfef-a080-448b-a4ba-bc0d0f68eef1 tempest-CreateVolumesFromImageTest-727387812 None] Flow 'volume_create_manager' (b3bc54c8-3c79-4f20-835f-74177ca2d3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:54:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2853cfef-a080-448b-a4ba-bc0d0f68eef1 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c4737bb-ce68-43b5-85e4-1a013e479bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2853cfef-a080-448b-a4ba-bc0d0f68eef1 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c4737bb-ce68-43b5-85e4-1a013e479bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-68932643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4b32fc7-58bd-4d95-81cc-28f5e8934a02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf288c66c5d4a5e87b4daf46bff6e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:54:53Z,use_quota=True,user_id='f9dd01a864cf4e2a9b419cb7f239888d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2853cfef-a080-448b-a4ba-bc0d0f68eef1 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cfb7d64-9b45-47d6-a353-191faadf5ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2853cfef-a080-448b-a4ba-bc0d0f68eef1 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cfb7d64-9b45-47d6-a353-191faadf5ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2853cfef-a080-448b-a4ba-bc0d0f68eef1 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70b8851a-979d-4ef8-a8bd-bb28acf7c790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2853cfef-a080-448b-a4ba-bc0d0f68eef1 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70b8851a-979d-4ef8-a8bd-bb28acf7c790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4b32fc7-58bd-4d95-81cc-28f5e8934a02', 'volume_name': 'volume-f4b32fc7-58bd-4d95-81cc-28f5e8934a02', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2853cfef-a080-448b-a4ba-bc0d0f68eef1 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a95ab62-ecf8-4b52-bab4-742fb2384336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2853cfef-a080-448b-a4ba-bc0d0f68eef1 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a95ab62-ecf8-4b52-bab4-742fb2384336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2853cfef-a080-448b-a4ba-bc0d0f68eef1 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ea66d67-a301-4b57-b5e5-daf78bde2ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:53 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-2853cfef-a080-448b-a4ba-bc0d0f68eef1 tempest-CreateVolumesFromImageTest-727387812 None] Volume f4b32fc7-58bd-4d95-81cc-28f5e8934a02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4b32fc7-58bd-4d95-81cc-28f5e8934a02', 'volume_size': 1} Jul 31 10:54:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2853cfef-a080-448b-a4ba-bc0d0f68eef1 tempest-CreateVolumesFromImageTest-727387812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:54 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c85cd32-d928-4e31-9308-447de3384e46 tempest-CreateVolumesFromImageTest-727387812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:54:54 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6c85cd32-d928-4e31-9308-447de3384e46 tempest-CreateVolumesFromImageTest-727387812 None] Flow 'volume_create_manager' (e091c9a2-0948-40f4-adcc-b81a9acc37f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:54:54 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6c85cd32-d928-4e31-9308-447de3384e46 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2fe064a-8972-4b23-854d-233fc513485d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:54 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6c85cd32-d928-4e31-9308-447de3384e46 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2fe064a-8972-4b23-854d-233fc513485d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-202540324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b6566ef-6256-4618-8d51-93e1ac5c33f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf288c66c5d4a5e87b4daf46bff6e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:54:54Z,use_quota=True,user_id='f9dd01a864cf4e2a9b419cb7f239888d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:54 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6c85cd32-d928-4e31-9308-447de3384e46 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (844f2773-95f1-4ecd-bcf1-2156887d8876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:54 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6c85cd32-d928-4e31-9308-447de3384e46 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (844f2773-95f1-4ecd-bcf1-2156887d8876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:54 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6c85cd32-d928-4e31-9308-447de3384e46 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2058dfe3-6027-4fa5-93ce-23ed6f1ba605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:54 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6c85cd32-d928-4e31-9308-447de3384e46 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2058dfe3-6027-4fa5-93ce-23ed6f1ba605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b6566ef-6256-4618-8d51-93e1ac5c33f2', 'volume_name': 'volume-6b6566ef-6256-4618-8d51-93e1ac5c33f2', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:54 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6c85cd32-d928-4e31-9308-447de3384e46 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4b841fd-3c63-424a-9ae8-1189852c7522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:54 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6c85cd32-d928-4e31-9308-447de3384e46 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4b841fd-3c63-424a-9ae8-1189852c7522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:54 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6c85cd32-d928-4e31-9308-447de3384e46 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b36812-cda8-474f-94c9-7d70ad624bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:54 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-6c85cd32-d928-4e31-9308-447de3384e46 tempest-CreateVolumesFromImageTest-727387812 None] Volume 6b6566ef-6256-4618-8d51-93e1ac5c33f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b6566ef-6256-4618-8d51-93e1ac5c33f2', 'volume_size': 1} Jul 31 10:54:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6c85cd32-d928-4e31-9308-447de3384e46 tempest-CreateVolumesFromImageTest-727387812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:54 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-50af5fb5-bb1f-40e8-b83b-5d4916b16ae5 tempest-CreateVolumesFromImageTest-727387812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:54:54 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50af5fb5-bb1f-40e8-b83b-5d4916b16ae5 tempest-CreateVolumesFromImageTest-727387812 None] Flow 'volume_create_manager' (4e038478-ba4a-44ce-8c2b-a2488901ac37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:54:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50af5fb5-bb1f-40e8-b83b-5d4916b16ae5 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (604ba042-a342-495f-a1e4-d86a1267b7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50af5fb5-bb1f-40e8-b83b-5d4916b16ae5 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (604ba042-a342-495f-a1e4-d86a1267b7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1705042515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d33c47c-4c65-4c1f-8b2f-87bf85d29a26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf288c66c5d4a5e87b4daf46bff6e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:54:55Z,use_quota=True,user_id='f9dd01a864cf4e2a9b419cb7f239888d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50af5fb5-bb1f-40e8-b83b-5d4916b16ae5 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (098a1f93-ae5a-4a36-bbe3-e3516b840b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50af5fb5-bb1f-40e8-b83b-5d4916b16ae5 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (098a1f93-ae5a-4a36-bbe3-e3516b840b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50af5fb5-bb1f-40e8-b83b-5d4916b16ae5 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48ab0e15-0d75-4f6a-b0a1-6aaceac8b180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50af5fb5-bb1f-40e8-b83b-5d4916b16ae5 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48ab0e15-0d75-4f6a-b0a1-6aaceac8b180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d33c47c-4c65-4c1f-8b2f-87bf85d29a26', 'volume_name': 'volume-7d33c47c-4c65-4c1f-8b2f-87bf85d29a26', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50af5fb5-bb1f-40e8-b83b-5d4916b16ae5 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21ba0b3b-9986-46c3-87f5-575d43141430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50af5fb5-bb1f-40e8-b83b-5d4916b16ae5 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21ba0b3b-9986-46c3-87f5-575d43141430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50af5fb5-bb1f-40e8-b83b-5d4916b16ae5 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c30617a-2176-4a02-b6ed-861181ec2b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:55 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-50af5fb5-bb1f-40e8-b83b-5d4916b16ae5 tempest-CreateVolumesFromImageTest-727387812 None] Volume 7d33c47c-4c65-4c1f-8b2f-87bf85d29a26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d33c47c-4c65-4c1f-8b2f-87bf85d29a26', 'volume_size': 1} Jul 31 10:54:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-50af5fb5-bb1f-40e8-b83b-5d4916b16ae5 tempest-CreateVolumesFromImageTest-727387812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:55 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f56f812-59cc-4d10-9b35-1d57a1aa5b1a tempest-CreateVolumesFromImageTest-727387812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:54:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4f56f812-59cc-4d10-9b35-1d57a1aa5b1a tempest-CreateVolumesFromImageTest-727387812 None] Flow 'volume_create_manager' (d2fb531c-2160-4b99-908f-4c051c81db5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:54:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4f56f812-59cc-4d10-9b35-1d57a1aa5b1a tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (534255ea-5e30-4502-9950-fe1f40b35be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4f56f812-59cc-4d10-9b35-1d57a1aa5b1a tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (534255ea-5e30-4502-9950-fe1f40b35be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1687647218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09d63154-46b3-4834-b915-9d1b8dc18166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf288c66c5d4a5e87b4daf46bff6e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:54:55Z,use_quota=True,user_id='f9dd01a864cf4e2a9b419cb7f239888d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4f56f812-59cc-4d10-9b35-1d57a1aa5b1a tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b45beab-f03a-49e7-a602-a717ce91aacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4f56f812-59cc-4d10-9b35-1d57a1aa5b1a tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b45beab-f03a-49e7-a602-a717ce91aacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4f56f812-59cc-4d10-9b35-1d57a1aa5b1a tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd5bf3d3-9ae9-4d9b-a4be-4a95803e77df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4f56f812-59cc-4d10-9b35-1d57a1aa5b1a tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd5bf3d3-9ae9-4d9b-a4be-4a95803e77df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09d63154-46b3-4834-b915-9d1b8dc18166', 'volume_name': 'volume-09d63154-46b3-4834-b915-9d1b8dc18166', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4f56f812-59cc-4d10-9b35-1d57a1aa5b1a tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (117cf8c0-357d-434d-9874-b03238c37801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4f56f812-59cc-4d10-9b35-1d57a1aa5b1a tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (117cf8c0-357d-434d-9874-b03238c37801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4f56f812-59cc-4d10-9b35-1d57a1aa5b1a tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76aeddd7-d164-42be-b5bb-05f72d9a9c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:55 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-4f56f812-59cc-4d10-9b35-1d57a1aa5b1a tempest-CreateVolumesFromImageTest-727387812 None] Volume 09d63154-46b3-4834-b915-9d1b8dc18166: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09d63154-46b3-4834-b915-9d1b8dc18166', 'volume_size': 1} Jul 31 10:54:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4f56f812-59cc-4d10-9b35-1d57a1aa5b1a tempest-CreateVolumesFromImageTest-727387812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:55 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f882b9f-95a1-42bd-9ef5-f59077a547c7 tempest-CreateVolumesFromImageTest-727387812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:54:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7f882b9f-95a1-42bd-9ef5-f59077a547c7 tempest-CreateVolumesFromImageTest-727387812 None] Flow 'volume_create_manager' (2eb992a6-30ca-470b-9f74-b03c71cac1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:54:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7f882b9f-95a1-42bd-9ef5-f59077a547c7 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3887e728-6d99-479c-a110-cf7926ec880c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7f882b9f-95a1-42bd-9ef5-f59077a547c7 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3887e728-6d99-479c-a110-cf7926ec880c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1491953950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a31386e3-e07a-4640-b13e-b639f469297f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf288c66c5d4a5e87b4daf46bff6e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:54:56Z,use_quota=True,user_id='f9dd01a864cf4e2a9b419cb7f239888d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7f882b9f-95a1-42bd-9ef5-f59077a547c7 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bdd8849-7093-4fc3-9ac5-78a2e0a9cff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7f882b9f-95a1-42bd-9ef5-f59077a547c7 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bdd8849-7093-4fc3-9ac5-78a2e0a9cff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7f882b9f-95a1-42bd-9ef5-f59077a547c7 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c81307b9-a058-4fd0-b944-bafc2cc1b0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7f882b9f-95a1-42bd-9ef5-f59077a547c7 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c81307b9-a058-4fd0-b944-bafc2cc1b0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a31386e3-e07a-4640-b13e-b639f469297f', 'volume_name': 'volume-a31386e3-e07a-4640-b13e-b639f469297f', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7f882b9f-95a1-42bd-9ef5-f59077a547c7 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bcd9264-4402-46b2-b56e-78c5bf059f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7f882b9f-95a1-42bd-9ef5-f59077a547c7 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bcd9264-4402-46b2-b56e-78c5bf059f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7f882b9f-95a1-42bd-9ef5-f59077a547c7 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71c7b91e-cd93-46de-aab5-a2375b2cb5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:56 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-7f882b9f-95a1-42bd-9ef5-f59077a547c7 tempest-CreateVolumesFromImageTest-727387812 None] Volume a31386e3-e07a-4640-b13e-b639f469297f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a31386e3-e07a-4640-b13e-b639f469297f', 'volume_size': 1} Jul 31 10:54:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7f882b9f-95a1-42bd-9ef5-f59077a547c7 tempest-CreateVolumesFromImageTest-727387812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:02 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-68e2154a-436b-4556-ba26-53f4ef21fbac tempest-SnapshotDependencyTests-2128035145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:55:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-68e2154a-436b-4556-ba26-53f4ef21fbac tempest-SnapshotDependencyTests-2128035145 None] Flow 'volume_create_manager' (16fcc1be-0660-410b-83d8-fdae6974a5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-68e2154a-436b-4556-ba26-53f4ef21fbac tempest-SnapshotDependencyTests-2128035145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b9378e5-9002-41f0-babd-f5ca287d738a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-68e2154a-436b-4556-ba26-53f4ef21fbac tempest-SnapshotDependencyTests-2128035145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b9378e5-9002-41f0-babd-f5ca287d738a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1525230293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=408b78a5-8f37-417d-9310-a63c47ad4d03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d9c581d5970485993604db0e31e83dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:02Z,use_quota=True,user_id='b6e272f69337443b84f60a89ac85691e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-68e2154a-436b-4556-ba26-53f4ef21fbac tempest-SnapshotDependencyTests-2128035145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d84508c-0e03-47c2-9468-5f7acee0ad77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-68e2154a-436b-4556-ba26-53f4ef21fbac tempest-SnapshotDependencyTests-2128035145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d84508c-0e03-47c2-9468-5f7acee0ad77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-68e2154a-436b-4556-ba26-53f4ef21fbac tempest-SnapshotDependencyTests-2128035145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e6fcf20-ca10-4bf2-b65a-d83bbec993bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-68e2154a-436b-4556-ba26-53f4ef21fbac tempest-SnapshotDependencyTests-2128035145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e6fcf20-ca10-4bf2-b65a-d83bbec993bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '408b78a5-8f37-417d-9310-a63c47ad4d03', 'volume_name': 'volume-408b78a5-8f37-417d-9310-a63c47ad4d03', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-68e2154a-436b-4556-ba26-53f4ef21fbac tempest-SnapshotDependencyTests-2128035145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (945094f2-54e7-432b-811f-1a14e10f0393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-68e2154a-436b-4556-ba26-53f4ef21fbac tempest-SnapshotDependencyTests-2128035145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (945094f2-54e7-432b-811f-1a14e10f0393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-68e2154a-436b-4556-ba26-53f4ef21fbac tempest-SnapshotDependencyTests-2128035145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec6d53a-cf99-4f96-9590-1a4541ac8038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:02 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-68e2154a-436b-4556-ba26-53f4ef21fbac tempest-SnapshotDependencyTests-2128035145 None] Volume 408b78a5-8f37-417d-9310-a63c47ad4d03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-408b78a5-8f37-417d-9310-a63c47ad4d03', 'volume_size': 1} Jul 31 10:55:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-68e2154a-436b-4556-ba26-53f4ef21fbac tempest-SnapshotDependencyTests-2128035145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ba8fb7df-d60d-4d19-985d-98cd899a3183 tempest-TestImageHashVerification-1976946938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 34.337s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ba8fb7df-d60d-4d19-985d-98cd899a3183 tempest-TestImageHashVerification-1976946938 None] Uploaded volume to glance image-id: 351a418c-f311-4bcb-b56a-cf03b784822c. {{(pid=89090) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 31 10:55:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3ef8aa64-afe1-46ee-9b39-cde850143784 tempest-VolumesSnapshotListTestJSON-1057808077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.461s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:03 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-3ef8aa64-afe1-46ee-9b39-cde850143784 tempest-VolumesSnapshotListTestJSON-1057808077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1441160050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b112411-a782-430d-9605-bbfef0a21c84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b877abc5a0c4c8bbff520424a15aaed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:54:40Z,use_quota=True,user_id='a68b35f043db44c2a8ad1906ca19ec20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:55:03 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-3ef8aa64-afe1-46ee-9b39-cde850143784 tempest-VolumesSnapshotListTestJSON-1057808077 None] Creating volume 3b112411-a782-430d-9605-bbfef0a21c84 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:55:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3ef8aa64-afe1-46ee-9b39-cde850143784 tempest-VolumesSnapshotListTestJSON-1057808077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3ef8aa64-afe1-46ee-9b39-cde850143784 tempest-VolumesSnapshotListTestJSON-1057808077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:03 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-3ef8aa64-afe1-46ee-9b39-cde850143784 tempest-VolumesSnapshotListTestJSON-1057808077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:55:03 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-3ef8aa64-afe1-46ee-9b39-cde850143784 tempest-VolumesSnapshotListTestJSON-1057808077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:55:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3ef8aa64-afe1-46ee-9b39-cde850143784 tempest-VolumesSnapshotListTestJSON-1057808077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:03 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-3ef8aa64-afe1-46ee-9b39-cde850143784 tempest-VolumesSnapshotListTestJSON-1057808077 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:55:03 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-3ef8aa64-afe1-46ee-9b39-cde850143784 tempest-VolumesSnapshotListTestJSON-1057808077 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:55:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3ef8aa64-afe1-46ee-9b39-cde850143784 tempest-VolumesSnapshotListTestJSON-1057808077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:04 devstack sudo[104983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84 1073741824 Jul 31 10:55:04 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:04 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-ba8fb7df-d60d-4d19-985d-98cd899a3183 tempest-TestImageHashVerification-1976946938 None] Copy volume to image completed successfully. Jul 31 10:55:04 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3ef8aa64-afe1-46ee-9b39-cde850143784 tempest-VolumesSnapshotListTestJSON-1057808077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84 1073741824" returned: 0 in 0.478s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3ef8aa64-afe1-46ee-9b39-cde850143784 tempest-VolumesSnapshotListTestJSON-1057808077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:04 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84 Jul 31 10:55:04 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:04 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3ef8aa64-afe1-46ee-9b39-cde850143784 tempest-VolumesSnapshotListTestJSON-1057808077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84" returned: 0 in 0.295s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-3ef8aa64-afe1-46ee-9b39-cde850143784 tempest-VolumesSnapshotListTestJSON-1057808077 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:55:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3ef8aa64-afe1-46ee-9b39-cde850143784 tempest-VolumesSnapshotListTestJSON-1057808077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2853cfef-a080-448b-a4ba-bc0d0f68eef1 tempest-CreateVolumesFromImageTest-727387812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.109s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2853cfef-a080-448b-a4ba-bc0d0f68eef1 tempest-CreateVolumesFromImageTest-727387812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-68932643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4b32fc7-58bd-4d95-81cc-28f5e8934a02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf288c66c5d4a5e87b4daf46bff6e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:54:53Z,use_quota=True,user_id='f9dd01a864cf4e2a9b419cb7f239888d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:55:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-2853cfef-a080-448b-a4ba-bc0d0f68eef1 tempest-CreateVolumesFromImageTest-727387812 None] Creating volume f4b32fc7-58bd-4d95-81cc-28f5e8934a02 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:55:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2853cfef-a080-448b-a4ba-bc0d0f68eef1 tempest-CreateVolumesFromImageTest-727387812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2853cfef-a080-448b-a4ba-bc0d0f68eef1 tempest-CreateVolumesFromImageTest-727387812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2853cfef-a080-448b-a4ba-bc0d0f68eef1 tempest-CreateVolumesFromImageTest-727387812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:55:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2853cfef-a080-448b-a4ba-bc0d0f68eef1 tempest-CreateVolumesFromImageTest-727387812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:55:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2853cfef-a080-448b-a4ba-bc0d0f68eef1 tempest-CreateVolumesFromImageTest-727387812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2853cfef-a080-448b-a4ba-bc0d0f68eef1 tempest-CreateVolumesFromImageTest-727387812 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:55:04 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-2853cfef-a080-448b-a4ba-bc0d0f68eef1 tempest-CreateVolumesFromImageTest-727387812 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:55:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2853cfef-a080-448b-a4ba-bc0d0f68eef1 tempest-CreateVolumesFromImageTest-727387812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f4b32fc7-58bd-4d95-81cc-28f5e8934a02 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:04 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f4b32fc7-58bd-4d95-81cc-28f5e8934a02 1073741824 Jul 31 10:55:04 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:04 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3ef8aa64-afe1-46ee-9b39-cde850143784 tempest-VolumesSnapshotListTestJSON-1057808077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a86b83c-024e-45a4-83a8-f1bc23afa2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b112411-a782-430d-9605-bbfef0a21c84', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:04 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3ef8aa64-afe1-46ee-9b39-cde850143784 tempest-VolumesSnapshotListTestJSON-1057808077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65874292-b118-437e-a1bd-b0fcb127ae11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:04 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-3ef8aa64-afe1-46ee-9b39-cde850143784 tempest-VolumesSnapshotListTestJSON-1057808077 None] Volume volume-3b112411-a782-430d-9605-bbfef0a21c84 (3b112411-a782-430d-9605-bbfef0a21c84): created successfully Jul 31 10:55:04 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3ef8aa64-afe1-46ee-9b39-cde850143784 tempest-VolumesSnapshotListTestJSON-1057808077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65874292-b118-437e-a1bd-b0fcb127ae11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:04 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3ef8aa64-afe1-46ee-9b39-cde850143784 tempest-VolumesSnapshotListTestJSON-1057808077 None] Flow 'volume_create_manager' (a2fcf9c3-b556-4770-86e1-7b2849d54b35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:04 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-3ef8aa64-afe1-46ee-9b39-cde850143784 tempest-VolumesSnapshotListTestJSON-1057808077 None] Created volume successfully. Jul 31 10:55:05 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2853cfef-a080-448b-a4ba-bc0d0f68eef1 tempest-CreateVolumesFromImageTest-727387812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f4b32fc7-58bd-4d95-81cc-28f5e8934a02 1073741824" returned: 0 in 0.517s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2853cfef-a080-448b-a4ba-bc0d0f68eef1 tempest-CreateVolumesFromImageTest-727387812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f4b32fc7-58bd-4d95-81cc-28f5e8934a02 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:05 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f4b32fc7-58bd-4d95-81cc-28f5e8934a02 Jul 31 10:55:05 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:05 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-5f6626e1-8ac0-42b0-85e1-623bf090b0c4 tempest-TestImageHashVerification-1976946938 None] Acquiring lock "cinder-a01c9c86-4b66-4737-a15f-a916669a4694-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:05 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-5f6626e1-8ac0-42b0-85e1-623bf090b0c4 tempest-TestImageHashVerification-1976946938 None] Lock "cinder-a01c9c86-4b66-4737-a15f-a916669a4694-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:05 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-5f6626e1-8ac0-42b0-85e1-623bf090b0c4 tempest-TestImageHashVerification-1976946938 None] Acquiring lock "cinder-quobyte-a01c9c86-4b66-4737-a15f-a916669a4694" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:05 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-5f6626e1-8ac0-42b0-85e1-623bf090b0c4 tempest-TestImageHashVerification-1976946938 None] Lock "cinder-quobyte-a01c9c86-4b66-4737-a15f-a916669a4694" acquired by "delete_volume" :: waited 0.017s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:05 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3999e4-0672-4f7e-815f-af3895779027]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5f6626e1-8ac0-42b0-85e1-623bf090b0c4 tempest-TestImageHashVerification-1976946938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a01c9c86-4b66-4737-a15f-a916669a4694 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:05 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2853cfef-a080-448b-a4ba-bc0d0f68eef1 tempest-CreateVolumesFromImageTest-727387812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f4b32fc7-58bd-4d95-81cc-28f5e8934a02" returned: 0 in 0.359s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:05 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2853cfef-a080-448b-a4ba-bc0d0f68eef1 tempest-CreateVolumesFromImageTest-727387812 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:55:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2853cfef-a080-448b-a4ba-bc0d0f68eef1 tempest-CreateVolumesFromImageTest-727387812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6c85cd32-d928-4e31-9308-447de3384e46 tempest-CreateVolumesFromImageTest-727387812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.363s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:05 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-6c85cd32-d928-4e31-9308-447de3384e46 tempest-CreateVolumesFromImageTest-727387812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-202540324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b6566ef-6256-4618-8d51-93e1ac5c33f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf288c66c5d4a5e87b4daf46bff6e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:54:54Z,use_quota=True,user_id='f9dd01a864cf4e2a9b419cb7f239888d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:55:05 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-6c85cd32-d928-4e31-9308-447de3384e46 tempest-CreateVolumesFromImageTest-727387812 None] Creating volume 6b6566ef-6256-4618-8d51-93e1ac5c33f2 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:55:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6c85cd32-d928-4e31-9308-447de3384e46 tempest-CreateVolumesFromImageTest-727387812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6c85cd32-d928-4e31-9308-447de3384e46 tempest-CreateVolumesFromImageTest-727387812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:05 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-6c85cd32-d928-4e31-9308-447de3384e46 tempest-CreateVolumesFromImageTest-727387812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:55:05 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a01c9c86-4b66-4737-a15f-a916669a4694 Jul 31 10:55:05 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:05 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-6c85cd32-d928-4e31-9308-447de3384e46 tempest-CreateVolumesFromImageTest-727387812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:55:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6c85cd32-d928-4e31-9308-447de3384e46 tempest-CreateVolumesFromImageTest-727387812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:05 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-6c85cd32-d928-4e31-9308-447de3384e46 tempest-CreateVolumesFromImageTest-727387812 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:55:05 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-6c85cd32-d928-4e31-9308-447de3384e46 tempest-CreateVolumesFromImageTest-727387812 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:55:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6c85cd32-d928-4e31-9308-447de3384e46 tempest-CreateVolumesFromImageTest-727387812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6b6566ef-6256-4618-8d51-93e1ac5c33f2 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:05 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6b6566ef-6256-4618-8d51-93e1ac5c33f2 1073741824 Jul 31 10:55:05 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:05 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2853cfef-a080-448b-a4ba-bc0d0f68eef1 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ea66d67-a301-4b57-b5e5-daf78bde2ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4b32fc7-58bd-4d95-81cc-28f5e8934a02', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:05 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2853cfef-a080-448b-a4ba-bc0d0f68eef1 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39f36031-8eb4-4de5-b469-d05b00912437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:05 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-2853cfef-a080-448b-a4ba-bc0d0f68eef1 tempest-CreateVolumesFromImageTest-727387812 None] Volume volume-f4b32fc7-58bd-4d95-81cc-28f5e8934a02 (f4b32fc7-58bd-4d95-81cc-28f5e8934a02): created successfully Jul 31 10:55:05 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2853cfef-a080-448b-a4ba-bc0d0f68eef1 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39f36031-8eb4-4de5-b469-d05b00912437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:05 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2853cfef-a080-448b-a4ba-bc0d0f68eef1 tempest-CreateVolumesFromImageTest-727387812 None] Flow 'volume_create_manager' (b3bc54c8-3c79-4f20-835f-74177ca2d3f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:05 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-2853cfef-a080-448b-a4ba-bc0d0f68eef1 tempest-CreateVolumesFromImageTest-727387812 None] Created volume successfully. Jul 31 10:55:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-bf781c46-067a-479b-9ae5-074f7e1d06b1 tempest-VolumesSnapshotListTestJSON-1057808077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:06 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5f6626e1-8ac0-42b0-85e1-623bf090b0c4 tempest-TestImageHashVerification-1976946938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a01c9c86-4b66-4737-a15f-a916669a4694" returned: 0 in 0.480s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5f6626e1-8ac0-42b0-85e1-623bf090b0c4 tempest-TestImageHashVerification-1976946938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a01c9c86-4b66-4737-a15f-a916669a4694 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:06 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a01c9c86-4b66-4737-a15f-a916669a4694 Jul 31 10:55:06 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:06 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6c85cd32-d928-4e31-9308-447de3384e46 tempest-CreateVolumesFromImageTest-727387812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6b6566ef-6256-4618-8d51-93e1ac5c33f2 1073741824" returned: 0 in 0.568s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6c85cd32-d928-4e31-9308-447de3384e46 tempest-CreateVolumesFromImageTest-727387812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6b6566ef-6256-4618-8d51-93e1ac5c33f2 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:06 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:06 devstack sudo[105015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6b6566ef-6256-4618-8d51-93e1ac5c33f2 Jul 31 10:55:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5f6626e1-8ac0-42b0-85e1-623bf090b0c4 tempest-TestImageHashVerification-1976946938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a01c9c86-4b66-4737-a15f-a916669a4694" returned: 0 in 0.301s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:06 devstack sudo[105015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:06 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-5f6626e1-8ac0-42b0-85e1-623bf090b0c4 tempest-TestImageHashVerification-1976946938 None] Lock "cinder-quobyte-a01c9c86-4b66-4737-a15f-a916669a4694" released by "delete_volume" :: held 0.834s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:06 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-5f6626e1-8ac0-42b0-85e1-623bf090b0c4 tempest-TestImageHashVerification-1976946938 None] Created reservations ['e3c35927-f411-4cb4-a11b-86fa74efed51', 'bc8dd787-af87-4f5e-88b2-14f13789a3f8', 'dca65a6d-06c0-4ff1-8742-a40754b4c334', 'cb919854-9758-4e97-8078-f87c8aef5a24'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:55:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-5f6626e1-8ac0-42b0-85e1-623bf090b0c4 tempest-TestImageHashVerification-1976946938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-5f6626e1-8ac0-42b0-85e1-623bf090b0c4 tempest-TestImageHashVerification-1976946938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:06 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-5f6626e1-8ac0-42b0-85e1-623bf090b0c4 tempest-TestImageHashVerification-1976946938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:55:06 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-5f6626e1-8ac0-42b0-85e1-623bf090b0c4 tempest-TestImageHashVerification-1976946938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:55:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-5f6626e1-8ac0-42b0-85e1-623bf090b0c4 tempest-TestImageHashVerification-1976946938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5f6626e1-8ac0-42b0-85e1-623bf090b0c4 tempest-TestImageHashVerification-1976946938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:06 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:55:06 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:06 devstack sudo[105015]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6c85cd32-d928-4e31-9308-447de3384e46 tempest-CreateVolumesFromImageTest-727387812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6b6566ef-6256-4618-8d51-93e1ac5c33f2" returned: 0 in 0.305s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:06 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-6c85cd32-d928-4e31-9308-447de3384e46 tempest-CreateVolumesFromImageTest-727387812 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:55:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6c85cd32-d928-4e31-9308-447de3384e46 tempest-CreateVolumesFromImageTest-727387812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-50af5fb5-bb1f-40e8-b83b-5d4916b16ae5 tempest-CreateVolumesFromImageTest-727387812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.618s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:06 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-50af5fb5-bb1f-40e8-b83b-5d4916b16ae5 tempest-CreateVolumesFromImageTest-727387812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1705042515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d33c47c-4c65-4c1f-8b2f-87bf85d29a26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf288c66c5d4a5e87b4daf46bff6e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:54:55Z,use_quota=True,user_id='f9dd01a864cf4e2a9b419cb7f239888d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:55:06 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-50af5fb5-bb1f-40e8-b83b-5d4916b16ae5 tempest-CreateVolumesFromImageTest-727387812 None] Creating volume 7d33c47c-4c65-4c1f-8b2f-87bf85d29a26 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:55:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-50af5fb5-bb1f-40e8-b83b-5d4916b16ae5 tempest-CreateVolumesFromImageTest-727387812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-50af5fb5-bb1f-40e8-b83b-5d4916b16ae5 tempest-CreateVolumesFromImageTest-727387812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:06 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-50af5fb5-bb1f-40e8-b83b-5d4916b16ae5 tempest-CreateVolumesFromImageTest-727387812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:55:06 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-50af5fb5-bb1f-40e8-b83b-5d4916b16ae5 tempest-CreateVolumesFromImageTest-727387812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:55:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-50af5fb5-bb1f-40e8-b83b-5d4916b16ae5 tempest-CreateVolumesFromImageTest-727387812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:06 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-50af5fb5-bb1f-40e8-b83b-5d4916b16ae5 tempest-CreateVolumesFromImageTest-727387812 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:55:06 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-50af5fb5-bb1f-40e8-b83b-5d4916b16ae5 tempest-CreateVolumesFromImageTest-727387812 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:55:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-50af5fb5-bb1f-40e8-b83b-5d4916b16ae5 tempest-CreateVolumesFromImageTest-727387812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-7d33c47c-4c65-4c1f-8b2f-87bf85d29a26 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:06 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-7d33c47c-4c65-4c1f-8b2f-87bf85d29a26 1073741824 Jul 31 10:55:06 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:06 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6c85cd32-d928-4e31-9308-447de3384e46 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b36812-cda8-474f-94c9-7d70ad624bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b6566ef-6256-4618-8d51-93e1ac5c33f2', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:06 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6c85cd32-d928-4e31-9308-447de3384e46 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6beb17f1-a35b-4355-8302-903193e26eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:06 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-6c85cd32-d928-4e31-9308-447de3384e46 tempest-CreateVolumesFromImageTest-727387812 None] Volume volume-6b6566ef-6256-4618-8d51-93e1ac5c33f2 (6b6566ef-6256-4618-8d51-93e1ac5c33f2): created successfully Jul 31 10:55:06 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6c85cd32-d928-4e31-9308-447de3384e46 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6beb17f1-a35b-4355-8302-903193e26eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:06 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6c85cd32-d928-4e31-9308-447de3384e46 tempest-CreateVolumesFromImageTest-727387812 None] Flow 'volume_create_manager' (e091c9a2-0948-40f4-adcc-b81a9acc37f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:06 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-6c85cd32-d928-4e31-9308-447de3384e46 tempest-CreateVolumesFromImageTest-727387812 None] Created volume successfully. Jul 31 10:55:06 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5f6626e1-8ac0-42b0-85e1-623bf090b0c4 tempest-TestImageHashVerification-1976946938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.368s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:06 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-5f6626e1-8ac0-42b0-85e1-623bf090b0c4 tempest-TestImageHashVerification-1976946938 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:55:06 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-5f6626e1-8ac0-42b0-85e1-623bf090b0c4 tempest-TestImageHashVerification-1976946938 None] Deleted volume successfully. Jul 31 10:55:07 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-5f6626e1-8ac0-42b0-85e1-623bf090b0c4 tempest-TestImageHashVerification-1976946938 None] Lock "cinder-a01c9c86-4b66-4737-a15f-a916669a4694-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:07 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-50af5fb5-bb1f-40e8-b83b-5d4916b16ae5 tempest-CreateVolumesFromImageTest-727387812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-7d33c47c-4c65-4c1f-8b2f-87bf85d29a26 1073741824" returned: 0 in 0.591s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-50af5fb5-bb1f-40e8-b83b-5d4916b16ae5 tempest-CreateVolumesFromImageTest-727387812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-7d33c47c-4c65-4c1f-8b2f-87bf85d29a26 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:07 devstack sudo[105027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-7d33c47c-4c65-4c1f-8b2f-87bf85d29a26 Jul 31 10:55:07 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:07 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-50af5fb5-bb1f-40e8-b83b-5d4916b16ae5 tempest-CreateVolumesFromImageTest-727387812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-7d33c47c-4c65-4c1f-8b2f-87bf85d29a26" returned: 0 in 0.292s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:07 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-50af5fb5-bb1f-40e8-b83b-5d4916b16ae5 tempest-CreateVolumesFromImageTest-727387812 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:55:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-50af5fb5-bb1f-40e8-b83b-5d4916b16ae5 tempest-CreateVolumesFromImageTest-727387812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4f56f812-59cc-4d10-9b35-1d57a1aa5b1a tempest-CreateVolumesFromImageTest-727387812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.985s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:07 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4f56f812-59cc-4d10-9b35-1d57a1aa5b1a tempest-CreateVolumesFromImageTest-727387812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1687647218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09d63154-46b3-4834-b915-9d1b8dc18166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf288c66c5d4a5e87b4daf46bff6e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:54:55Z,use_quota=True,user_id='f9dd01a864cf4e2a9b419cb7f239888d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:55:07 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-4f56f812-59cc-4d10-9b35-1d57a1aa5b1a tempest-CreateVolumesFromImageTest-727387812 None] Creating volume 09d63154-46b3-4834-b915-9d1b8dc18166 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:55:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4f56f812-59cc-4d10-9b35-1d57a1aa5b1a tempest-CreateVolumesFromImageTest-727387812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4f56f812-59cc-4d10-9b35-1d57a1aa5b1a tempest-CreateVolumesFromImageTest-727387812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:07 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4f56f812-59cc-4d10-9b35-1d57a1aa5b1a tempest-CreateVolumesFromImageTest-727387812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:55:07 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4f56f812-59cc-4d10-9b35-1d57a1aa5b1a tempest-CreateVolumesFromImageTest-727387812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:55:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4f56f812-59cc-4d10-9b35-1d57a1aa5b1a tempest-CreateVolumesFromImageTest-727387812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:07 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4f56f812-59cc-4d10-9b35-1d57a1aa5b1a tempest-CreateVolumesFromImageTest-727387812 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:55:07 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-4f56f812-59cc-4d10-9b35-1d57a1aa5b1a tempest-CreateVolumesFromImageTest-727387812 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:55:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4f56f812-59cc-4d10-9b35-1d57a1aa5b1a tempest-CreateVolumesFromImageTest-727387812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-09d63154-46b3-4834-b915-9d1b8dc18166 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:07 devstack sudo[105030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-09d63154-46b3-4834-b915-9d1b8dc18166 1073741824 Jul 31 10:55:07 devstack sudo[105030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:07 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50af5fb5-bb1f-40e8-b83b-5d4916b16ae5 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c30617a-2176-4a02-b6ed-861181ec2b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d33c47c-4c65-4c1f-8b2f-87bf85d29a26', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:07 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50af5fb5-bb1f-40e8-b83b-5d4916b16ae5 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9147874-0915-43fb-ba26-09676c1dc1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:07 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-50af5fb5-bb1f-40e8-b83b-5d4916b16ae5 tempest-CreateVolumesFromImageTest-727387812 None] Volume volume-7d33c47c-4c65-4c1f-8b2f-87bf85d29a26 (7d33c47c-4c65-4c1f-8b2f-87bf85d29a26): created successfully Jul 31 10:55:07 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50af5fb5-bb1f-40e8-b83b-5d4916b16ae5 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9147874-0915-43fb-ba26-09676c1dc1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:07 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50af5fb5-bb1f-40e8-b83b-5d4916b16ae5 tempest-CreateVolumesFromImageTest-727387812 None] Flow 'volume_create_manager' (4e038478-ba4a-44ce-8c2b-a2488901ac37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:07 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-50af5fb5-bb1f-40e8-b83b-5d4916b16ae5 tempest-CreateVolumesFromImageTest-727387812 None] Created volume successfully. Jul 31 10:55:08 devstack sudo[105030]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4f56f812-59cc-4d10-9b35-1d57a1aa5b1a tempest-CreateVolumesFromImageTest-727387812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-09d63154-46b3-4834-b915-9d1b8dc18166 1073741824" returned: 0 in 0.593s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4f56f812-59cc-4d10-9b35-1d57a1aa5b1a tempest-CreateVolumesFromImageTest-727387812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-09d63154-46b3-4834-b915-9d1b8dc18166 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:08 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-09d63154-46b3-4834-b915-9d1b8dc18166 Jul 31 10:55:08 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:08 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4f56f812-59cc-4d10-9b35-1d57a1aa5b1a tempest-CreateVolumesFromImageTest-727387812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-09d63154-46b3-4834-b915-9d1b8dc18166" returned: 0 in 0.327s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:08 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4f56f812-59cc-4d10-9b35-1d57a1aa5b1a tempest-CreateVolumesFromImageTest-727387812 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:55:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4f56f812-59cc-4d10-9b35-1d57a1aa5b1a tempest-CreateVolumesFromImageTest-727387812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7f882b9f-95a1-42bd-9ef5-f59077a547c7 tempest-CreateVolumesFromImageTest-727387812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.517s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:08 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-7f882b9f-95a1-42bd-9ef5-f59077a547c7 tempest-CreateVolumesFromImageTest-727387812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1491953950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a31386e3-e07a-4640-b13e-b639f469297f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf288c66c5d4a5e87b4daf46bff6e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:54:56Z,use_quota=True,user_id='f9dd01a864cf4e2a9b419cb7f239888d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:55:08 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-7f882b9f-95a1-42bd-9ef5-f59077a547c7 tempest-CreateVolumesFromImageTest-727387812 None] Creating volume a31386e3-e07a-4640-b13e-b639f469297f {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:55:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7f882b9f-95a1-42bd-9ef5-f59077a547c7 tempest-CreateVolumesFromImageTest-727387812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7f882b9f-95a1-42bd-9ef5-f59077a547c7 tempest-CreateVolumesFromImageTest-727387812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:08 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-7f882b9f-95a1-42bd-9ef5-f59077a547c7 tempest-CreateVolumesFromImageTest-727387812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:55:08 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-7f882b9f-95a1-42bd-9ef5-f59077a547c7 tempest-CreateVolumesFromImageTest-727387812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:55:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7f882b9f-95a1-42bd-9ef5-f59077a547c7 tempest-CreateVolumesFromImageTest-727387812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:08 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-7f882b9f-95a1-42bd-9ef5-f59077a547c7 tempest-CreateVolumesFromImageTest-727387812 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:55:08 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-7f882b9f-95a1-42bd-9ef5-f59077a547c7 tempest-CreateVolumesFromImageTest-727387812 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:55:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7f882b9f-95a1-42bd-9ef5-f59077a547c7 tempest-CreateVolumesFromImageTest-727387812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a31386e3-e07a-4640-b13e-b639f469297f 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4f56f812-59cc-4d10-9b35-1d57a1aa5b1a tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76aeddd7-d164-42be-b5bb-05f72d9a9c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09d63154-46b3-4834-b915-9d1b8dc18166', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:08 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a31386e3-e07a-4640-b13e-b639f469297f 1073741824 Jul 31 10:55:08 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4f56f812-59cc-4d10-9b35-1d57a1aa5b1a tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5426e5d7-4bdf-4c79-9b2a-70ac0395ac1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:08 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-4f56f812-59cc-4d10-9b35-1d57a1aa5b1a tempest-CreateVolumesFromImageTest-727387812 None] Volume volume-09d63154-46b3-4834-b915-9d1b8dc18166 (09d63154-46b3-4834-b915-9d1b8dc18166): created successfully Jul 31 10:55:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4f56f812-59cc-4d10-9b35-1d57a1aa5b1a tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5426e5d7-4bdf-4c79-9b2a-70ac0395ac1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4f56f812-59cc-4d10-9b35-1d57a1aa5b1a tempest-CreateVolumesFromImageTest-727387812 None] Flow 'volume_create_manager' (d2fb531c-2160-4b99-908f-4c051c81db5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:08 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-4f56f812-59cc-4d10-9b35-1d57a1aa5b1a tempest-CreateVolumesFromImageTest-727387812 None] Created volume successfully. Jul 31 10:55:09 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7f882b9f-95a1-42bd-9ef5-f59077a547c7 tempest-CreateVolumesFromImageTest-727387812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a31386e3-e07a-4640-b13e-b639f469297f 1073741824" returned: 0 in 0.540s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7f882b9f-95a1-42bd-9ef5-f59077a547c7 tempest-CreateVolumesFromImageTest-727387812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a31386e3-e07a-4640-b13e-b639f469297f {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:09 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a31386e3-e07a-4640-b13e-b639f469297f Jul 31 10:55:09 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:09 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7f882b9f-95a1-42bd-9ef5-f59077a547c7 tempest-CreateVolumesFromImageTest-727387812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a31386e3-e07a-4640-b13e-b639f469297f" returned: 0 in 0.285s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:09 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-7f882b9f-95a1-42bd-9ef5-f59077a547c7 tempest-CreateVolumesFromImageTest-727387812 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:55:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7f882b9f-95a1-42bd-9ef5-f59077a547c7 tempest-CreateVolumesFromImageTest-727387812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-68e2154a-436b-4556-ba26-53f4ef21fbac tempest-SnapshotDependencyTests-2128035145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.397s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:09 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-68e2154a-436b-4556-ba26-53f4ef21fbac tempest-SnapshotDependencyTests-2128035145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1525230293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=408b78a5-8f37-417d-9310-a63c47ad4d03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d9c581d5970485993604db0e31e83dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:02Z,use_quota=True,user_id='b6e272f69337443b84f60a89ac85691e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:55:09 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-68e2154a-436b-4556-ba26-53f4ef21fbac tempest-SnapshotDependencyTests-2128035145 None] Creating volume 408b78a5-8f37-417d-9310-a63c47ad4d03 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:55:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-68e2154a-436b-4556-ba26-53f4ef21fbac tempest-SnapshotDependencyTests-2128035145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-68e2154a-436b-4556-ba26-53f4ef21fbac tempest-SnapshotDependencyTests-2128035145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:09 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-68e2154a-436b-4556-ba26-53f4ef21fbac tempest-SnapshotDependencyTests-2128035145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:55:09 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-68e2154a-436b-4556-ba26-53f4ef21fbac tempest-SnapshotDependencyTests-2128035145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:55:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-68e2154a-436b-4556-ba26-53f4ef21fbac tempest-SnapshotDependencyTests-2128035145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:09 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-68e2154a-436b-4556-ba26-53f4ef21fbac tempest-SnapshotDependencyTests-2128035145 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:55:09 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-68e2154a-436b-4556-ba26-53f4ef21fbac tempest-SnapshotDependencyTests-2128035145 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:55:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-68e2154a-436b-4556-ba26-53f4ef21fbac tempest-SnapshotDependencyTests-2128035145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:09 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03 1073741824 Jul 31 10:55:09 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:09 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7f882b9f-95a1-42bd-9ef5-f59077a547c7 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71c7b91e-cd93-46de-aab5-a2375b2cb5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a31386e3-e07a-4640-b13e-b639f469297f', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:09 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7f882b9f-95a1-42bd-9ef5-f59077a547c7 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (080cf27e-7ea9-4d5e-9e1c-5d963a7db3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:09 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-7f882b9f-95a1-42bd-9ef5-f59077a547c7 tempest-CreateVolumesFromImageTest-727387812 None] Volume volume-a31386e3-e07a-4640-b13e-b639f469297f (a31386e3-e07a-4640-b13e-b639f469297f): created successfully Jul 31 10:55:09 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7f882b9f-95a1-42bd-9ef5-f59077a547c7 tempest-CreateVolumesFromImageTest-727387812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (080cf27e-7ea9-4d5e-9e1c-5d963a7db3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:09 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7f882b9f-95a1-42bd-9ef5-f59077a547c7 tempest-CreateVolumesFromImageTest-727387812 None] Flow 'volume_create_manager' (2eb992a6-30ca-470b-9f74-b03c71cac1e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:09 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-7f882b9f-95a1-42bd-9ef5-f59077a547c7 tempest-CreateVolumesFromImageTest-727387812 None] Created volume successfully. Jul 31 10:55:10 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-68e2154a-436b-4556-ba26-53f4ef21fbac tempest-SnapshotDependencyTests-2128035145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03 1073741824" returned: 0 in 0.571s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-68e2154a-436b-4556-ba26-53f4ef21fbac tempest-SnapshotDependencyTests-2128035145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:10 devstack sudo[105091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03 Jul 31 10:55:10 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7b777396-492c-49ca-a8f8-08123da4db29 tempest-CreateVolumesFromImageTest-727387812 None] Acquiring lock "cinder-a31386e3-e07a-4640-b13e-b639f469297f-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7b777396-492c-49ca-a8f8-08123da4db29 tempest-CreateVolumesFromImageTest-727387812 None] Lock "cinder-a31386e3-e07a-4640-b13e-b639f469297f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7b777396-492c-49ca-a8f8-08123da4db29 tempest-CreateVolumesFromImageTest-727387812 None] Acquiring lock "cinder-quobyte-a31386e3-e07a-4640-b13e-b639f469297f" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7b777396-492c-49ca-a8f8-08123da4db29 tempest-CreateVolumesFromImageTest-727387812 None] Lock "cinder-quobyte-a31386e3-e07a-4640-b13e-b639f469297f" acquired by "delete_volume" :: waited 0.024s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:10 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02d931e-9553-4bfb-8c3d-ef2e195ca8e7]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7b777396-492c-49ca-a8f8-08123da4db29 tempest-CreateVolumesFromImageTest-727387812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a31386e3-e07a-4640-b13e-b639f469297f {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:10 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-68e2154a-436b-4556-ba26-53f4ef21fbac tempest-SnapshotDependencyTests-2128035145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03" returned: 0 in 0.636s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:10 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-68e2154a-436b-4556-ba26-53f4ef21fbac tempest-SnapshotDependencyTests-2128035145 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:55:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-68e2154a-436b-4556-ba26-53f4ef21fbac tempest-SnapshotDependencyTests-2128035145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-bf781c46-067a-479b-9ae5-074f7e1d06b1 tempest-VolumesSnapshotListTestJSON-1057808077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.787s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:10 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-68e2154a-436b-4556-ba26-53f4ef21fbac tempest-SnapshotDependencyTests-2128035145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec6d53a-cf99-4f96-9590-1a4541ac8038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-408b78a5-8f37-417d-9310-a63c47ad4d03', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:10 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-68e2154a-436b-4556-ba26-53f4ef21fbac tempest-SnapshotDependencyTests-2128035145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2abf8e4-0375-484a-902b-c5a402cc7b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:10 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-bf781c46-067a-479b-9ae5-074f7e1d06b1 tempest-VolumesSnapshotListTestJSON-1057808077 None] Creating offline snapshot cbc8c566-7acb-4223-ac6b-7d217c7e53f0 of volume 3b112411-a782-430d-9605-bbfef0a21c84 {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:55:10 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-68e2154a-436b-4556-ba26-53f4ef21fbac tempest-SnapshotDependencyTests-2128035145 None] Volume volume-408b78a5-8f37-417d-9310-a63c47ad4d03 (408b78a5-8f37-417d-9310-a63c47ad4d03): created successfully Jul 31 10:55:10 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-68e2154a-436b-4556-ba26-53f4ef21fbac tempest-SnapshotDependencyTests-2128035145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2abf8e4-0375-484a-902b-c5a402cc7b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:10 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-68e2154a-436b-4556-ba26-53f4ef21fbac tempest-SnapshotDependencyTests-2128035145 None] Flow 'volume_create_manager' (16fcc1be-0660-410b-83d8-fdae6974a5f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:10 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1004c04-9915-4082-84b1-cffe23981c9d]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bf781c46-067a-479b-9ae5-074f7e1d06b1 tempest-VolumesSnapshotListTestJSON-1057808077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:10 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-68e2154a-436b-4556-ba26-53f4ef21fbac tempest-SnapshotDependencyTests-2128035145 None] Created volume successfully. Jul 31 10:55:10 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a31386e3-e07a-4640-b13e-b639f469297f Jul 31 10:55:10 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:11 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84 Jul 31 10:55:11 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:11 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7b777396-492c-49ca-a8f8-08123da4db29 tempest-CreateVolumesFromImageTest-727387812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a31386e3-e07a-4640-b13e-b639f469297f" returned: 0 in 0.496s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7b777396-492c-49ca-a8f8-08123da4db29 tempest-CreateVolumesFromImageTest-727387812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a31386e3-e07a-4640-b13e-b639f469297f {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:11 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a31386e3-e07a-4640-b13e-b639f469297f Jul 31 10:55:11 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:11 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bf781c46-067a-479b-9ae5-074f7e1d06b1 tempest-VolumesSnapshotListTestJSON-1057808077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84" returned: 0 in 0.528s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bf781c46-067a-479b-9ae5-074f7e1d06b1 tempest-VolumesSnapshotListTestJSON-1057808077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.cbc8c566-7acb-4223-ac6b-7d217c7e53f0 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:11 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.cbc8c566-7acb-4223-ac6b-7d217c7e53f0 1G Jul 31 10:55:11 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:11 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7b777396-492c-49ca-a8f8-08123da4db29 tempest-CreateVolumesFromImageTest-727387812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a31386e3-e07a-4640-b13e-b639f469297f" returned: 0 in 0.331s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:11 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7b777396-492c-49ca-a8f8-08123da4db29 tempest-CreateVolumesFromImageTest-727387812 None] Lock "cinder-quobyte-a31386e3-e07a-4640-b13e-b639f469297f" released by "delete_volume" :: held 0.907s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:11 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-7b777396-492c-49ca-a8f8-08123da4db29 tempest-CreateVolumesFromImageTest-727387812 None] Created reservations ['e74b64af-d78a-415e-a619-2d9437c4f606', 'deb72a2d-a720-4fc6-976c-f579a284a785', 'a46b7e56-6102-443e-99a2-a37a4af6c822', '66e7a09e-ca3a-4935-88a6-2bee3e5fcabb'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:55:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7b777396-492c-49ca-a8f8-08123da4db29 tempest-CreateVolumesFromImageTest-727387812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7b777396-492c-49ca-a8f8-08123da4db29 tempest-CreateVolumesFromImageTest-727387812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:11 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-7b777396-492c-49ca-a8f8-08123da4db29 tempest-CreateVolumesFromImageTest-727387812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:55:11 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-7b777396-492c-49ca-a8f8-08123da4db29 tempest-CreateVolumesFromImageTest-727387812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:55:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7b777396-492c-49ca-a8f8-08123da4db29 tempest-CreateVolumesFromImageTest-727387812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7b777396-492c-49ca-a8f8-08123da4db29 tempest-CreateVolumesFromImageTest-727387812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:11 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:55:11 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:12 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bf781c46-067a-479b-9ae5-074f7e1d06b1 tempest-VolumesSnapshotListTestJSON-1057808077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.cbc8c566-7acb-4223-ac6b-7d217c7e53f0 1G" returned: 0 in 0.690s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bf781c46-067a-479b-9ae5-074f7e1d06b1 tempest-VolumesSnapshotListTestJSON-1057808077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b112411-a782-430d-9605-bbfef0a21c84 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.cbc8c566-7acb-4223-ac6b-7d217c7e53f0 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:12 devstack sudo[105210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b112411-a782-430d-9605-bbfef0a21c84 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.cbc8c566-7acb-4223-ac6b-7d217c7e53f0 Jul 31 10:55:12 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:12 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7b777396-492c-49ca-a8f8-08123da4db29 tempest-CreateVolumesFromImageTest-727387812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.369s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:12 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-7b777396-492c-49ca-a8f8-08123da4db29 tempest-CreateVolumesFromImageTest-727387812 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:55:12 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-7b777396-492c-49ca-a8f8-08123da4db29 tempest-CreateVolumesFromImageTest-727387812 None] Deleted volume successfully. Jul 31 10:55:12 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7b777396-492c-49ca-a8f8-08123da4db29 tempest-CreateVolumesFromImageTest-727387812 None] Lock "cinder-a31386e3-e07a-4640-b13e-b639f469297f-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c240fce4-c879-44c0-acca-8507bab4855e tempest-SnapshotDependencyTests-2128035145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:12 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bf781c46-067a-479b-9ae5-074f7e1d06b1 tempest-VolumesSnapshotListTestJSON-1057808077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b112411-a782-430d-9605-bbfef0a21c84 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.cbc8c566-7acb-4223-ac6b-7d217c7e53f0" returned: 0 in 0.394s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:12 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-bf781c46-067a-479b-9ae5-074f7e1d06b1 tempest-VolumesSnapshotListTestJSON-1057808077 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.cbc8c566-7acb-4223-ac6b-7d217c7e53f0 is being set with open permissions: ugo+rw Jul 31 10:55:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bf781c46-067a-479b-9ae5-074f7e1d06b1 tempest-VolumesSnapshotListTestJSON-1057808077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.cbc8c566-7acb-4223-ac6b-7d217c7e53f0 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:12 devstack sudo[105216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.cbc8c566-7acb-4223-ac6b-7d217c7e53f0 Jul 31 10:55:12 devstack sudo[105216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:12 devstack sudo[105216]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bf781c46-067a-479b-9ae5-074f7e1d06b1 tempest-VolumesSnapshotListTestJSON-1057808077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.cbc8c566-7acb-4223-ac6b-7d217c7e53f0" returned: 0 in 0.262s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bf781c46-067a-479b-9ae5-074f7e1d06b1 tempest-VolumesSnapshotListTestJSON-1057808077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:12 devstack sudo[105219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.info Jul 31 10:55:12 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:13 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f63e1c7a-e451-41f5-8b8a-93d1212f29a0 tempest-CreateVolumesFromImageTest-727387812 None] Acquiring lock "cinder-09d63154-46b3-4834-b915-9d1b8dc18166-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:13 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f63e1c7a-e451-41f5-8b8a-93d1212f29a0 tempest-CreateVolumesFromImageTest-727387812 None] Lock "cinder-09d63154-46b3-4834-b915-9d1b8dc18166-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:13 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f63e1c7a-e451-41f5-8b8a-93d1212f29a0 tempest-CreateVolumesFromImageTest-727387812 None] Acquiring lock "cinder-quobyte-09d63154-46b3-4834-b915-9d1b8dc18166" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:13 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f63e1c7a-e451-41f5-8b8a-93d1212f29a0 tempest-CreateVolumesFromImageTest-727387812 None] Lock "cinder-quobyte-09d63154-46b3-4834-b915-9d1b8dc18166" acquired by "delete_volume" :: waited 0.020s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:13 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[453ac02d-2453-403d-94fb-b6a0897b90ae]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f63e1c7a-e451-41f5-8b8a-93d1212f29a0 tempest-CreateVolumesFromImageTest-727387812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-09d63154-46b3-4834-b915-9d1b8dc18166 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:13 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bf781c46-067a-479b-9ae5-074f7e1d06b1 tempest-VolumesSnapshotListTestJSON-1057808077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.info" returned: 0 in 0.386s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:13 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-bf781c46-067a-479b-9ae5-074f7e1d06b1 tempest-VolumesSnapshotListTestJSON-1057808077 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.info is being set with open permissions: ugo+rw Jul 31 10:55:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bf781c46-067a-479b-9ae5-074f7e1d06b1 tempest-VolumesSnapshotListTestJSON-1057808077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:13 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.info Jul 31 10:55:13 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:13 devstack sudo[105222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-09d63154-46b3-4834-b915-9d1b8dc18166 Jul 31 10:55:13 devstack sudo[105222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:13 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bf781c46-067a-479b-9ae5-074f7e1d06b1 tempest-VolumesSnapshotListTestJSON-1057808077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.info" returned: 0 in 0.301s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-bf781c46-067a-479b-9ae5-074f7e1d06b1 tempest-VolumesSnapshotListTestJSON-1057808077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.708s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c240fce4-c879-44c0-acca-8507bab4855e tempest-SnapshotDependencyTests-2128035145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.138s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:13 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-c240fce4-c879-44c0-acca-8507bab4855e tempest-SnapshotDependencyTests-2128035145 None] Creating offline snapshot 6e931250-0e07-400f-84a2-7a05bb491e97 of volume 408b78a5-8f37-417d-9310-a63c47ad4d03 {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:55:13 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-bf781c46-067a-479b-9ae5-074f7e1d06b1 tempest-VolumesSnapshotListTestJSON-1057808077 None] Create snapshot completed successfully Jul 31 10:55:13 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8db6942-eee1-47c7-a1d7-f4160d709345]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c240fce4-c879-44c0-acca-8507bab4855e tempest-SnapshotDependencyTests-2128035145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:13 devstack sudo[105222]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f63e1c7a-e451-41f5-8b8a-93d1212f29a0 tempest-CreateVolumesFromImageTest-727387812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-09d63154-46b3-4834-b915-9d1b8dc18166" returned: 0 in 0.494s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f63e1c7a-e451-41f5-8b8a-93d1212f29a0 tempest-CreateVolumesFromImageTest-727387812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-09d63154-46b3-4834-b915-9d1b8dc18166 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:13 devstack sudo[105233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-09d63154-46b3-4834-b915-9d1b8dc18166 Jul 31 10:55:13 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:13 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03 Jul 31 10:55:13 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:13 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f63e1c7a-e451-41f5-8b8a-93d1212f29a0 tempest-CreateVolumesFromImageTest-727387812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-09d63154-46b3-4834-b915-9d1b8dc18166" returned: 0 in 0.312s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:13 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f63e1c7a-e451-41f5-8b8a-93d1212f29a0 tempest-CreateVolumesFromImageTest-727387812 None] Lock "cinder-quobyte-09d63154-46b3-4834-b915-9d1b8dc18166" released by "delete_volume" :: held 0.852s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:14 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-f63e1c7a-e451-41f5-8b8a-93d1212f29a0 tempest-CreateVolumesFromImageTest-727387812 None] Created reservations ['acc65743-9946-4a59-9602-f68c79e12452', 'e9d649ed-ce78-4c71-90e8-e6c3c3e86b8d', '32ef7ddd-5731-495e-9d78-208cbc5e6c16', 'c6d1f35e-cf08-488e-be10-5ae976983026'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:55:14 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c240fce4-c879-44c0-acca-8507bab4855e tempest-SnapshotDependencyTests-2128035145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03" returned: 0 in 0.491s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c240fce4-c879-44c0-acca-8507bab4855e tempest-SnapshotDependencyTests-2128035145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03.6e931250-0e07-400f-84a2-7a05bb491e97 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:14 devstack sudo[105241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03.6e931250-0e07-400f-84a2-7a05bb491e97 1G Jul 31 10:55:14 devstack sudo[105241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f63e1c7a-e451-41f5-8b8a-93d1212f29a0 tempest-CreateVolumesFromImageTest-727387812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f63e1c7a-e451-41f5-8b8a-93d1212f29a0 tempest-CreateVolumesFromImageTest-727387812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:14 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f63e1c7a-e451-41f5-8b8a-93d1212f29a0 tempest-CreateVolumesFromImageTest-727387812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:55:14 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f63e1c7a-e451-41f5-8b8a-93d1212f29a0 tempest-CreateVolumesFromImageTest-727387812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:55:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f63e1c7a-e451-41f5-8b8a-93d1212f29a0 tempest-CreateVolumesFromImageTest-727387812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f63e1c7a-e451-41f5-8b8a-93d1212f29a0 tempest-CreateVolumesFromImageTest-727387812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:14 devstack sudo[105243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:55:14 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7d89b499-6b4a-4c0e-8207-1159411b3bea tempest-CreateVolumesFromImageTest-727387812 None] Acquiring lock "cinder-7d33c47c-4c65-4c1f-8b2f-87bf85d29a26-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:14 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:14 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7d89b499-6b4a-4c0e-8207-1159411b3bea tempest-CreateVolumesFromImageTest-727387812 None] Lock "cinder-7d33c47c-4c65-4c1f-8b2f-87bf85d29a26-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:14 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7d89b499-6b4a-4c0e-8207-1159411b3bea tempest-CreateVolumesFromImageTest-727387812 None] Acquiring lock "cinder-quobyte-7d33c47c-4c65-4c1f-8b2f-87bf85d29a26" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:14 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7d89b499-6b4a-4c0e-8207-1159411b3bea tempest-CreateVolumesFromImageTest-727387812 None] Lock "cinder-quobyte-7d33c47c-4c65-4c1f-8b2f-87bf85d29a26" acquired by "delete_volume" :: waited 0.054s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:14 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acfe803-df07-4534-8eda-22bfb18f320d]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7d89b499-6b4a-4c0e-8207-1159411b3bea tempest-CreateVolumesFromImageTest-727387812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-7d33c47c-4c65-4c1f-8b2f-87bf85d29a26 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:14 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f63e1c7a-e451-41f5-8b8a-93d1212f29a0 tempest-CreateVolumesFromImageTest-727387812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.364s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:14 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-f63e1c7a-e451-41f5-8b8a-93d1212f29a0 tempest-CreateVolumesFromImageTest-727387812 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:55:14 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-f63e1c7a-e451-41f5-8b8a-93d1212f29a0 tempest-CreateVolumesFromImageTest-727387812 None] Deleted volume successfully. Jul 31 10:55:14 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f63e1c7a-e451-41f5-8b8a-93d1212f29a0 tempest-CreateVolumesFromImageTest-727387812 None] Lock "cinder-09d63154-46b3-4834-b915-9d1b8dc18166-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:14 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-7d33c47c-4c65-4c1f-8b2f-87bf85d29a26 Jul 31 10:55:14 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e7c32326-fe9e-4c19-901e-4ea4066237bb tempest-VolumesSnapshotListTestJSON-1057808077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:14 devstack sudo[105241]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c240fce4-c879-44c0-acca-8507bab4855e tempest-SnapshotDependencyTests-2128035145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03.6e931250-0e07-400f-84a2-7a05bb491e97 1G" returned: 0 in 0.817s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c240fce4-c879-44c0-acca-8507bab4855e tempest-SnapshotDependencyTests-2128035145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-408b78a5-8f37-417d-9310-a63c47ad4d03 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03.6e931250-0e07-400f-84a2-7a05bb491e97 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:14 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-408b78a5-8f37-417d-9310-a63c47ad4d03 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03.6e931250-0e07-400f-84a2-7a05bb491e97 Jul 31 10:55:14 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:15 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7d89b499-6b4a-4c0e-8207-1159411b3bea tempest-CreateVolumesFromImageTest-727387812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-7d33c47c-4c65-4c1f-8b2f-87bf85d29a26" returned: 0 in 0.476s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7d89b499-6b4a-4c0e-8207-1159411b3bea tempest-CreateVolumesFromImageTest-727387812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-7d33c47c-4c65-4c1f-8b2f-87bf85d29a26 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:15 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-7d33c47c-4c65-4c1f-8b2f-87bf85d29a26 Jul 31 10:55:15 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:15 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c240fce4-c879-44c0-acca-8507bab4855e tempest-SnapshotDependencyTests-2128035145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-408b78a5-8f37-417d-9310-a63c47ad4d03 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03.6e931250-0e07-400f-84a2-7a05bb491e97" returned: 0 in 0.395s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:15 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-c240fce4-c879-44c0-acca-8507bab4855e tempest-SnapshotDependencyTests-2128035145 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03.6e931250-0e07-400f-84a2-7a05bb491e97 is being set with open permissions: ugo+rw Jul 31 10:55:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c240fce4-c879-44c0-acca-8507bab4855e tempest-SnapshotDependencyTests-2128035145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03.6e931250-0e07-400f-84a2-7a05bb491e97 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:15 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03.6e931250-0e07-400f-84a2-7a05bb491e97 Jul 31 10:55:15 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:15 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7d89b499-6b4a-4c0e-8207-1159411b3bea tempest-CreateVolumesFromImageTest-727387812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-7d33c47c-4c65-4c1f-8b2f-87bf85d29a26" returned: 0 in 0.328s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:15 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7d89b499-6b4a-4c0e-8207-1159411b3bea tempest-CreateVolumesFromImageTest-727387812 None] Lock "cinder-quobyte-7d33c47c-4c65-4c1f-8b2f-87bf85d29a26" released by "delete_volume" :: held 0.884s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:15 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-7d89b499-6b4a-4c0e-8207-1159411b3bea tempest-CreateVolumesFromImageTest-727387812 None] Created reservations ['301d71cc-caa1-492d-a046-0fe50bf2f229', '85bb67cb-7a56-4c25-bb62-aa1a17addddc', 'b2475d3f-bbe5-4f67-b4de-0f509d5d5e2f', '82a45b72-75eb-4d9e-87dd-c3ee4885ee0c'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:55:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7d89b499-6b4a-4c0e-8207-1159411b3bea tempest-CreateVolumesFromImageTest-727387812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7d89b499-6b4a-4c0e-8207-1159411b3bea tempest-CreateVolumesFromImageTest-727387812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:15 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-7d89b499-6b4a-4c0e-8207-1159411b3bea tempest-CreateVolumesFromImageTest-727387812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:55:15 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-7d89b499-6b4a-4c0e-8207-1159411b3bea tempest-CreateVolumesFromImageTest-727387812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:55:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7d89b499-6b4a-4c0e-8207-1159411b3bea tempest-CreateVolumesFromImageTest-727387812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7d89b499-6b4a-4c0e-8207-1159411b3bea tempest-CreateVolumesFromImageTest-727387812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:15 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c240fce4-c879-44c0-acca-8507bab4855e tempest-SnapshotDependencyTests-2128035145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03.6e931250-0e07-400f-84a2-7a05bb491e97" returned: 0 in 0.335s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:15 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:55:15 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c240fce4-c879-44c0-acca-8507bab4855e tempest-SnapshotDependencyTests-2128035145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:15 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03.info Jul 31 10:55:15 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:16 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7d89b499-6b4a-4c0e-8207-1159411b3bea tempest-CreateVolumesFromImageTest-727387812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.406s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:16 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-7d89b499-6b4a-4c0e-8207-1159411b3bea tempest-CreateVolumesFromImageTest-727387812 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:55:16 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-7d89b499-6b4a-4c0e-8207-1159411b3bea tempest-CreateVolumesFromImageTest-727387812 None] Deleted volume successfully. Jul 31 10:55:16 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7d89b499-6b4a-4c0e-8207-1159411b3bea tempest-CreateVolumesFromImageTest-727387812 None] Lock "cinder-7d33c47c-4c65-4c1f-8b2f-87bf85d29a26-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:16 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c240fce4-c879-44c0-acca-8507bab4855e tempest-SnapshotDependencyTests-2128035145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03.info" returned: 0 in 0.410s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:16 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-c240fce4-c879-44c0-acca-8507bab4855e tempest-SnapshotDependencyTests-2128035145 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03.info is being set with open permissions: ugo+rw Jul 31 10:55:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c240fce4-c879-44c0-acca-8507bab4855e tempest-SnapshotDependencyTests-2128035145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:16 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03.info Jul 31 10:55:16 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:16 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c240fce4-c879-44c0-acca-8507bab4855e tempest-SnapshotDependencyTests-2128035145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03.info" returned: 0 in 0.309s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c240fce4-c879-44c0-acca-8507bab4855e tempest-SnapshotDependencyTests-2128035145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.884s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e7c32326-fe9e-4c19-901e-4ea4066237bb tempest-VolumesSnapshotListTestJSON-1057808077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.570s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:16 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-e7c32326-fe9e-4c19-901e-4ea4066237bb tempest-VolumesSnapshotListTestJSON-1057808077 None] Creating offline snapshot 2daabf09-ea9f-4b23-b5ac-8dbd7dc366ba of volume 3b112411-a782-430d-9605-bbfef0a21c84 {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:55:16 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-c240fce4-c879-44c0-acca-8507bab4855e tempest-SnapshotDependencyTests-2128035145 None] Create snapshot completed successfully Jul 31 10:55:16 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d43d4d0-6e0b-4110-bba3-c8aa16880554]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e7c32326-fe9e-4c19-901e-4ea4066237bb tempest-VolumesSnapshotListTestJSON-1057808077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.cbc8c566-7acb-4223-ac6b-7d217c7e53f0 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:16 devstack sudo[105274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.cbc8c566-7acb-4223-ac6b-7d217c7e53f0 Jul 31 10:55:16 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:16 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2b1ad32a-348e-4e49-9a4f-3a2c8ab77695 tempest-CreateVolumesFromImageTest-727387812 None] Acquiring lock "cinder-6b6566ef-6256-4618-8d51-93e1ac5c33f2-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:16 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2b1ad32a-348e-4e49-9a4f-3a2c8ab77695 tempest-CreateVolumesFromImageTest-727387812 None] Lock "cinder-6b6566ef-6256-4618-8d51-93e1ac5c33f2-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:16 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2b1ad32a-348e-4e49-9a4f-3a2c8ab77695 tempest-CreateVolumesFromImageTest-727387812 None] Acquiring lock "cinder-quobyte-6b6566ef-6256-4618-8d51-93e1ac5c33f2" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:16 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2b1ad32a-348e-4e49-9a4f-3a2c8ab77695 tempest-CreateVolumesFromImageTest-727387812 None] Lock "cinder-quobyte-6b6566ef-6256-4618-8d51-93e1ac5c33f2" acquired by "delete_volume" :: waited 0.018s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:16 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca82a959-fb98-4185-8674-08f65b04ceba]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2b1ad32a-348e-4e49-9a4f-3a2c8ab77695 tempest-CreateVolumesFromImageTest-727387812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6b6566ef-6256-4618-8d51-93e1ac5c33f2 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:17 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6b6566ef-6256-4618-8d51-93e1ac5c33f2 Jul 31 10:55:17 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:17 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e7c32326-fe9e-4c19-901e-4ea4066237bb tempest-VolumesSnapshotListTestJSON-1057808077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.cbc8c566-7acb-4223-ac6b-7d217c7e53f0" returned: 0 in 0.645s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:17 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-e7c32326-fe9e-4c19-901e-4ea4066237bb tempest-VolumesSnapshotListTestJSON-1057808077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b112411-a782-430d-9605-bbfef0a21c84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:55:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e7c32326-fe9e-4c19-901e-4ea4066237bb tempest-VolumesSnapshotListTestJSON-1057808077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.cbc8c566-7acb-4223-ac6b-7d217c7e53f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.2daabf09-ea9f-4b23-b5ac-8dbd7dc366ba 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:17 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.cbc8c566-7acb-4223-ac6b-7d217c7e53f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.2daabf09-ea9f-4b23-b5ac-8dbd7dc366ba 1G Jul 31 10:55:17 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:17 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2b1ad32a-348e-4e49-9a4f-3a2c8ab77695 tempest-CreateVolumesFromImageTest-727387812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6b6566ef-6256-4618-8d51-93e1ac5c33f2" returned: 0 in 0.564s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2b1ad32a-348e-4e49-9a4f-3a2c8ab77695 tempest-CreateVolumesFromImageTest-727387812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6b6566ef-6256-4618-8d51-93e1ac5c33f2 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:17 devstack sudo[105287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6b6566ef-6256-4618-8d51-93e1ac5c33f2 Jul 31 10:55:17 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:17 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:55:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Flow 'volume_create_manager' (80838ccf-a2ee-42ed-ace0-8c416788b557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:17 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fafe864d-c28b-452e-a8da-d3971d63c748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2b1ad32a-348e-4e49-9a4f-3a2c8ab77695 tempest-CreateVolumesFromImageTest-727387812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6b6566ef-6256-4618-8d51-93e1ac5c33f2" returned: 0 in 0.379s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:17 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e7c32326-fe9e-4c19-901e-4ea4066237bb tempest-VolumesSnapshotListTestJSON-1057808077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.cbc8c566-7acb-4223-ac6b-7d217c7e53f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.2daabf09-ea9f-4b23-b5ac-8dbd7dc366ba 1G" returned: 0 in 0.691s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e7c32326-fe9e-4c19-901e-4ea4066237bb tempest-VolumesSnapshotListTestJSON-1057808077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b112411-a782-430d-9605-bbfef0a21c84.cbc8c566-7acb-4223-ac6b-7d217c7e53f0 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.2daabf09-ea9f-4b23-b5ac-8dbd7dc366ba {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:17 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2b1ad32a-348e-4e49-9a4f-3a2c8ab77695 tempest-CreateVolumesFromImageTest-727387812 None] Lock "cinder-quobyte-6b6566ef-6256-4618-8d51-93e1ac5c33f2" released by "delete_volume" :: held 1.030s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:17 devstack sudo[105296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b112411-a782-430d-9605-bbfef0a21c84.cbc8c566-7acb-4223-ac6b-7d217c7e53f0 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.2daabf09-ea9f-4b23-b5ac-8dbd7dc366ba Jul 31 10:55:17 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fafe864d-c28b-452e-a8da-d3971d63c748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9188b901-852a-4945-b47d-b140c6a40a9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d9c581d5970485993604db0e31e83dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6e931250-0e07-400f-84a2-7a05bb491e97,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:18Z,use_quota=True,user_id='b6e272f69337443b84f60a89ac85691e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e96fecfc-7ee6-475d-b561-cab2fd0b3c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e96fecfc-7ee6-475d-b561-cab2fd0b3c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9c827a1-180c-4261-b8d6-5feef7622756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9c827a1-180c-4261-b8d6-5feef7622756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9188b901-852a-4945-b47d-b140c6a40a9c', 'volume_name': 'volume-9188b901-852a-4945-b47d-b140c6a40a9c', 'volume_size': 1, 'snapshot_id': '6e931250-0e07-400f-84a2-7a05bb491e97'}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d1d27b6-84b9-44ac-a6a2-48de990225e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d1d27b6-84b9-44ac-a6a2-48de990225e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3291d518-1e97-43e9-8baa-3558ecacb6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:17 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Volume 9188b901-852a-4945-b47d-b140c6a40a9c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9188b901-852a-4945-b47d-b140c6a40a9c', 'volume_size': 1, 'snapshot_id': '6e931250-0e07-400f-84a2-7a05bb491e97'} Jul 31 10:55:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:18 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-2b1ad32a-348e-4e49-9a4f-3a2c8ab77695 tempest-CreateVolumesFromImageTest-727387812 None] Created reservations ['2f505480-e45c-4d4d-aa6a-31678ab688d5', 'ddb903a8-0664-4305-8aec-ef847ca6b1d0', '6f615784-5dc4-4889-a372-5309440878e6', 'ae129f8b-1213-4c60-b182-6ae2cf139d5f'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:55:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2b1ad32a-348e-4e49-9a4f-3a2c8ab77695 tempest-CreateVolumesFromImageTest-727387812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2b1ad32a-348e-4e49-9a4f-3a2c8ab77695 tempest-CreateVolumesFromImageTest-727387812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2b1ad32a-348e-4e49-9a4f-3a2c8ab77695 tempest-CreateVolumesFromImageTest-727387812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:55:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2b1ad32a-348e-4e49-9a4f-3a2c8ab77695 tempest-CreateVolumesFromImageTest-727387812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:55:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2b1ad32a-348e-4e49-9a4f-3a2c8ab77695 tempest-CreateVolumesFromImageTest-727387812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2b1ad32a-348e-4e49-9a4f-3a2c8ab77695 tempest-CreateVolumesFromImageTest-727387812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:18 devstack sudo[105298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:55:18 devstack sudo[105298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:18 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e7c32326-fe9e-4c19-901e-4ea4066237bb tempest-VolumesSnapshotListTestJSON-1057808077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b112411-a782-430d-9605-bbfef0a21c84.cbc8c566-7acb-4223-ac6b-7d217c7e53f0 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.2daabf09-ea9f-4b23-b5ac-8dbd7dc366ba" returned: 0 in 0.401s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:18 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-e7c32326-fe9e-4c19-901e-4ea4066237bb tempest-VolumesSnapshotListTestJSON-1057808077 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.2daabf09-ea9f-4b23-b5ac-8dbd7dc366ba is being set with open permissions: ugo+rw Jul 31 10:55:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e7c32326-fe9e-4c19-901e-4ea4066237bb tempest-VolumesSnapshotListTestJSON-1057808077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.2daabf09-ea9f-4b23-b5ac-8dbd7dc366ba {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:18 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.2daabf09-ea9f-4b23-b5ac-8dbd7dc366ba Jul 31 10:55:18 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:18 devstack sudo[105298]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2b1ad32a-348e-4e49-9a4f-3a2c8ab77695 tempest-CreateVolumesFromImageTest-727387812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.309s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:18 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-2b1ad32a-348e-4e49-9a4f-3a2c8ab77695 tempest-CreateVolumesFromImageTest-727387812 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:55:18 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-2b1ad32a-348e-4e49-9a4f-3a2c8ab77695 tempest-CreateVolumesFromImageTest-727387812 None] Deleted volume successfully. Jul 31 10:55:18 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2b1ad32a-348e-4e49-9a4f-3a2c8ab77695 tempest-CreateVolumesFromImageTest-727387812 None] Lock "cinder-6b6566ef-6256-4618-8d51-93e1ac5c33f2-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:18 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e7c32326-fe9e-4c19-901e-4ea4066237bb tempest-VolumesSnapshotListTestJSON-1057808077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.2daabf09-ea9f-4b23-b5ac-8dbd7dc366ba" returned: 0 in 0.317s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e7c32326-fe9e-4c19-901e-4ea4066237bb tempest-VolumesSnapshotListTestJSON-1057808077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.194s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.673s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:18 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Acquiring lock "cinder-quobyte-6e931250-0e07-400f-84a2-7a05bb491e97-9188b901-852a-4945-b47d-b140c6a40a9c" by "_create_volume_from_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:18 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Lock "cinder-quobyte-6e931250-0e07-400f-84a2-7a05bb491e97-9188b901-852a-4945-b47d-b140c6a40a9c" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Creating volume 9188b901-852a-4945-b47d-b140c6a40a9c from snapshot 6e931250-0e07-400f-84a2-7a05bb491e97 {{(pid=89090) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 10:55:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:55:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:55:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:55:18 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Acquiring lock "cinder-quobyte-9188b901-852a-4945-b47d-b140c6a40a9c" by "_copy_volume_from_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:18 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Lock "cinder-quobyte-9188b901-852a-4945-b47d-b140c6a40a9c" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] snapshot: 6e931250-0e07-400f-84a2-7a05bb491e97, volume: 9188b901-852a-4945-b47d-b140c6a40a9c, {{(pid=89090) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 10:55:18 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-e7c32326-fe9e-4c19-901e-4ea4066237bb tempest-VolumesSnapshotListTestJSON-1057808077 None] Create snapshot completed successfully Jul 31 10:55:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:55:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:55:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:18 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f88fede-9ce8-4e8d-a793-0efc6e521ffa]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03.6e931250-0e07-400f-84a2-7a05bb491e97 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:18 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03.6e931250-0e07-400f-84a2-7a05bb491e97 Jul 31 10:55:18 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:19 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a271860b-6c69-47cd-8e31-c283d116e80f tempest-CreateVolumesFromImageTest-727387812 None] Acquiring lock "cinder-f4b32fc7-58bd-4d95-81cc-28f5e8934a02-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:19 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a271860b-6c69-47cd-8e31-c283d116e80f tempest-CreateVolumesFromImageTest-727387812 None] Lock "cinder-f4b32fc7-58bd-4d95-81cc-28f5e8934a02-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:19 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03.6e931250-0e07-400f-84a2-7a05bb491e97" returned: 0 in 0.490s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:19 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-408b78a5-8f37-417d-9310-a63c47ad4d03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:55:19 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a271860b-6c69-47cd-8e31-c283d116e80f tempest-CreateVolumesFromImageTest-727387812 None] Acquiring lock "cinder-quobyte-f4b32fc7-58bd-4d95-81cc-28f5e8934a02" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:19 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[84be8d9c-d9a1-48a6-9336-92776e190671]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:19 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a271860b-6c69-47cd-8e31-c283d116e80f tempest-CreateVolumesFromImageTest-727387812 None] Lock "cinder-quobyte-f4b32fc7-58bd-4d95-81cc-28f5e8934a02" acquired by "delete_volume" :: waited 0.043s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:19 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[095e82b7-cc17-4678-bae8-bb915def4f7a]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a271860b-6c69-47cd-8e31-c283d116e80f tempest-CreateVolumesFromImageTest-727387812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f4b32fc7-58bd-4d95-81cc-28f5e8934a02 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e26f5748-cbe1-4e85-9832-25addd8a2de9 tempest-VolumesSnapshotListTestJSON-1057808077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:19 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03 Jul 31 10:55:19 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:19 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f4b32fc7-58bd-4d95-81cc-28f5e8934a02 Jul 31 10:55:19 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:19 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03" returned: 0 in 0.484s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:19 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03 {{(pid=89090) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 10:55:19 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Creating direct copy from snapshot {{(pid=89090) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 10:55:19 devstack cinder-volume[89090]: DEBUG cinder.utils [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Path /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9188b901-852a-4945-b47d-b140c6a40a9c not found in is_blk_device check {{(pid=89090) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 10:55:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9188b901-852a-4945-b47d-b140c6a40a9c {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:19 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9188b901-852a-4945-b47d-b140c6a40a9c Jul 31 10:55:19 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:19 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a271860b-6c69-47cd-8e31-c283d116e80f tempest-CreateVolumesFromImageTest-727387812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f4b32fc7-58bd-4d95-81cc-28f5e8934a02" returned: 0 in 0.472s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a271860b-6c69-47cd-8e31-c283d116e80f tempest-CreateVolumesFromImageTest-727387812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f4b32fc7-58bd-4d95-81cc-28f5e8934a02 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:19 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f4b32fc7-58bd-4d95-81cc-28f5e8934a02 Jul 31 10:55:19 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:20 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a271860b-6c69-47cd-8e31-c283d116e80f tempest-CreateVolumesFromImageTest-727387812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f4b32fc7-58bd-4d95-81cc-28f5e8934a02" returned: 0 in 0.307s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:20 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a271860b-6c69-47cd-8e31-c283d116e80f tempest-CreateVolumesFromImageTest-727387812 None] Lock "cinder-quobyte-f4b32fc7-58bd-4d95-81cc-28f5e8934a02" released by "delete_volume" :: held 0.857s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:20 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-a271860b-6c69-47cd-8e31-c283d116e80f tempest-CreateVolumesFromImageTest-727387812 None] Created reservations ['77b73f02-49c6-412e-b454-aeead307cc4d', 'd2cbee34-2591-453b-ae2d-6dde730e520a', '25f18d57-819f-433a-9d6b-2ef9c7d89973', '34810244-f4be-4979-97b4-7498181bee87'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:55:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a271860b-6c69-47cd-8e31-c283d116e80f tempest-CreateVolumesFromImageTest-727387812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a271860b-6c69-47cd-8e31-c283d116e80f tempest-CreateVolumesFromImageTest-727387812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:20 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a271860b-6c69-47cd-8e31-c283d116e80f tempest-CreateVolumesFromImageTest-727387812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:55:20 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a271860b-6c69-47cd-8e31-c283d116e80f tempest-CreateVolumesFromImageTest-727387812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:55:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a271860b-6c69-47cd-8e31-c283d116e80f tempest-CreateVolumesFromImageTest-727387812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a271860b-6c69-47cd-8e31-c283d116e80f tempest-CreateVolumesFromImageTest-727387812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:20 devstack sudo[105337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:55:20 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:21 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a271860b-6c69-47cd-8e31-c283d116e80f tempest-CreateVolumesFromImageTest-727387812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.686s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:21 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-a271860b-6c69-47cd-8e31-c283d116e80f tempest-CreateVolumesFromImageTest-727387812 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:55:21 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-a271860b-6c69-47cd-8e31-c283d116e80f tempest-CreateVolumesFromImageTest-727387812 None] Deleted volume successfully. Jul 31 10:55:21 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a271860b-6c69-47cd-8e31-c283d116e80f tempest-CreateVolumesFromImageTest-727387812 None] Lock "cinder-f4b32fc7-58bd-4d95-81cc-28f5e8934a02-delete_volume" released by "delete_volume" :: held 2.014s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:22 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-6335d214-a0be-4ec6-ace9-913042bfe1d3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:55:23 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6335d214-a0be-4ec6-ace9-913042bfe1d3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Flow 'volume_create_manager' (20a28108-4054-41dc-99e5-5e9260e44324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:23 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6335d214-a0be-4ec6-ace9-913042bfe1d3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53a158d8-2745-4ff6-85f3-2bd876fcaee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:23 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6335d214-a0be-4ec6-ace9-913042bfe1d3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53a158d8-2745-4ff6-85f3-2bd876fcaee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-757838663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5cd813d-b339-429a-b1e7-a352fb0af94d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7907a064637641e0b91c7cad9306dd24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:23Z,use_quota=True,user_id='56c43773ce504261baad25122f910bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:23 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6335d214-a0be-4ec6-ace9-913042bfe1d3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ff235f-6e38-4353-8569-1c7455f208c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:23 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6335d214-a0be-4ec6-ace9-913042bfe1d3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ff235f-6e38-4353-8569-1c7455f208c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:23 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6335d214-a0be-4ec6-ace9-913042bfe1d3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6d90d4-13f5-4c69-8852-4bad2204315b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:23 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6335d214-a0be-4ec6-ace9-913042bfe1d3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6d90d4-13f5-4c69-8852-4bad2204315b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5cd813d-b339-429a-b1e7-a352fb0af94d', 'volume_name': 'volume-e5cd813d-b339-429a-b1e7-a352fb0af94d', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:23 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6335d214-a0be-4ec6-ace9-913042bfe1d3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8f9f550-8b24-4797-b0e3-13f8b624a330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:23 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6335d214-a0be-4ec6-ace9-913042bfe1d3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8f9f550-8b24-4797-b0e3-13f8b624a330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:23 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6335d214-a0be-4ec6-ace9-913042bfe1d3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc5209a-2f42-4179-af5f-4040b7b24688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:23 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-6335d214-a0be-4ec6-ace9-913042bfe1d3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Volume e5cd813d-b339-429a-b1e7-a352fb0af94d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5cd813d-b339-429a-b1e7-a352fb0af94d', 'volume_size': 1} Jul 31 10:55:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6335d214-a0be-4ec6-ace9-913042bfe1d3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:25 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9188b901-852a-4945-b47d-b140c6a40a9c" returned: 0 in 6.008s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:25 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Image conversion details: src /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03, size 1024.00 MB, duration 6.01 sec, destination /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9188b901-852a-4945-b47d-b140c6a40a9c {{(pid=89090) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 10:55:25 devstack cinder-volume[89090]: INFO cinder.image.image_utils [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Converted 1024.00 MB image at 170.41 MB/s Jul 31 10:55:25 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9188b901-852a-4945-b47d-b140c6a40a9c is being set with open permissions: ugo+rw Jul 31 10:55:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9188b901-852a-4945-b47d-b140c6a40a9c {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:25 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9188b901-852a-4945-b47d-b140c6a40a9c Jul 31 10:55:25 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:26 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9188b901-852a-4945-b47d-b140c6a40a9c" returned: 0 in 0.294s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:26 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Lock "cinder-quobyte-9188b901-852a-4945-b47d-b140c6a40a9c" released by "_copy_volume_from_snapshot" :: held 7.398s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:26 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Lock "cinder-quobyte-6e931250-0e07-400f-84a2-7a05bb491e97-9188b901-852a-4945-b47d-b140c6a40a9c" released by "_create_volume_from_snapshot" :: held 7.475s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.508s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e26f5748-cbe1-4e85-9832-25addd8a2de9 tempest-VolumesSnapshotListTestJSON-1057808077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.695s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-e26f5748-cbe1-4e85-9832-25addd8a2de9 tempest-VolumesSnapshotListTestJSON-1057808077 None] Creating offline snapshot 384d9c38-b960-4852-bb41-91399c99d6f1 of volume 3b112411-a782-430d-9605-bbfef0a21c84 {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:55:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3291d518-1e97-43e9-8baa-3558ecacb6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9188b901-852a-4945-b47d-b140c6a40a9c', 'volume_size': 1, 'snapshot_id': '6e931250-0e07-400f-84a2-7a05bb491e97'}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca27b27f-aec0-486d-a223-8b6f42b011c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:26 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[412389f7-cdec-45ce-8f86-7c83ba9dd7af]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e26f5748-cbe1-4e85-9832-25addd8a2de9 tempest-VolumesSnapshotListTestJSON-1057808077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.2daabf09-ea9f-4b23-b5ac-8dbd7dc366ba {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:26 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Volume volume-9188b901-852a-4945-b47d-b140c6a40a9c (9188b901-852a-4945-b47d-b140c6a40a9c): created successfully Jul 31 10:55:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca27b27f-aec0-486d-a223-8b6f42b011c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Flow 'volume_create_manager' (80838ccf-a2ee-42ed-ace0-8c416788b557) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:26 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-ad4aba2f-9218-4f4d-bf02-4e2175470178 tempest-SnapshotDependencyTests-2128035145 None] Created volume successfully. Jul 31 10:55:26 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.2daabf09-ea9f-4b23-b5ac-8dbd7dc366ba Jul 31 10:55:26 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:26 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e26f5748-cbe1-4e85-9832-25addd8a2de9 tempest-VolumesSnapshotListTestJSON-1057808077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.2daabf09-ea9f-4b23-b5ac-8dbd7dc366ba" returned: 0 in 0.433s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-e26f5748-cbe1-4e85-9832-25addd8a2de9 tempest-VolumesSnapshotListTestJSON-1057808077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b112411-a782-430d-9605-bbfef0a21c84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:55:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e26f5748-cbe1-4e85-9832-25addd8a2de9 tempest-VolumesSnapshotListTestJSON-1057808077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.2daabf09-ea9f-4b23-b5ac-8dbd7dc366ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.384d9c38-b960-4852-bb41-91399c99d6f1 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:26 devstack sudo[105350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.2daabf09-ea9f-4b23-b5ac-8dbd7dc366ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.384d9c38-b960-4852-bb41-91399c99d6f1 1G Jul 31 10:55:26 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:26 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e2536770-37a0-423a-bf65-677889958937 tempest-SnapshotDependencyTests-2128035145 None] Acquiring lock "cinder-6e931250-0e07-400f-84a2-7a05bb491e97-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:26 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e2536770-37a0-423a-bf65-677889958937 tempest-SnapshotDependencyTests-2128035145 None] Lock "cinder-6e931250-0e07-400f-84a2-7a05bb491e97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:26 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e2536770-37a0-423a-bf65-677889958937 tempest-SnapshotDependencyTests-2128035145 None] Acquiring lock "cinder-quobyte-408b78a5-8f37-417d-9310-a63c47ad4d03" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:26 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e2536770-37a0-423a-bf65-677889958937 tempest-SnapshotDependencyTests-2128035145 None] Lock "cinder-quobyte-408b78a5-8f37-417d-9310-a63c47ad4d03" acquired by "delete_snapshot" :: waited 0.035s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:26 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e2536770-37a0-423a-bf65-677889958937 tempest-SnapshotDependencyTests-2128035145 None] Acquiring lock "cinder-quobyte-6e931250-0e07-400f-84a2-7a05bb491e97" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:26 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e2536770-37a0-423a-bf65-677889958937 tempest-SnapshotDependencyTests-2128035145 None] Lock "cinder-quobyte-6e931250-0e07-400f-84a2-7a05bb491e97" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-e2536770-37a0-423a-bf65-677889958937 tempest-SnapshotDependencyTests-2128035145 None] Deleting offline snapshot 6e931250-0e07-400f-84a2-7a05bb491e97 of volume 408b78a5-8f37-417d-9310-a63c47ad4d03 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:55:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-e2536770-37a0-423a-bf65-677889958937 tempest-SnapshotDependencyTests-2128035145 None] snapshot_file for this snap is: volume-408b78a5-8f37-417d-9310-a63c47ad4d03.6e931250-0e07-400f-84a2-7a05bb491e97 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:55:26 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b48ee09-c2ba-4230-966d-6ee0fd509a03]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e2536770-37a0-423a-bf65-677889958937 tempest-SnapshotDependencyTests-2128035145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03.6e931250-0e07-400f-84a2-7a05bb491e97 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:26 devstack sudo[105352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03.6e931250-0e07-400f-84a2-7a05bb491e97 Jul 31 10:55:26 devstack sudo[105352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:27 devstack sudo[105352]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:27 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e2536770-37a0-423a-bf65-677889958937 tempest-SnapshotDependencyTests-2128035145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03.6e931250-0e07-400f-84a2-7a05bb491e97" returned: 0 in 0.429s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:27 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-e2536770-37a0-423a-bf65-677889958937 tempest-SnapshotDependencyTests-2128035145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-408b78a5-8f37-417d-9310-a63c47ad4d03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:55:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e26f5748-cbe1-4e85-9832-25addd8a2de9 tempest-VolumesSnapshotListTestJSON-1057808077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.2daabf09-ea9f-4b23-b5ac-8dbd7dc366ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.384d9c38-b960-4852-bb41-91399c99d6f1 1G" returned: 0 in 0.615s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e26f5748-cbe1-4e85-9832-25addd8a2de9 tempest-VolumesSnapshotListTestJSON-1057808077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b112411-a782-430d-9605-bbfef0a21c84.2daabf09-ea9f-4b23-b5ac-8dbd7dc366ba -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.384d9c38-b960-4852-bb41-91399c99d6f1 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:27 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6b9825-11a6-483d-9719-d0571da6f2dd]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e2536770-37a0-423a-bf65-677889958937 tempest-SnapshotDependencyTests-2128035145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:27 devstack sudo[105362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b112411-a782-430d-9605-bbfef0a21c84.2daabf09-ea9f-4b23-b5ac-8dbd7dc366ba -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.384d9c38-b960-4852-bb41-91399c99d6f1 Jul 31 10:55:27 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:27 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03 Jul 31 10:55:27 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:27 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e26f5748-cbe1-4e85-9832-25addd8a2de9 tempest-VolumesSnapshotListTestJSON-1057808077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b112411-a782-430d-9605-bbfef0a21c84.2daabf09-ea9f-4b23-b5ac-8dbd7dc366ba -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.384d9c38-b960-4852-bb41-91399c99d6f1" returned: 0 in 0.323s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:27 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-e26f5748-cbe1-4e85-9832-25addd8a2de9 tempest-VolumesSnapshotListTestJSON-1057808077 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.384d9c38-b960-4852-bb41-91399c99d6f1 is being set with open permissions: ugo+rw Jul 31 10:55:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e26f5748-cbe1-4e85-9832-25addd8a2de9 tempest-VolumesSnapshotListTestJSON-1057808077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.384d9c38-b960-4852-bb41-91399c99d6f1 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:27 devstack sudo[105369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.384d9c38-b960-4852-bb41-91399c99d6f1 Jul 31 10:55:27 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:27 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e2536770-37a0-423a-bf65-677889958937 tempest-SnapshotDependencyTests-2128035145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03" returned: 0 in 0.614s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e2536770-37a0-423a-bf65-677889958937 tempest-SnapshotDependencyTests-2128035145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03.6e931250-0e07-400f-84a2-7a05bb491e97 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:27 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e26f5748-cbe1-4e85-9832-25addd8a2de9 tempest-VolumesSnapshotListTestJSON-1057808077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.384d9c38-b960-4852-bb41-91399c99d6f1" returned: 0 in 0.320s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:27 devstack sudo[105376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03.6e931250-0e07-400f-84a2-7a05bb491e97 Jul 31 10:55:27 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e26f5748-cbe1-4e85-9832-25addd8a2de9 tempest-VolumesSnapshotListTestJSON-1057808077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.828s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6335d214-a0be-4ec6-ace9-913042bfe1d3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.803s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:27 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-6335d214-a0be-4ec6-ace9-913042bfe1d3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-757838663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5cd813d-b339-429a-b1e7-a352fb0af94d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7907a064637641e0b91c7cad9306dd24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:23Z,use_quota=True,user_id='56c43773ce504261baad25122f910bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:55:27 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-6335d214-a0be-4ec6-ace9-913042bfe1d3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Creating volume e5cd813d-b339-429a-b1e7-a352fb0af94d {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:55:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6335d214-a0be-4ec6-ace9-913042bfe1d3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6335d214-a0be-4ec6-ace9-913042bfe1d3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:27 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-6335d214-a0be-4ec6-ace9-913042bfe1d3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:55:27 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-6335d214-a0be-4ec6-ace9-913042bfe1d3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:55:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6335d214-a0be-4ec6-ace9-913042bfe1d3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:27 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-6335d214-a0be-4ec6-ace9-913042bfe1d3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:55:27 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-6335d214-a0be-4ec6-ace9-913042bfe1d3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:55:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6335d214-a0be-4ec6-ace9-913042bfe1d3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:28 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d 1073741824 Jul 31 10:55:28 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:28 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-e26f5748-cbe1-4e85-9832-25addd8a2de9 tempest-VolumesSnapshotListTestJSON-1057808077 None] Create snapshot completed successfully Jul 31 10:55:28 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-620edfe5-341d-4994-b271-afe12d143dc6 tempest-ProjectReaderTests-1161097642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:55:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-620edfe5-341d-4994-b271-afe12d143dc6 tempest-ProjectReaderTests-1161097642 None] Flow 'volume_create_manager' (892220fc-cb59-47a4-be3e-07e7ee328e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-620edfe5-341d-4994-b271-afe12d143dc6 tempest-ProjectReaderTests-1161097642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b794e67-f1cc-410f-a4c9-2efcdaafc0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-620edfe5-341d-4994-b271-afe12d143dc6 tempest-ProjectReaderTests-1161097642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b794e67-f1cc-410f-a4c9-2efcdaafc0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-688445781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4352b40f-b8b1-480e-a8d0-63403b6811b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a1a57295c554d179ecfe1c2639d06e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:28Z,use_quota=True,user_id='3575ad7bd5b7401abab68b71217af415',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-620edfe5-341d-4994-b271-afe12d143dc6 tempest-ProjectReaderTests-1161097642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41be7edf-9685-4d62-a887-c4d73e384564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-620edfe5-341d-4994-b271-afe12d143dc6 tempest-ProjectReaderTests-1161097642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41be7edf-9685-4d62-a887-c4d73e384564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-620edfe5-341d-4994-b271-afe12d143dc6 tempest-ProjectReaderTests-1161097642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (910b3982-860d-400b-8794-5a2c02ddf596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-620edfe5-341d-4994-b271-afe12d143dc6 tempest-ProjectReaderTests-1161097642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (910b3982-860d-400b-8794-5a2c02ddf596) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4352b40f-b8b1-480e-a8d0-63403b6811b6', 'volume_name': 'volume-4352b40f-b8b1-480e-a8d0-63403b6811b6', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-620edfe5-341d-4994-b271-afe12d143dc6 tempest-ProjectReaderTests-1161097642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c0b6b22-0104-44b7-a6a0-8d5346b8be1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-620edfe5-341d-4994-b271-afe12d143dc6 tempest-ProjectReaderTests-1161097642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c0b6b22-0104-44b7-a6a0-8d5346b8be1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:28 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-620edfe5-341d-4994-b271-afe12d143dc6 tempest-ProjectReaderTests-1161097642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67e22641-c7d0-49b9-aa50-f0ca0e5219cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:28 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-620edfe5-341d-4994-b271-afe12d143dc6 tempest-ProjectReaderTests-1161097642 None] Volume 4352b40f-b8b1-480e-a8d0-63403b6811b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4352b40f-b8b1-480e-a8d0-63403b6811b6', 'volume_size': 1} Jul 31 10:55:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-620edfe5-341d-4994-b271-afe12d143dc6 tempest-ProjectReaderTests-1161097642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e2536770-37a0-423a-bf65-677889958937 tempest-SnapshotDependencyTests-2128035145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03.6e931250-0e07-400f-84a2-7a05bb491e97" returned: 0 in 0.455s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e2536770-37a0-423a-bf65-677889958937 tempest-SnapshotDependencyTests-2128035145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03.6e931250-0e07-400f-84a2-7a05bb491e97 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:28 devstack sudo[105387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03.6e931250-0e07-400f-84a2-7a05bb491e97 Jul 31 10:55:28 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:28 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6335d214-a0be-4ec6-ace9-913042bfe1d3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d 1073741824" returned: 0 in 0.532s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6335d214-a0be-4ec6-ace9-913042bfe1d3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:28 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d Jul 31 10:55:28 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:28 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e2536770-37a0-423a-bf65-677889958937 tempest-SnapshotDependencyTests-2128035145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03.6e931250-0e07-400f-84a2-7a05bb491e97" returned: 0 in 0.284s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:28 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e2536770-37a0-423a-bf65-677889958937 tempest-SnapshotDependencyTests-2128035145 None] Lock "cinder-quobyte-6e931250-0e07-400f-84a2-7a05bb491e97" released by "_delete_snapshot" :: held 1.900s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:28 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e2536770-37a0-423a-bf65-677889958937 tempest-SnapshotDependencyTests-2128035145 None] Lock "cinder-quobyte-408b78a5-8f37-417d-9310-a63c47ad4d03" released by "delete_snapshot" :: held 1.928s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:28 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-e2536770-37a0-423a-bf65-677889958937 tempest-SnapshotDependencyTests-2128035145 None] Created reservations ['517afb78-8ed3-4073-86b6-604510bfdad6', 'a5738b50-6f96-4de8-904f-3ab6e6c90611', '9bdc3629-4696-433a-9ed2-457019061941', '9162a159-4737-4e1c-aea6-8da0ad9a41ac'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:55:28 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-e2536770-37a0-423a-bf65-677889958937 tempest-SnapshotDependencyTests-2128035145 None] Delete snapshot completed successfully. Jul 31 10:55:28 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e2536770-37a0-423a-bf65-677889958937 tempest-SnapshotDependencyTests-2128035145 None] Lock "cinder-6e931250-0e07-400f-84a2-7a05bb491e97-delete_snapshot" released by "delete_snapshot" :: held 2.091s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:28 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6335d214-a0be-4ec6-ace9-913042bfe1d3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d" returned: 0 in 0.308s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:28 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-6335d214-a0be-4ec6-ace9-913042bfe1d3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:55:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6335d214-a0be-4ec6-ace9-913042bfe1d3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-620edfe5-341d-4994-b271-afe12d143dc6 tempest-ProjectReaderTests-1161097642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.524s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:28 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-620edfe5-341d-4994-b271-afe12d143dc6 tempest-ProjectReaderTests-1161097642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-688445781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4352b40f-b8b1-480e-a8d0-63403b6811b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a1a57295c554d179ecfe1c2639d06e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:28Z,use_quota=True,user_id='3575ad7bd5b7401abab68b71217af415',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:55:28 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-620edfe5-341d-4994-b271-afe12d143dc6 tempest-ProjectReaderTests-1161097642 None] Creating volume 4352b40f-b8b1-480e-a8d0-63403b6811b6 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:55:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-620edfe5-341d-4994-b271-afe12d143dc6 tempest-ProjectReaderTests-1161097642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-620edfe5-341d-4994-b271-afe12d143dc6 tempest-ProjectReaderTests-1161097642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:28 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-620edfe5-341d-4994-b271-afe12d143dc6 tempest-ProjectReaderTests-1161097642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:55:28 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-620edfe5-341d-4994-b271-afe12d143dc6 tempest-ProjectReaderTests-1161097642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:55:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-620edfe5-341d-4994-b271-afe12d143dc6 tempest-ProjectReaderTests-1161097642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:28 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-620edfe5-341d-4994-b271-afe12d143dc6 tempest-ProjectReaderTests-1161097642 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:55:28 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-620edfe5-341d-4994-b271-afe12d143dc6 tempest-ProjectReaderTests-1161097642 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:55:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-620edfe5-341d-4994-b271-afe12d143dc6 tempest-ProjectReaderTests-1161097642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4352b40f-b8b1-480e-a8d0-63403b6811b6 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6335d214-a0be-4ec6-ace9-913042bfe1d3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc5209a-2f42-4179-af5f-4040b7b24688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5cd813d-b339-429a-b1e7-a352fb0af94d', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:28 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4352b40f-b8b1-480e-a8d0-63403b6811b6 1073741824 Jul 31 10:55:28 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6335d214-a0be-4ec6-ace9-913042bfe1d3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e815a30f-1aab-4c49-8dd8-807555df905c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:28 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-aae66f3c-d0b3-487b-825b-21852c506a27 tempest-SnapshotDependencyTests-2128035145 None] Acquiring lock "cinder-408b78a5-8f37-417d-9310-a63c47ad4d03-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:28 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-6335d214-a0be-4ec6-ace9-913042bfe1d3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Volume volume-e5cd813d-b339-429a-b1e7-a352fb0af94d (e5cd813d-b339-429a-b1e7-a352fb0af94d): created successfully Jul 31 10:55:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6335d214-a0be-4ec6-ace9-913042bfe1d3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e815a30f-1aab-4c49-8dd8-807555df905c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-6335d214-a0be-4ec6-ace9-913042bfe1d3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Flow 'volume_create_manager' (20a28108-4054-41dc-99e5-5e9260e44324) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:28 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-aae66f3c-d0b3-487b-825b-21852c506a27 tempest-SnapshotDependencyTests-2128035145 None] Lock "cinder-408b78a5-8f37-417d-9310-a63c47ad4d03-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:28 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-6335d214-a0be-4ec6-ace9-913042bfe1d3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Created volume successfully. Jul 31 10:55:29 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-aae66f3c-d0b3-487b-825b-21852c506a27 tempest-SnapshotDependencyTests-2128035145 None] Acquiring lock "cinder-quobyte-408b78a5-8f37-417d-9310-a63c47ad4d03" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:29 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-aae66f3c-d0b3-487b-825b-21852c506a27 tempest-SnapshotDependencyTests-2128035145 None] Lock "cinder-quobyte-408b78a5-8f37-417d-9310-a63c47ad4d03" acquired by "delete_volume" :: waited 0.021s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:29 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76d538d-c214-4bb7-8665-2a5cab58210f]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-aae66f3c-d0b3-487b-825b-21852c506a27 tempest-SnapshotDependencyTests-2128035145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:29 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03 Jul 31 10:55:29 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:29 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-620edfe5-341d-4994-b271-afe12d143dc6 tempest-ProjectReaderTests-1161097642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4352b40f-b8b1-480e-a8d0-63403b6811b6 1073741824" returned: 0 in 0.634s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-620edfe5-341d-4994-b271-afe12d143dc6 tempest-ProjectReaderTests-1161097642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4352b40f-b8b1-480e-a8d0-63403b6811b6 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:29 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4352b40f-b8b1-480e-a8d0-63403b6811b6 Jul 31 10:55:29 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:29 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-aae66f3c-d0b3-487b-825b-21852c506a27 tempest-SnapshotDependencyTests-2128035145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03" returned: 0 in 0.534s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-aae66f3c-d0b3-487b-825b-21852c506a27 tempest-SnapshotDependencyTests-2128035145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:29 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03 Jul 31 10:55:29 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:29 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-620edfe5-341d-4994-b271-afe12d143dc6 tempest-ProjectReaderTests-1161097642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4352b40f-b8b1-480e-a8d0-63403b6811b6" returned: 0 in 0.370s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:29 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-620edfe5-341d-4994-b271-afe12d143dc6 tempest-ProjectReaderTests-1161097642 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:55:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-620edfe5-341d-4994-b271-afe12d143dc6 tempest-ProjectReaderTests-1161097642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-620edfe5-341d-4994-b271-afe12d143dc6 tempest-ProjectReaderTests-1161097642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67e22641-c7d0-49b9-aa50-f0ca0e5219cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4352b40f-b8b1-480e-a8d0-63403b6811b6', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-620edfe5-341d-4994-b271-afe12d143dc6 tempest-ProjectReaderTests-1161097642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c93dc1e-7127-4648-858c-2bf19d6e3646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:30 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-620edfe5-341d-4994-b271-afe12d143dc6 tempest-ProjectReaderTests-1161097642 None] Volume volume-4352b40f-b8b1-480e-a8d0-63403b6811b6 (4352b40f-b8b1-480e-a8d0-63403b6811b6): created successfully Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-620edfe5-341d-4994-b271-afe12d143dc6 tempest-ProjectReaderTests-1161097642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c93dc1e-7127-4648-858c-2bf19d6e3646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-620edfe5-341d-4994-b271-afe12d143dc6 tempest-ProjectReaderTests-1161097642 None] Flow 'volume_create_manager' (892220fc-cb59-47a4-be3e-07e7ee328e3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-eaf6de71-4139-4444-aa63-b00d7c3ff060 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-eaf6de71-4139-4444-aa63-b00d7c3ff060 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:30 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:30 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-620edfe5-341d-4994-b271-afe12d143dc6 tempest-ProjectReaderTests-1161097642 None] Created volume successfully. Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-aae66f3c-d0b3-487b-825b-21852c506a27 tempest-SnapshotDependencyTests-2128035145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-408b78a5-8f37-417d-9310-a63c47ad4d03" returned: 0 in 0.444s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-eaf6de71-4139-4444-aa63-b00d7c3ff060 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Creating offline snapshot f4f832b3-364e-4e6b-a2bb-d7cac217054f of volume e5cd813d-b339-429a-b1e7-a352fb0af94d {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-aae66f3c-d0b3-487b-825b-21852c506a27 tempest-SnapshotDependencyTests-2128035145 None] Lock "cinder-quobyte-408b78a5-8f37-417d-9310-a63c47ad4d03" released by "delete_volume" :: held 1.088s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb439a4-7f3d-4d7a-9214-83597c6542fa]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-eaf6de71-4139-4444-aa63-b00d7c3ff060 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1698343a-cd2f-4f63-8e3a-1cf36cd8be3a tempest-VolumesSnapshotListTestJSON-1057808077 None] Acquiring lock "cinder-384d9c38-b960-4852-bb41-91399c99d6f1-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1698343a-cd2f-4f63-8e3a-1cf36cd8be3a tempest-VolumesSnapshotListTestJSON-1057808077 None] Lock "cinder-384d9c38-b960-4852-bb41-91399c99d6f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1698343a-cd2f-4f63-8e3a-1cf36cd8be3a tempest-VolumesSnapshotListTestJSON-1057808077 None] Acquiring lock "cinder-quobyte-3b112411-a782-430d-9605-bbfef0a21c84" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-aae66f3c-d0b3-487b-825b-21852c506a27 tempest-SnapshotDependencyTests-2128035145 None] Created reservations ['c7e3e36d-189f-4d05-9a89-8f5eb5f5bd6a', '04b77017-55a6-42d7-84ef-0bce1661db8a', 'd688ec62-70a1-4a52-b56e-0b7abf8c1b42', '32bcaf5c-2fe5-4367-aced-32b04342a224'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1698343a-cd2f-4f63-8e3a-1cf36cd8be3a tempest-VolumesSnapshotListTestJSON-1057808077 None] Lock "cinder-quobyte-3b112411-a782-430d-9605-bbfef0a21c84" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1698343a-cd2f-4f63-8e3a-1cf36cd8be3a tempest-VolumesSnapshotListTestJSON-1057808077 None] Acquiring lock "cinder-quobyte-384d9c38-b960-4852-bb41-91399c99d6f1" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1698343a-cd2f-4f63-8e3a-1cf36cd8be3a tempest-VolumesSnapshotListTestJSON-1057808077 None] Lock "cinder-quobyte-384d9c38-b960-4852-bb41-91399c99d6f1" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-1698343a-cd2f-4f63-8e3a-1cf36cd8be3a tempest-VolumesSnapshotListTestJSON-1057808077 None] Deleting offline snapshot 384d9c38-b960-4852-bb41-91399c99d6f1 of volume 3b112411-a782-430d-9605-bbfef0a21c84 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:55:30 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d Jul 31 10:55:30 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-1698343a-cd2f-4f63-8e3a-1cf36cd8be3a tempest-VolumesSnapshotListTestJSON-1057808077 None] snapshot_file for this snap is: volume-3b112411-a782-430d-9605-bbfef0a21c84.384d9c38-b960-4852-bb41-91399c99d6f1 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[74244749-d131-4bf5-9d8a-8c806c1be9e6]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1698343a-cd2f-4f63-8e3a-1cf36cd8be3a tempest-VolumesSnapshotListTestJSON-1057808077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.384d9c38-b960-4852-bb41-91399c99d6f1 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-aae66f3c-d0b3-487b-825b-21852c506a27 tempest-SnapshotDependencyTests-2128035145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-aae66f3c-d0b3-487b-825b-21852c506a27 tempest-SnapshotDependencyTests-2128035145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-aae66f3c-d0b3-487b-825b-21852c506a27 tempest-SnapshotDependencyTests-2128035145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-aae66f3c-d0b3-487b-825b-21852c506a27 tempest-SnapshotDependencyTests-2128035145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-aae66f3c-d0b3-487b-825b-21852c506a27 tempest-SnapshotDependencyTests-2128035145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-aae66f3c-d0b3-487b-825b-21852c506a27 tempest-SnapshotDependencyTests-2128035145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:30 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:55:30 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:30 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.384d9c38-b960-4852-bb41-91399c99d6f1 Jul 31 10:55:30 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-13468efe-1174-4338-add3-d982a66d6ff8 tempest-ProjectReaderTests-1161097642 None] Acquiring lock "cinder-4352b40f-b8b1-480e-a8d0-63403b6811b6-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:30 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-eaf6de71-4139-4444-aa63-b00d7c3ff060 tempest-CreateVolumesFromSnapshotTest-1820093262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d" returned: 0 in 0.490s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-eaf6de71-4139-4444-aa63-b00d7c3ff060 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d.f4f832b3-364e-4e6b-a2bb-d7cac217054f 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-13468efe-1174-4338-add3-d982a66d6ff8 tempest-ProjectReaderTests-1161097642 None] Lock "cinder-4352b40f-b8b1-480e-a8d0-63403b6811b6-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:30 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d.f4f832b3-364e-4e6b-a2bb-d7cac217054f 1G Jul 31 10:55:30 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-13468efe-1174-4338-add3-d982a66d6ff8 tempest-ProjectReaderTests-1161097642 None] Acquiring lock "cinder-quobyte-4352b40f-b8b1-480e-a8d0-63403b6811b6" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-13468efe-1174-4338-add3-d982a66d6ff8 tempest-ProjectReaderTests-1161097642 None] Lock "cinder-quobyte-4352b40f-b8b1-480e-a8d0-63403b6811b6" acquired by "delete_volume" :: waited 0.020s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[552f1930-c9a7-4502-895f-f9f148e4e090]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-13468efe-1174-4338-add3-d982a66d6ff8 tempest-ProjectReaderTests-1161097642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4352b40f-b8b1-480e-a8d0-63403b6811b6 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:30 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-aae66f3c-d0b3-487b-825b-21852c506a27 tempest-SnapshotDependencyTests-2128035145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.372s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-aae66f3c-d0b3-487b-825b-21852c506a27 tempest-SnapshotDependencyTests-2128035145 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:55:30 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-aae66f3c-d0b3-487b-825b-21852c506a27 tempest-SnapshotDependencyTests-2128035145 None] Deleted volume successfully. Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-aae66f3c-d0b3-487b-825b-21852c506a27 tempest-SnapshotDependencyTests-2128035145 None] Lock "cinder-408b78a5-8f37-417d-9310-a63c47ad4d03-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:30 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1698343a-cd2f-4f63-8e3a-1cf36cd8be3a tempest-VolumesSnapshotListTestJSON-1057808077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.384d9c38-b960-4852-bb41-91399c99d6f1" returned: 0 in 0.546s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-1698343a-cd2f-4f63-8e3a-1cf36cd8be3a tempest-VolumesSnapshotListTestJSON-1057808077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b112411-a782-430d-9605-bbfef0a21c84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:55:30 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4352b40f-b8b1-480e-a8d0-63403b6811b6 Jul 31 10:55:30 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c97b82b-40b8-414f-b817-4e3703e50de5]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1698343a-cd2f-4f63-8e3a-1cf36cd8be3a tempest-VolumesSnapshotListTestJSON-1057808077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.2daabf09-ea9f-4b23-b5ac-8dbd7dc366ba {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:31 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.2daabf09-ea9f-4b23-b5ac-8dbd7dc366ba Jul 31 10:55:31 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:31 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-eaf6de71-4139-4444-aa63-b00d7c3ff060 tempest-CreateVolumesFromSnapshotTest-1820093262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d.f4f832b3-364e-4e6b-a2bb-d7cac217054f 1G" returned: 0 in 0.593s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-eaf6de71-4139-4444-aa63-b00d7c3ff060 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5cd813d-b339-429a-b1e7-a352fb0af94d -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d.f4f832b3-364e-4e6b-a2bb-d7cac217054f {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:31 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5cd813d-b339-429a-b1e7-a352fb0af94d -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d.f4f832b3-364e-4e6b-a2bb-d7cac217054f Jul 31 10:55:31 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6f146e90-7481-4114-922e-9d9763e88096 tempest-SnapshotDependencyTests-2128035145 None] Acquiring lock "cinder-9188b901-852a-4945-b47d-b140c6a40a9c-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:31 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:31 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6f146e90-7481-4114-922e-9d9763e88096 tempest-SnapshotDependencyTests-2128035145 None] Lock "cinder-9188b901-852a-4945-b47d-b140c6a40a9c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:31 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-13468efe-1174-4338-add3-d982a66d6ff8 tempest-ProjectReaderTests-1161097642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4352b40f-b8b1-480e-a8d0-63403b6811b6" returned: 0 in 0.552s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-13468efe-1174-4338-add3-d982a66d6ff8 tempest-ProjectReaderTests-1161097642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4352b40f-b8b1-480e-a8d0-63403b6811b6 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:31 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4352b40f-b8b1-480e-a8d0-63403b6811b6 Jul 31 10:55:31 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:31 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6f146e90-7481-4114-922e-9d9763e88096 tempest-SnapshotDependencyTests-2128035145 None] Acquiring lock "cinder-quobyte-9188b901-852a-4945-b47d-b140c6a40a9c" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:31 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6f146e90-7481-4114-922e-9d9763e88096 tempest-SnapshotDependencyTests-2128035145 None] Lock "cinder-quobyte-9188b901-852a-4945-b47d-b140c6a40a9c" acquired by "delete_volume" :: waited 0.025s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:31 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[e668d3f2-46ff-42e6-bd77-98bc8d7f7dcd]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6f146e90-7481-4114-922e-9d9763e88096 tempest-SnapshotDependencyTests-2128035145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9188b901-852a-4945-b47d-b140c6a40a9c {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:31 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1698343a-cd2f-4f63-8e3a-1cf36cd8be3a tempest-VolumesSnapshotListTestJSON-1057808077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.2daabf09-ea9f-4b23-b5ac-8dbd7dc366ba" returned: 0 in 0.549s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:31 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-1698343a-cd2f-4f63-8e3a-1cf36cd8be3a tempest-VolumesSnapshotListTestJSON-1057808077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b112411-a782-430d-9605-bbfef0a21c84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:55:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1698343a-cd2f-4f63-8e3a-1cf36cd8be3a tempest-VolumesSnapshotListTestJSON-1057808077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.384d9c38-b960-4852-bb41-91399c99d6f1 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:31 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.384d9c38-b960-4852-bb41-91399c99d6f1 Jul 31 10:55:31 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:31 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9188b901-852a-4945-b47d-b140c6a40a9c Jul 31 10:55:31 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:31 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-eaf6de71-4139-4444-aa63-b00d7c3ff060 tempest-CreateVolumesFromSnapshotTest-1820093262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5cd813d-b339-429a-b1e7-a352fb0af94d -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d.f4f832b3-364e-4e6b-a2bb-d7cac217054f" returned: 0 in 0.435s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:31 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-eaf6de71-4139-4444-aa63-b00d7c3ff060 tempest-CreateVolumesFromSnapshotTest-1820093262 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d.f4f832b3-364e-4e6b-a2bb-d7cac217054f is being set with open permissions: ugo+rw Jul 31 10:55:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-eaf6de71-4139-4444-aa63-b00d7c3ff060 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d.f4f832b3-364e-4e6b-a2bb-d7cac217054f {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:31 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-13468efe-1174-4338-add3-d982a66d6ff8 tempest-ProjectReaderTests-1161097642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4352b40f-b8b1-480e-a8d0-63403b6811b6" returned: 0 in 0.368s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:31 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d.f4f832b3-364e-4e6b-a2bb-d7cac217054f Jul 31 10:55:31 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:31 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-13468efe-1174-4338-add3-d982a66d6ff8 tempest-ProjectReaderTests-1161097642 None] Lock "cinder-quobyte-4352b40f-b8b1-480e-a8d0-63403b6811b6" released by "delete_volume" :: held 0.994s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:31 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-13468efe-1174-4338-add3-d982a66d6ff8 tempest-ProjectReaderTests-1161097642 None] Created reservations ['289e3671-aa0a-4e11-bb3c-362eb7b17709', '8cf88add-1fbc-4b28-8c55-7af51c17236a', '4890eddf-9c2d-47c5-a879-448659eac0dc', '3b0f4653-716a-4333-92d2-fe05c6949c27'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:55:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-13468efe-1174-4338-add3-d982a66d6ff8 tempest-ProjectReaderTests-1161097642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-13468efe-1174-4338-add3-d982a66d6ff8 tempest-ProjectReaderTests-1161097642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:31 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-13468efe-1174-4338-add3-d982a66d6ff8 tempest-ProjectReaderTests-1161097642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:55:31 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-13468efe-1174-4338-add3-d982a66d6ff8 tempest-ProjectReaderTests-1161097642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:55:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-13468efe-1174-4338-add3-d982a66d6ff8 tempest-ProjectReaderTests-1161097642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-13468efe-1174-4338-add3-d982a66d6ff8 tempest-ProjectReaderTests-1161097642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:31 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:31 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:55:31 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6f146e90-7481-4114-922e-9d9763e88096 tempest-SnapshotDependencyTests-2128035145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9188b901-852a-4945-b47d-b140c6a40a9c" returned: 0 in 0.524s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6f146e90-7481-4114-922e-9d9763e88096 tempest-SnapshotDependencyTests-2128035145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9188b901-852a-4945-b47d-b140c6a40a9c {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:31 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-eaf6de71-4139-4444-aa63-b00d7c3ff060 tempest-CreateVolumesFromSnapshotTest-1820093262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d.f4f832b3-364e-4e6b-a2bb-d7cac217054f" returned: 0 in 0.311s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:32 devstack sudo[105465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9188b901-852a-4945-b47d-b140c6a40a9c Jul 31 10:55:32 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-eaf6de71-4139-4444-aa63-b00d7c3ff060 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:32 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d.info Jul 31 10:55:32 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:32 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1698343a-cd2f-4f63-8e3a-1cf36cd8be3a tempest-VolumesSnapshotListTestJSON-1057808077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.384d9c38-b960-4852-bb41-91399c99d6f1" returned: 0 in 0.621s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1698343a-cd2f-4f63-8e3a-1cf36cd8be3a tempest-VolumesSnapshotListTestJSON-1057808077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.384d9c38-b960-4852-bb41-91399c99d6f1 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:32 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.384d9c38-b960-4852-bb41-91399c99d6f1 Jul 31 10:55:32 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:32 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-13468efe-1174-4338-add3-d982a66d6ff8 tempest-ProjectReaderTests-1161097642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.332s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:32 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-13468efe-1174-4338-add3-d982a66d6ff8 tempest-ProjectReaderTests-1161097642 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:55:32 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-13468efe-1174-4338-add3-d982a66d6ff8 tempest-ProjectReaderTests-1161097642 None] Deleted volume successfully. Jul 31 10:55:32 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6f146e90-7481-4114-922e-9d9763e88096 tempest-SnapshotDependencyTests-2128035145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9188b901-852a-4945-b47d-b140c6a40a9c" returned: 0 in 0.342s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:32 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-13468efe-1174-4338-add3-d982a66d6ff8 tempest-ProjectReaderTests-1161097642 None] Lock "cinder-4352b40f-b8b1-480e-a8d0-63403b6811b6-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:32 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6f146e90-7481-4114-922e-9d9763e88096 tempest-SnapshotDependencyTests-2128035145 None] Lock "cinder-quobyte-9188b901-852a-4945-b47d-b140c6a40a9c" released by "delete_volume" :: held 0.926s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:32 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-6f146e90-7481-4114-922e-9d9763e88096 tempest-SnapshotDependencyTests-2128035145 None] Created reservations ['4bb2628f-2361-4caf-8890-041d6d23f8f3', 'f771800b-3e47-436f-897b-cb7c7b78d75f', '299eb731-e805-4808-affa-1bc573e93469', '71294108-6fd2-4b05-bd1b-94168b65806d'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:55:32 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-eaf6de71-4139-4444-aa63-b00d7c3ff060 tempest-CreateVolumesFromSnapshotTest-1820093262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d.info" returned: 0 in 0.353s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:32 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-eaf6de71-4139-4444-aa63-b00d7c3ff060 tempest-CreateVolumesFromSnapshotTest-1820093262 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d.info is being set with open permissions: ugo+rw Jul 31 10:55:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-eaf6de71-4139-4444-aa63-b00d7c3ff060 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:32 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d.info Jul 31 10:55:32 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:32 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1698343a-cd2f-4f63-8e3a-1cf36cd8be3a tempest-VolumesSnapshotListTestJSON-1057808077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.384d9c38-b960-4852-bb41-91399c99d6f1" returned: 0 in 0.368s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:32 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1698343a-cd2f-4f63-8e3a-1cf36cd8be3a tempest-VolumesSnapshotListTestJSON-1057808077 None] Lock "cinder-quobyte-384d9c38-b960-4852-bb41-91399c99d6f1" released by "_delete_snapshot" :: held 2.231s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:32 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1698343a-cd2f-4f63-8e3a-1cf36cd8be3a tempest-VolumesSnapshotListTestJSON-1057808077 None] Lock "cinder-quobyte-3b112411-a782-430d-9605-bbfef0a21c84" released by "delete_snapshot" :: held 2.288s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6f146e90-7481-4114-922e-9d9763e88096 tempest-SnapshotDependencyTests-2128035145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6f146e90-7481-4114-922e-9d9763e88096 tempest-SnapshotDependencyTests-2128035145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:32 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-6f146e90-7481-4114-922e-9d9763e88096 tempest-SnapshotDependencyTests-2128035145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:55:32 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-6f146e90-7481-4114-922e-9d9763e88096 tempest-SnapshotDependencyTests-2128035145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:55:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6f146e90-7481-4114-922e-9d9763e88096 tempest-SnapshotDependencyTests-2128035145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6f146e90-7481-4114-922e-9d9763e88096 tempest-SnapshotDependencyTests-2128035145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:32 devstack sudo[105477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:55:32 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:32 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-1698343a-cd2f-4f63-8e3a-1cf36cd8be3a tempest-VolumesSnapshotListTestJSON-1057808077 None] Created reservations ['a654f401-c93d-434c-9ca1-401fc16215b9', 'a30c9d6c-48fc-4f3c-b398-d865df304dd9', '03b4eee4-5034-4993-9436-c84f09bd8546', '37d18df0-eec3-438f-9041-4807b40a81e6'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:55:32 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-1698343a-cd2f-4f63-8e3a-1cf36cd8be3a tempest-VolumesSnapshotListTestJSON-1057808077 None] Delete snapshot completed successfully. Jul 31 10:55:32 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1698343a-cd2f-4f63-8e3a-1cf36cd8be3a tempest-VolumesSnapshotListTestJSON-1057808077 None] Lock "cinder-384d9c38-b960-4852-bb41-91399c99d6f1-delete_snapshot" released by "delete_snapshot" :: held 2.504s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:32 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-eaf6de71-4139-4444-aa63-b00d7c3ff060 tempest-CreateVolumesFromSnapshotTest-1820093262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d.info" returned: 0 in 0.321s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-eaf6de71-4139-4444-aa63-b00d7c3ff060 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.702s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:32 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-eaf6de71-4139-4444-aa63-b00d7c3ff060 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Create snapshot completed successfully Jul 31 10:55:32 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6f146e90-7481-4114-922e-9d9763e88096 tempest-SnapshotDependencyTests-2128035145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.295s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:32 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-6f146e90-7481-4114-922e-9d9763e88096 tempest-SnapshotDependencyTests-2128035145 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:55:32 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-6f146e90-7481-4114-922e-9d9763e88096 tempest-SnapshotDependencyTests-2128035145 None] Deleted volume successfully. Jul 31 10:55:32 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6f146e90-7481-4114-922e-9d9763e88096 tempest-SnapshotDependencyTests-2128035145 None] Lock "cinder-9188b901-852a-4945-b47d-b140c6a40a9c-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a62018d8-e2f6-4b8f-8849-033abfce952c tempest-VolumesSnapshotListTestJSON-1057808077 None] Acquiring lock "cinder-2daabf09-ea9f-4b23-b5ac-8dbd7dc366ba-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d2e0b3a-d61d-4f19-9e8c-268b8f5192e0 tempest-ProjectReaderTests-1161097642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4d2e0b3a-d61d-4f19-9e8c-268b8f5192e0 tempest-ProjectReaderTests-1161097642 None] Flow 'volume_create_manager' (2b18c03b-bf1b-4c2d-9401-9f8db2ef6909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4d2e0b3a-d61d-4f19-9e8c-268b8f5192e0 tempest-ProjectReaderTests-1161097642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4ac1013-7c4a-4188-8222-8d5d148ed24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4d2e0b3a-d61d-4f19-9e8c-268b8f5192e0 tempest-ProjectReaderTests-1161097642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4ac1013-7c4a-4188-8222-8d5d148ed24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1672671591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc83b61c-8e41-406d-b5fe-9f8540b3018d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a1a57295c554d179ecfe1c2639d06e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:33Z,use_quota=True,user_id='3575ad7bd5b7401abab68b71217af415',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4d2e0b3a-d61d-4f19-9e8c-268b8f5192e0 tempest-ProjectReaderTests-1161097642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b657dd1e-3032-471e-89ca-8a969bf65476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4d2e0b3a-d61d-4f19-9e8c-268b8f5192e0 tempest-ProjectReaderTests-1161097642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b657dd1e-3032-471e-89ca-8a969bf65476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4d2e0b3a-d61d-4f19-9e8c-268b8f5192e0 tempest-ProjectReaderTests-1161097642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c58b0123-39c2-4cf9-a0bc-d640fccdf1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4d2e0b3a-d61d-4f19-9e8c-268b8f5192e0 tempest-ProjectReaderTests-1161097642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c58b0123-39c2-4cf9-a0bc-d640fccdf1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc83b61c-8e41-406d-b5fe-9f8540b3018d', 'volume_name': 'volume-fc83b61c-8e41-406d-b5fe-9f8540b3018d', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4d2e0b3a-d61d-4f19-9e8c-268b8f5192e0 tempest-ProjectReaderTests-1161097642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d52a8a8-8ce5-4826-b546-cfb454e16eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4d2e0b3a-d61d-4f19-9e8c-268b8f5192e0 tempest-ProjectReaderTests-1161097642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d52a8a8-8ce5-4826-b546-cfb454e16eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4d2e0b3a-d61d-4f19-9e8c-268b8f5192e0 tempest-ProjectReaderTests-1161097642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92bd5944-2dba-4b5a-b25a-3d0310d50c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:33 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-4d2e0b3a-d61d-4f19-9e8c-268b8f5192e0 tempest-ProjectReaderTests-1161097642 None] Volume fc83b61c-8e41-406d-b5fe-9f8540b3018d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc83b61c-8e41-406d-b5fe-9f8540b3018d', 'volume_size': 1} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4d2e0b3a-d61d-4f19-9e8c-268b8f5192e0 tempest-ProjectReaderTests-1161097642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4d2e0b3a-d61d-4f19-9e8c-268b8f5192e0 tempest-ProjectReaderTests-1161097642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4d2e0b3a-d61d-4f19-9e8c-268b8f5192e0 tempest-ProjectReaderTests-1161097642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1672671591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc83b61c-8e41-406d-b5fe-9f8540b3018d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a1a57295c554d179ecfe1c2639d06e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:33Z,use_quota=True,user_id='3575ad7bd5b7401abab68b71217af415',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-4d2e0b3a-d61d-4f19-9e8c-268b8f5192e0 tempest-ProjectReaderTests-1161097642 None] Creating volume fc83b61c-8e41-406d-b5fe-9f8540b3018d {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4d2e0b3a-d61d-4f19-9e8c-268b8f5192e0 tempest-ProjectReaderTests-1161097642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4d2e0b3a-d61d-4f19-9e8c-268b8f5192e0 tempest-ProjectReaderTests-1161097642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4d2e0b3a-d61d-4f19-9e8c-268b8f5192e0 tempest-ProjectReaderTests-1161097642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4d2e0b3a-d61d-4f19-9e8c-268b8f5192e0 tempest-ProjectReaderTests-1161097642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4d2e0b3a-d61d-4f19-9e8c-268b8f5192e0 tempest-ProjectReaderTests-1161097642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4d2e0b3a-d61d-4f19-9e8c-268b8f5192e0 tempest-ProjectReaderTests-1161097642 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:55:33 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-4d2e0b3a-d61d-4f19-9e8c-268b8f5192e0 tempest-ProjectReaderTests-1161097642 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4d2e0b3a-d61d-4f19-9e8c-268b8f5192e0 tempest-ProjectReaderTests-1161097642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fc83b61c-8e41-406d-b5fe-9f8540b3018d 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a62018d8-e2f6-4b8f-8849-033abfce952c tempest-VolumesSnapshotListTestJSON-1057808077 None] Lock "cinder-2daabf09-ea9f-4b23-b5ac-8dbd7dc366ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.137s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a62018d8-e2f6-4b8f-8849-033abfce952c tempest-VolumesSnapshotListTestJSON-1057808077 None] Acquiring lock "cinder-quobyte-3b112411-a782-430d-9605-bbfef0a21c84" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:33 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fc83b61c-8e41-406d-b5fe-9f8540b3018d 1073741824 Jul 31 10:55:33 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a62018d8-e2f6-4b8f-8849-033abfce952c tempest-VolumesSnapshotListTestJSON-1057808077 None] Lock "cinder-quobyte-3b112411-a782-430d-9605-bbfef0a21c84" acquired by "delete_snapshot" :: waited 0.032s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a62018d8-e2f6-4b8f-8849-033abfce952c tempest-VolumesSnapshotListTestJSON-1057808077 None] Acquiring lock "cinder-quobyte-2daabf09-ea9f-4b23-b5ac-8dbd7dc366ba" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a62018d8-e2f6-4b8f-8849-033abfce952c tempest-VolumesSnapshotListTestJSON-1057808077 None] Lock "cinder-quobyte-2daabf09-ea9f-4b23-b5ac-8dbd7dc366ba" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-a62018d8-e2f6-4b8f-8849-033abfce952c tempest-VolumesSnapshotListTestJSON-1057808077 None] Deleting offline snapshot 2daabf09-ea9f-4b23-b5ac-8dbd7dc366ba of volume 3b112411-a782-430d-9605-bbfef0a21c84 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-a62018d8-e2f6-4b8f-8849-033abfce952c tempest-VolumesSnapshotListTestJSON-1057808077 None] snapshot_file for this snap is: volume-3b112411-a782-430d-9605-bbfef0a21c84.2daabf09-ea9f-4b23-b5ac-8dbd7dc366ba {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3897f3c-586d-41c6-94c7-5d08c79b9f1c]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a62018d8-e2f6-4b8f-8849-033abfce952c tempest-VolumesSnapshotListTestJSON-1057808077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.2daabf09-ea9f-4b23-b5ac-8dbd7dc366ba {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa4f0481-a9f3-4aaa-81f6-243a97db38c4 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:55:33 devstack sudo[105483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.2daabf09-ea9f-4b23-b5ac-8dbd7dc366ba Jul 31 10:55:33 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-aa4f0481-a9f3-4aaa-81f6-243a97db38c4 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Flow 'volume_create_manager' (6c9577b1-107f-4e6a-a7a7-893afc01607b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-aa4f0481-a9f3-4aaa-81f6-243a97db38c4 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f27aee-08de-4cb4-bb77-ca0a5e46f2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-aa4f0481-a9f3-4aaa-81f6-243a97db38c4 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f27aee-08de-4cb4-bb77-ca0a5e46f2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1064413289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b96f9d30-3c58-4b45-ae53-a32f3be812aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7907a064637641e0b91c7cad9306dd24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:34Z,use_quota=True,user_id='56c43773ce504261baad25122f910bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-aa4f0481-a9f3-4aaa-81f6-243a97db38c4 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (663c43d9-a142-4f5f-aa73-d28697b80575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-aa4f0481-a9f3-4aaa-81f6-243a97db38c4 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (663c43d9-a142-4f5f-aa73-d28697b80575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-aa4f0481-a9f3-4aaa-81f6-243a97db38c4 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a34f44-54bb-4672-9c73-cc6ed3a02ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-aa4f0481-a9f3-4aaa-81f6-243a97db38c4 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a34f44-54bb-4672-9c73-cc6ed3a02ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b96f9d30-3c58-4b45-ae53-a32f3be812aa', 'volume_name': 'volume-b96f9d30-3c58-4b45-ae53-a32f3be812aa', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-aa4f0481-a9f3-4aaa-81f6-243a97db38c4 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29e88cb8-ec5e-4b0d-be1f-6ae9f9cd745d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-aa4f0481-a9f3-4aaa-81f6-243a97db38c4 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29e88cb8-ec5e-4b0d-be1f-6ae9f9cd745d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-aa4f0481-a9f3-4aaa-81f6-243a97db38c4 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4761bd81-5f97-4f3d-81b3-f234dca70adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:33 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-aa4f0481-a9f3-4aaa-81f6-243a97db38c4 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Volume b96f9d30-3c58-4b45-ae53-a32f3be812aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b96f9d30-3c58-4b45-ae53-a32f3be812aa', 'volume_size': 1} Jul 31 10:55:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-aa4f0481-a9f3-4aaa-81f6-243a97db38c4 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:34 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4d2e0b3a-d61d-4f19-9e8c-268b8f5192e0 tempest-ProjectReaderTests-1161097642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fc83b61c-8e41-406d-b5fe-9f8540b3018d 1073741824" returned: 0 in 0.782s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:34 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a62018d8-e2f6-4b8f-8849-033abfce952c tempest-VolumesSnapshotListTestJSON-1057808077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.2daabf09-ea9f-4b23-b5ac-8dbd7dc366ba" returned: 0 in 0.704s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:34 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-a62018d8-e2f6-4b8f-8849-033abfce952c tempest-VolumesSnapshotListTestJSON-1057808077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b112411-a782-430d-9605-bbfef0a21c84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:55:34 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[47273210-8b49-4ce1-bf3e-4f31f8863ca5]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a62018d8-e2f6-4b8f-8849-033abfce952c tempest-VolumesSnapshotListTestJSON-1057808077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.cbc8c566-7acb-4223-ac6b-7d217c7e53f0 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4d2e0b3a-d61d-4f19-9e8c-268b8f5192e0 tempest-ProjectReaderTests-1161097642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fc83b61c-8e41-406d-b5fe-9f8540b3018d {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:34 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fc83b61c-8e41-406d-b5fe-9f8540b3018d Jul 31 10:55:34 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:34 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-18425994-f0ae-465d-9ef3-c88b9650e7af tempest-CreateVolumesFromSnapshotTest-1820093262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:55:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-18425994-f0ae-465d-9ef3-c88b9650e7af tempest-CreateVolumesFromSnapshotTest-1820093262 None] Flow 'volume_create_manager' (b694832d-1c69-4a27-adf1-6dee4de6c9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-18425994-f0ae-465d-9ef3-c88b9650e7af tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f1db67c-e103-422e-bb7d-01e639019019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-18425994-f0ae-465d-9ef3-c88b9650e7af tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f1db67c-e103-422e-bb7d-01e639019019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-370185565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85d3f2e4-c477-4517-b75c-57e39bf98a39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7907a064637641e0b91c7cad9306dd24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:34Z,use_quota=True,user_id='56c43773ce504261baad25122f910bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-18425994-f0ae-465d-9ef3-c88b9650e7af tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95861e52-d27a-482d-a9ee-b195c25087f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-18425994-f0ae-465d-9ef3-c88b9650e7af tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95861e52-d27a-482d-a9ee-b195c25087f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-18425994-f0ae-465d-9ef3-c88b9650e7af tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c59e54c9-8147-43ca-81cb-04aa39f9ecc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-18425994-f0ae-465d-9ef3-c88b9650e7af tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c59e54c9-8147-43ca-81cb-04aa39f9ecc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85d3f2e4-c477-4517-b75c-57e39bf98a39', 'volume_name': 'volume-85d3f2e4-c477-4517-b75c-57e39bf98a39', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:34 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.cbc8c566-7acb-4223-ac6b-7d217c7e53f0 Jul 31 10:55:34 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-18425994-f0ae-465d-9ef3-c88b9650e7af tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b2a0d61-605a-455d-85f4-04dc295670e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-18425994-f0ae-465d-9ef3-c88b9650e7af tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b2a0d61-605a-455d-85f4-04dc295670e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-18425994-f0ae-465d-9ef3-c88b9650e7af tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1daffa19-9282-46dc-83f2-92dba4741b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:34 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-18425994-f0ae-465d-9ef3-c88b9650e7af tempest-CreateVolumesFromSnapshotTest-1820093262 None] Volume 85d3f2e4-c477-4517-b75c-57e39bf98a39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85d3f2e4-c477-4517-b75c-57e39bf98a39', 'volume_size': 1} Jul 31 10:55:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-18425994-f0ae-465d-9ef3-c88b9650e7af tempest-CreateVolumesFromSnapshotTest-1820093262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:34 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4d2e0b3a-d61d-4f19-9e8c-268b8f5192e0 tempest-ProjectReaderTests-1161097642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fc83b61c-8e41-406d-b5fe-9f8540b3018d" returned: 0 in 0.444s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:34 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4d2e0b3a-d61d-4f19-9e8c-268b8f5192e0 tempest-ProjectReaderTests-1161097642 None] <== create_volume: return (1367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:55:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4d2e0b3a-d61d-4f19-9e8c-268b8f5192e0 tempest-ProjectReaderTests-1161097642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.373s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-aa4f0481-a9f3-4aaa-81f6-243a97db38c4 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.925s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:34 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-aa4f0481-a9f3-4aaa-81f6-243a97db38c4 tempest-CreateVolumesFromSnapshotTest-1820093262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1064413289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b96f9d30-3c58-4b45-ae53-a32f3be812aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7907a064637641e0b91c7cad9306dd24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:34Z,use_quota=True,user_id='56c43773ce504261baad25122f910bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:55:34 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-aa4f0481-a9f3-4aaa-81f6-243a97db38c4 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Creating volume b96f9d30-3c58-4b45-ae53-a32f3be812aa {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:55:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-aa4f0481-a9f3-4aaa-81f6-243a97db38c4 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-aa4f0481-a9f3-4aaa-81f6-243a97db38c4 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:34 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-aa4f0481-a9f3-4aaa-81f6-243a97db38c4 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:55:34 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-aa4f0481-a9f3-4aaa-81f6-243a97db38c4 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:55:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-aa4f0481-a9f3-4aaa-81f6-243a97db38c4 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:34 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-aa4f0481-a9f3-4aaa-81f6-243a97db38c4 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:55:34 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-aa4f0481-a9f3-4aaa-81f6-243a97db38c4 tempest-CreateVolumesFromSnapshotTest-1820093262 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:55:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-aa4f0481-a9f3-4aaa-81f6-243a97db38c4 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b96f9d30-3c58-4b45-ae53-a32f3be812aa 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4d2e0b3a-d61d-4f19-9e8c-268b8f5192e0 tempest-ProjectReaderTests-1161097642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92bd5944-2dba-4b5a-b25a-3d0310d50c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc83b61c-8e41-406d-b5fe-9f8540b3018d', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:34 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b96f9d30-3c58-4b45-ae53-a32f3be812aa 1073741824 Jul 31 10:55:34 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4d2e0b3a-d61d-4f19-9e8c-268b8f5192e0 tempest-ProjectReaderTests-1161097642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7ed86a-7bc3-4d51-bd28-5afc583c4714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:35 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-4d2e0b3a-d61d-4f19-9e8c-268b8f5192e0 tempest-ProjectReaderTests-1161097642 None] Volume volume-fc83b61c-8e41-406d-b5fe-9f8540b3018d (fc83b61c-8e41-406d-b5fe-9f8540b3018d): created successfully Jul 31 10:55:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4d2e0b3a-d61d-4f19-9e8c-268b8f5192e0 tempest-ProjectReaderTests-1161097642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7ed86a-7bc3-4d51-bd28-5afc583c4714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4d2e0b3a-d61d-4f19-9e8c-268b8f5192e0 tempest-ProjectReaderTests-1161097642 None] Flow 'volume_create_manager' (2b18c03b-bf1b-4c2d-9401-9f8db2ef6909) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:35 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-4d2e0b3a-d61d-4f19-9e8c-268b8f5192e0 tempest-ProjectReaderTests-1161097642 None] Created volume successfully. Jul 31 10:55:35 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a62018d8-e2f6-4b8f-8849-033abfce952c tempest-VolumesSnapshotListTestJSON-1057808077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.cbc8c566-7acb-4223-ac6b-7d217c7e53f0" returned: 0 in 0.758s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:35 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-a62018d8-e2f6-4b8f-8849-033abfce952c tempest-VolumesSnapshotListTestJSON-1057808077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b112411-a782-430d-9605-bbfef0a21c84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:55:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a62018d8-e2f6-4b8f-8849-033abfce952c tempest-VolumesSnapshotListTestJSON-1057808077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.2daabf09-ea9f-4b23-b5ac-8dbd7dc366ba {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:35 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.2daabf09-ea9f-4b23-b5ac-8dbd7dc366ba Jul 31 10:55:35 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:35 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b07eacb-9e3c-40f5-81fb-6c89dc062837 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:55:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7b07eacb-9e3c-40f5-81fb-6c89dc062837 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Flow 'volume_create_manager' (36f7897a-bd24-4253-b1b0-6f977737a898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7b07eacb-9e3c-40f5-81fb-6c89dc062837 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8623174-5f37-41db-99e2-03f57f3b528f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7b07eacb-9e3c-40f5-81fb-6c89dc062837 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8623174-5f37-41db-99e2-03f57f3b528f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-770978950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7af0e29-4d01-49ed-9a10-b30b6772e9e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7907a064637641e0b91c7cad9306dd24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:35Z,use_quota=True,user_id='56c43773ce504261baad25122f910bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7b07eacb-9e3c-40f5-81fb-6c89dc062837 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1438665-ce79-4dc9-9290-7ef1aa7d6094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7b07eacb-9e3c-40f5-81fb-6c89dc062837 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1438665-ce79-4dc9-9290-7ef1aa7d6094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7b07eacb-9e3c-40f5-81fb-6c89dc062837 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d061cf7a-82bd-4807-92d1-f7f19d80db87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7b07eacb-9e3c-40f5-81fb-6c89dc062837 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d061cf7a-82bd-4807-92d1-f7f19d80db87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7af0e29-4d01-49ed-9a10-b30b6772e9e2', 'volume_name': 'volume-f7af0e29-4d01-49ed-9a10-b30b6772e9e2', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7b07eacb-9e3c-40f5-81fb-6c89dc062837 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efdfe9f1-8d70-4b0a-9111-7476ace9eb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7b07eacb-9e3c-40f5-81fb-6c89dc062837 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efdfe9f1-8d70-4b0a-9111-7476ace9eb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7b07eacb-9e3c-40f5-81fb-6c89dc062837 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85302683-5234-4bf9-9da2-119eae893999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:35 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-7b07eacb-9e3c-40f5-81fb-6c89dc062837 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Volume f7af0e29-4d01-49ed-9a10-b30b6772e9e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7af0e29-4d01-49ed-9a10-b30b6772e9e2', 'volume_size': 1} Jul 31 10:55:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7b07eacb-9e3c-40f5-81fb-6c89dc062837 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:35 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-801c3964-a5e6-469d-930e-27c17a51f368 tempest-ProjectReaderTests-1161097642 None] Acquiring lock "cinder-fc83b61c-8e41-406d-b5fe-9f8540b3018d-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:35 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-aa4f0481-a9f3-4aaa-81f6-243a97db38c4 tempest-CreateVolumesFromSnapshotTest-1820093262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b96f9d30-3c58-4b45-ae53-a32f3be812aa 1073741824" returned: 0 in 0.946s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:35 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-801c3964-a5e6-469d-930e-27c17a51f368 tempest-ProjectReaderTests-1161097642 None] Lock "cinder-fc83b61c-8e41-406d-b5fe-9f8540b3018d-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-aa4f0481-a9f3-4aaa-81f6-243a97db38c4 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b96f9d30-3c58-4b45-ae53-a32f3be812aa {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:35 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f26455f-2dde-4ad6-b5c0-4cb209dfa6db tempest-CreateVolumesFromSnapshotTest-1820093262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:55:36 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b96f9d30-3c58-4b45-ae53-a32f3be812aa Jul 31 10:55:36 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-1f26455f-2dde-4ad6-b5c0-4cb209dfa6db tempest-CreateVolumesFromSnapshotTest-1820093262 None] Flow 'volume_create_manager' (e0f55b6a-3184-4112-af61-9cb36041d625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-1f26455f-2dde-4ad6-b5c0-4cb209dfa6db tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b69361fe-d31d-4271-9bf3-28983b743d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a62018d8-e2f6-4b8f-8849-033abfce952c tempest-VolumesSnapshotListTestJSON-1057808077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.2daabf09-ea9f-4b23-b5ac-8dbd7dc366ba" returned: 0 in 0.867s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a62018d8-e2f6-4b8f-8849-033abfce952c tempest-VolumesSnapshotListTestJSON-1057808077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.2daabf09-ea9f-4b23-b5ac-8dbd7dc366ba {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-801c3964-a5e6-469d-930e-27c17a51f368 tempest-ProjectReaderTests-1161097642 None] Acquiring lock "cinder-quobyte-fc83b61c-8e41-406d-b5fe-9f8540b3018d" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-1f26455f-2dde-4ad6-b5c0-4cb209dfa6db tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b69361fe-d31d-4271-9bf3-28983b743d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1962244451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8ad2e02-419a-4609-9ed7-382b32d40860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7907a064637641e0b91c7cad9306dd24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:36Z,use_quota=True,user_id='56c43773ce504261baad25122f910bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:36 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.2daabf09-ea9f-4b23-b5ac-8dbd7dc366ba Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-1f26455f-2dde-4ad6-b5c0-4cb209dfa6db tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ac4faab-65ff-4068-8dde-70926c7a334d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:36 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-1f26455f-2dde-4ad6-b5c0-4cb209dfa6db tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ac4faab-65ff-4068-8dde-70926c7a334d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-1f26455f-2dde-4ad6-b5c0-4cb209dfa6db tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae473b1e-910a-445e-ac70-26b5a5e96c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-1f26455f-2dde-4ad6-b5c0-4cb209dfa6db tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae473b1e-910a-445e-ac70-26b5a5e96c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8ad2e02-419a-4609-9ed7-382b32d40860', 'volume_name': 'volume-e8ad2e02-419a-4609-9ed7-382b32d40860', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-1f26455f-2dde-4ad6-b5c0-4cb209dfa6db tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (466c8fde-5282-43e7-9fa8-37f9656ae8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-1f26455f-2dde-4ad6-b5c0-4cb209dfa6db tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (466c8fde-5282-43e7-9fa8-37f9656ae8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-1f26455f-2dde-4ad6-b5c0-4cb209dfa6db tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d74a6f37-8bc0-4634-bf07-a74f81ad2864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:36 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-1f26455f-2dde-4ad6-b5c0-4cb209dfa6db tempest-CreateVolumesFromSnapshotTest-1820093262 None] Volume e8ad2e02-419a-4609-9ed7-382b32d40860: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8ad2e02-419a-4609-9ed7-382b32d40860', 'volume_size': 1} Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-1f26455f-2dde-4ad6-b5c0-4cb209dfa6db tempest-CreateVolumesFromSnapshotTest-1820093262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-801c3964-a5e6-469d-930e-27c17a51f368 tempest-ProjectReaderTests-1161097642 None] Lock "cinder-quobyte-fc83b61c-8e41-406d-b5fe-9f8540b3018d" acquired by "delete_volume" :: waited 0.132s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba68dcc-a235-447e-9c19-ffd46993e55c]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-801c3964-a5e6-469d-930e-27c17a51f368 tempest-ProjectReaderTests-1161097642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fc83b61c-8e41-406d-b5fe-9f8540b3018d {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:36 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-aa4f0481-a9f3-4aaa-81f6-243a97db38c4 tempest-CreateVolumesFromSnapshotTest-1820093262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b96f9d30-3c58-4b45-ae53-a32f3be812aa" returned: 0 in 0.459s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:36 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-aa4f0481-a9f3-4aaa-81f6-243a97db38c4 tempest-CreateVolumesFromSnapshotTest-1820093262 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-aa4f0481-a9f3-4aaa-81f6-243a97db38c4 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:36 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fc83b61c-8e41-406d-b5fe-9f8540b3018d Jul 31 10:55:36 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-18425994-f0ae-465d-9ef3-c88b9650e7af tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.703s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-18425994-f0ae-465d-9ef3-c88b9650e7af tempest-CreateVolumesFromSnapshotTest-1820093262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-370185565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85d3f2e4-c477-4517-b75c-57e39bf98a39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7907a064637641e0b91c7cad9306dd24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:34Z,use_quota=True,user_id='56c43773ce504261baad25122f910bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-18425994-f0ae-465d-9ef3-c88b9650e7af tempest-CreateVolumesFromSnapshotTest-1820093262 None] Creating volume 85d3f2e4-c477-4517-b75c-57e39bf98a39 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-18425994-f0ae-465d-9ef3-c88b9650e7af tempest-CreateVolumesFromSnapshotTest-1820093262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-18425994-f0ae-465d-9ef3-c88b9650e7af tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-18425994-f0ae-465d-9ef3-c88b9650e7af tempest-CreateVolumesFromSnapshotTest-1820093262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-18425994-f0ae-465d-9ef3-c88b9650e7af tempest-CreateVolumesFromSnapshotTest-1820093262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-18425994-f0ae-465d-9ef3-c88b9650e7af tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-18425994-f0ae-465d-9ef3-c88b9650e7af tempest-CreateVolumesFromSnapshotTest-1820093262 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:55:36 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-18425994-f0ae-465d-9ef3-c88b9650e7af tempest-CreateVolumesFromSnapshotTest-1820093262 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-18425994-f0ae-465d-9ef3-c88b9650e7af tempest-CreateVolumesFromSnapshotTest-1820093262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-85d3f2e4-c477-4517-b75c-57e39bf98a39 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a62018d8-e2f6-4b8f-8849-033abfce952c tempest-VolumesSnapshotListTestJSON-1057808077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.2daabf09-ea9f-4b23-b5ac-8dbd7dc366ba" returned: 0 in 0.461s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:36 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-85d3f2e4-c477-4517-b75c-57e39bf98a39 1073741824 Jul 31 10:55:36 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-aa4f0481-a9f3-4aaa-81f6-243a97db38c4 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4761bd81-5f97-4f3d-81b3-f234dca70adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b96f9d30-3c58-4b45-ae53-a32f3be812aa', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-aa4f0481-a9f3-4aaa-81f6-243a97db38c4 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc11c727-a027-4044-9d96-6ab810bdd3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a62018d8-e2f6-4b8f-8849-033abfce952c tempest-VolumesSnapshotListTestJSON-1057808077 None] Lock "cinder-quobyte-2daabf09-ea9f-4b23-b5ac-8dbd7dc366ba" released by "_delete_snapshot" :: held 2.976s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a62018d8-e2f6-4b8f-8849-033abfce952c tempest-VolumesSnapshotListTestJSON-1057808077 None] Lock "cinder-quobyte-3b112411-a782-430d-9605-bbfef0a21c84" released by "delete_snapshot" :: held 3.041s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:36 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-aa4f0481-a9f3-4aaa-81f6-243a97db38c4 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Volume volume-b96f9d30-3c58-4b45-ae53-a32f3be812aa (b96f9d30-3c58-4b45-ae53-a32f3be812aa): created successfully Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-aa4f0481-a9f3-4aaa-81f6-243a97db38c4 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc11c727-a027-4044-9d96-6ab810bdd3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-aa4f0481-a9f3-4aaa-81f6-243a97db38c4 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Flow 'volume_create_manager' (6c9577b1-107f-4e6a-a7a7-893afc01607b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:36 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-aa4f0481-a9f3-4aaa-81f6-243a97db38c4 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Created volume successfully. Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-a62018d8-e2f6-4b8f-8849-033abfce952c tempest-VolumesSnapshotListTestJSON-1057808077 None] Created reservations ['f128fc36-af16-4b76-ba6f-4ba9e9ed77fb', '8d7e16c2-d89e-475f-8e97-621083e4c88a', '37e0944d-a83c-41fb-87c6-6e96d3bb4daa', 'c27f2606-7ba2-4827-840e-0af50eb86a29'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-93753093-1b30-413c-b021-9370585af4f9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:55:36 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-93753093-1b30-413c-b021-9370585af4f9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Flow 'volume_create_manager' (674728fa-e3d3-49ea-99c2-185b036d601c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-93753093-1b30-413c-b021-9370585af4f9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359284ef-4fee-4a35-824a-3f5e7ab459ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-801c3964-a5e6-469d-930e-27c17a51f368 tempest-ProjectReaderTests-1161097642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fc83b61c-8e41-406d-b5fe-9f8540b3018d" returned: 0 in 0.639s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-801c3964-a5e6-469d-930e-27c17a51f368 tempest-ProjectReaderTests-1161097642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fc83b61c-8e41-406d-b5fe-9f8540b3018d {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:36 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fc83b61c-8e41-406d-b5fe-9f8540b3018d Jul 31 10:55:36 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-93753093-1b30-413c-b021-9370585af4f9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359284ef-4fee-4a35-824a-3f5e7ab459ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1858058230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0993e8b5-19a7-4a6a-87b7-4cf170c9f7c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7907a064637641e0b91c7cad9306dd24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:37Z,use_quota=True,user_id='56c43773ce504261baad25122f910bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-93753093-1b30-413c-b021-9370585af4f9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03c3f98c-23fd-4d19-bab1-b3a3d2381b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-93753093-1b30-413c-b021-9370585af4f9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03c3f98c-23fd-4d19-bab1-b3a3d2381b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-93753093-1b30-413c-b021-9370585af4f9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82abb339-919b-400a-833e-60dfddc672f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-93753093-1b30-413c-b021-9370585af4f9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82abb339-919b-400a-833e-60dfddc672f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0993e8b5-19a7-4a6a-87b7-4cf170c9f7c7', 'volume_name': 'volume-0993e8b5-19a7-4a6a-87b7-4cf170c9f7c7', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-93753093-1b30-413c-b021-9370585af4f9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d0f6e46-4417-443d-a2ef-4bea3092e5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-93753093-1b30-413c-b021-9370585af4f9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d0f6e46-4417-443d-a2ef-4bea3092e5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-93753093-1b30-413c-b021-9370585af4f9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3df47f21-208a-4dac-94c2-3ba2bde7820e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:37 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-93753093-1b30-413c-b021-9370585af4f9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Volume 0993e8b5-19a7-4a6a-87b7-4cf170c9f7c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0993e8b5-19a7-4a6a-87b7-4cf170c9f7c7', 'volume_size': 1} Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-93753093-1b30-413c-b021-9370585af4f9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:37 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-a62018d8-e2f6-4b8f-8849-033abfce952c tempest-VolumesSnapshotListTestJSON-1057808077 None] Delete snapshot completed successfully. Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a62018d8-e2f6-4b8f-8849-033abfce952c tempest-VolumesSnapshotListTestJSON-1057808077 None] Lock "cinder-2daabf09-ea9f-4b23-b5ac-8dbd7dc366ba-delete_snapshot" released by "delete_snapshot" :: held 3.584s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:37 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:37 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-801c3964-a5e6-469d-930e-27c17a51f368 tempest-ProjectReaderTests-1161097642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fc83b61c-8e41-406d-b5fe-9f8540b3018d" returned: 0 in 0.344s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-18425994-f0ae-465d-9ef3-c88b9650e7af tempest-CreateVolumesFromSnapshotTest-1820093262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-85d3f2e4-c477-4517-b75c-57e39bf98a39 1073741824" returned: 0 in 0.769s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-801c3964-a5e6-469d-930e-27c17a51f368 tempest-ProjectReaderTests-1161097642 None] Lock "cinder-quobyte-fc83b61c-8e41-406d-b5fe-9f8540b3018d" released by "delete_volume" :: held 1.062s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-18425994-f0ae-465d-9ef3-c88b9650e7af tempest-CreateVolumesFromSnapshotTest-1820093262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-85d3f2e4-c477-4517-b75c-57e39bf98a39 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:37 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-85d3f2e4-c477-4517-b75c-57e39bf98a39 Jul 31 10:55:37 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-801c3964-a5e6-469d-930e-27c17a51f368 tempest-ProjectReaderTests-1161097642 None] Created reservations ['cd171c0c-c74a-476d-a659-18ea653adb49', '1e6850ac-f03b-4d9d-afa6-4e4629db653a', '3800182f-22ac-444d-933d-6538f4ef02c4', '6ab8e12a-4221-4fff-89ec-c0da24ff4a3c'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-801c3964-a5e6-469d-930e-27c17a51f368 tempest-ProjectReaderTests-1161097642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-801c3964-a5e6-469d-930e-27c17a51f368 tempest-ProjectReaderTests-1161097642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-801c3964-a5e6-469d-930e-27c17a51f368 tempest-ProjectReaderTests-1161097642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-801c3964-a5e6-469d-930e-27c17a51f368 tempest-ProjectReaderTests-1161097642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-801c3964-a5e6-469d-930e-27c17a51f368 tempest-ProjectReaderTests-1161097642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-801c3964-a5e6-469d-930e-27c17a51f368 tempest-ProjectReaderTests-1161097642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:37 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:55:37 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:37 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-18425994-f0ae-465d-9ef3-c88b9650e7af tempest-CreateVolumesFromSnapshotTest-1820093262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-85d3f2e4-c477-4517-b75c-57e39bf98a39" returned: 0 in 0.321s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-18425994-f0ae-465d-9ef3-c88b9650e7af tempest-CreateVolumesFromSnapshotTest-1820093262 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-18425994-f0ae-465d-9ef3-c88b9650e7af tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7b07eacb-9e3c-40f5-81fb-6c89dc062837 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.017s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-7b07eacb-9e3c-40f5-81fb-6c89dc062837 tempest-CreateVolumesFromSnapshotTest-1820093262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-770978950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7af0e29-4d01-49ed-9a10-b30b6772e9e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7907a064637641e0b91c7cad9306dd24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:35Z,use_quota=True,user_id='56c43773ce504261baad25122f910bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-7b07eacb-9e3c-40f5-81fb-6c89dc062837 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Creating volume f7af0e29-4d01-49ed-9a10-b30b6772e9e2 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7b07eacb-9e3c-40f5-81fb-6c89dc062837 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7b07eacb-9e3c-40f5-81fb-6c89dc062837 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-7b07eacb-9e3c-40f5-81fb-6c89dc062837 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-7b07eacb-9e3c-40f5-81fb-6c89dc062837 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7b07eacb-9e3c-40f5-81fb-6c89dc062837 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-7b07eacb-9e3c-40f5-81fb-6c89dc062837 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:55:37 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-7b07eacb-9e3c-40f5-81fb-6c89dc062837 tempest-CreateVolumesFromSnapshotTest-1820093262 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7b07eacb-9e3c-40f5-81fb-6c89dc062837 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f7af0e29-4d01-49ed-9a10-b30b6772e9e2 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:37 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f7af0e29-4d01-49ed-9a10-b30b6772e9e2 1073741824 Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-18425994-f0ae-465d-9ef3-c88b9650e7af tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1daffa19-9282-46dc-83f2-92dba4741b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85d3f2e4-c477-4517-b75c-57e39bf98a39', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:37 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-18425994-f0ae-465d-9ef3-c88b9650e7af tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (863ecc3c-c840-48aa-a045-cf2f96ddbb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:37 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-801c3964-a5e6-469d-930e-27c17a51f368 tempest-ProjectReaderTests-1161097642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.332s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-801c3964-a5e6-469d-930e-27c17a51f368 tempest-ProjectReaderTests-1161097642 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:55:37 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-18425994-f0ae-465d-9ef3-c88b9650e7af tempest-CreateVolumesFromSnapshotTest-1820093262 None] Volume volume-85d3f2e4-c477-4517-b75c-57e39bf98a39 (85d3f2e4-c477-4517-b75c-57e39bf98a39): created successfully Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-18425994-f0ae-465d-9ef3-c88b9650e7af tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (863ecc3c-c840-48aa-a045-cf2f96ddbb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-18425994-f0ae-465d-9ef3-c88b9650e7af tempest-CreateVolumesFromSnapshotTest-1820093262 None] Flow 'volume_create_manager' (b694832d-1c69-4a27-adf1-6dee4de6c9f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:37 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-801c3964-a5e6-469d-930e-27c17a51f368 tempest-ProjectReaderTests-1161097642 None] Deleted volume successfully. Jul 31 10:55:37 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-18425994-f0ae-465d-9ef3-c88b9650e7af tempest-CreateVolumesFromSnapshotTest-1820093262 None] Created volume successfully. Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-801c3964-a5e6-469d-930e-27c17a51f368 tempest-ProjectReaderTests-1161097642 None] Lock "cinder-fc83b61c-8e41-406d-b5fe-9f8540b3018d-delete_volume" released by "delete_volume" :: held 1.939s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-57e4b79a-1616-455a-88b1-52757de5e49c tempest-VolumesSnapshotListTestJSON-1057808077 None] Acquiring lock "cinder-cbc8c566-7acb-4223-ac6b-7d217c7e53f0-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-57e4b79a-1616-455a-88b1-52757de5e49c tempest-VolumesSnapshotListTestJSON-1057808077 None] Lock "cinder-cbc8c566-7acb-4223-ac6b-7d217c7e53f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-57e4b79a-1616-455a-88b1-52757de5e49c tempest-VolumesSnapshotListTestJSON-1057808077 None] Acquiring lock "cinder-quobyte-3b112411-a782-430d-9605-bbfef0a21c84" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-57e4b79a-1616-455a-88b1-52757de5e49c tempest-VolumesSnapshotListTestJSON-1057808077 None] Lock "cinder-quobyte-3b112411-a782-430d-9605-bbfef0a21c84" acquired by "delete_snapshot" :: waited 0.027s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-57e4b79a-1616-455a-88b1-52757de5e49c tempest-VolumesSnapshotListTestJSON-1057808077 None] Acquiring lock "cinder-quobyte-cbc8c566-7acb-4223-ac6b-7d217c7e53f0" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-57e4b79a-1616-455a-88b1-52757de5e49c tempest-VolumesSnapshotListTestJSON-1057808077 None] Lock "cinder-quobyte-cbc8c566-7acb-4223-ac6b-7d217c7e53f0" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-57e4b79a-1616-455a-88b1-52757de5e49c tempest-VolumesSnapshotListTestJSON-1057808077 None] Deleting offline snapshot cbc8c566-7acb-4223-ac6b-7d217c7e53f0 of volume 3b112411-a782-430d-9605-bbfef0a21c84 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-57e4b79a-1616-455a-88b1-52757de5e49c tempest-VolumesSnapshotListTestJSON-1057808077 None] snapshot_file for this snap is: volume-3b112411-a782-430d-9605-bbfef0a21c84.cbc8c566-7acb-4223-ac6b-7d217c7e53f0 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[117034d3-bf91-4b17-a65b-fb7e5d784f08]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-57e4b79a-1616-455a-88b1-52757de5e49c tempest-VolumesSnapshotListTestJSON-1057808077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.cbc8c566-7acb-4223-ac6b-7d217c7e53f0 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:38 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.cbc8c566-7acb-4223-ac6b-7d217c7e53f0 Jul 31 10:55:38 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:38 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7b07eacb-9e3c-40f5-81fb-6c89dc062837 tempest-CreateVolumesFromSnapshotTest-1820093262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f7af0e29-4d01-49ed-9a10-b30b6772e9e2 1073741824" returned: 0 in 0.672s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7b07eacb-9e3c-40f5-81fb-6c89dc062837 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f7af0e29-4d01-49ed-9a10-b30b6772e9e2 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:38 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f7af0e29-4d01-49ed-9a10-b30b6772e9e2 Jul 31 10:55:38 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:38 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-57e4b79a-1616-455a-88b1-52757de5e49c tempest-VolumesSnapshotListTestJSON-1057808077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.cbc8c566-7acb-4223-ac6b-7d217c7e53f0" returned: 0 in 0.510s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:38 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-57e4b79a-1616-455a-88b1-52757de5e49c tempest-VolumesSnapshotListTestJSON-1057808077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b112411-a782-430d-9605-bbfef0a21c84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:55:38 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c2bc43-fcab-4b31-aeca-3acf347c5b1e]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-57e4b79a-1616-455a-88b1-52757de5e49c tempest-VolumesSnapshotListTestJSON-1057808077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:38 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84 Jul 31 10:55:38 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:38 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7b07eacb-9e3c-40f5-81fb-6c89dc062837 tempest-CreateVolumesFromSnapshotTest-1820093262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f7af0e29-4d01-49ed-9a10-b30b6772e9e2" returned: 0 in 0.368s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:38 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-7b07eacb-9e3c-40f5-81fb-6c89dc062837 tempest-CreateVolumesFromSnapshotTest-1820093262 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:55:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7b07eacb-9e3c-40f5-81fb-6c89dc062837 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-1f26455f-2dde-4ad6-b5c0-4cb209dfa6db tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.608s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:38 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-1f26455f-2dde-4ad6-b5c0-4cb209dfa6db tempest-CreateVolumesFromSnapshotTest-1820093262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1962244451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8ad2e02-419a-4609-9ed7-382b32d40860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7907a064637641e0b91c7cad9306dd24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:36Z,use_quota=True,user_id='56c43773ce504261baad25122f910bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:55:38 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-1f26455f-2dde-4ad6-b5c0-4cb209dfa6db tempest-CreateVolumesFromSnapshotTest-1820093262 None] Creating volume e8ad2e02-419a-4609-9ed7-382b32d40860 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:55:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-1f26455f-2dde-4ad6-b5c0-4cb209dfa6db tempest-CreateVolumesFromSnapshotTest-1820093262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-1f26455f-2dde-4ad6-b5c0-4cb209dfa6db tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:38 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-1f26455f-2dde-4ad6-b5c0-4cb209dfa6db tempest-CreateVolumesFromSnapshotTest-1820093262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:55:38 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-1f26455f-2dde-4ad6-b5c0-4cb209dfa6db tempest-CreateVolumesFromSnapshotTest-1820093262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:55:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-1f26455f-2dde-4ad6-b5c0-4cb209dfa6db tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:38 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-1f26455f-2dde-4ad6-b5c0-4cb209dfa6db tempest-CreateVolumesFromSnapshotTest-1820093262 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:55:38 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-1f26455f-2dde-4ad6-b5c0-4cb209dfa6db tempest-CreateVolumesFromSnapshotTest-1820093262 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:55:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1f26455f-2dde-4ad6-b5c0-4cb209dfa6db tempest-CreateVolumesFromSnapshotTest-1820093262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e8ad2e02-419a-4609-9ed7-382b32d40860 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:38 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7b07eacb-9e3c-40f5-81fb-6c89dc062837 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85302683-5234-4bf9-9da2-119eae893999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7af0e29-4d01-49ed-9a10-b30b6772e9e2', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:38 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7b07eacb-9e3c-40f5-81fb-6c89dc062837 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (149fb6be-9f3f-4956-b975-ddf3cd86b376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:38 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e8ad2e02-419a-4609-9ed7-382b32d40860 1073741824 Jul 31 10:55:38 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:38 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-7b07eacb-9e3c-40f5-81fb-6c89dc062837 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Volume volume-f7af0e29-4d01-49ed-9a10-b30b6772e9e2 (f7af0e29-4d01-49ed-9a10-b30b6772e9e2): created successfully Jul 31 10:55:38 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7b07eacb-9e3c-40f5-81fb-6c89dc062837 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (149fb6be-9f3f-4956-b975-ddf3cd86b376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:38 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-7b07eacb-9e3c-40f5-81fb-6c89dc062837 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Flow 'volume_create_manager' (36f7897a-bd24-4253-b1b0-6f977737a898) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:38 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-7b07eacb-9e3c-40f5-81fb-6c89dc062837 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Created volume successfully. Jul 31 10:55:39 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-57e4b79a-1616-455a-88b1-52757de5e49c tempest-VolumesSnapshotListTestJSON-1057808077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84" returned: 0 in 0.690s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-57e4b79a-1616-455a-88b1-52757de5e49c tempest-VolumesSnapshotListTestJSON-1057808077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.cbc8c566-7acb-4223-ac6b-7d217c7e53f0 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:39 devstack sudo[105566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.cbc8c566-7acb-4223-ac6b-7d217c7e53f0 Jul 31 10:55:39 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:39 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1f26455f-2dde-4ad6-b5c0-4cb209dfa6db tempest-CreateVolumesFromSnapshotTest-1820093262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e8ad2e02-419a-4609-9ed7-382b32d40860 1073741824" returned: 0 in 0.716s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1f26455f-2dde-4ad6-b5c0-4cb209dfa6db tempest-CreateVolumesFromSnapshotTest-1820093262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e8ad2e02-419a-4609-9ed7-382b32d40860 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:39 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e8ad2e02-419a-4609-9ed7-382b32d40860 Jul 31 10:55:39 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:39 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-57e4b79a-1616-455a-88b1-52757de5e49c tempest-VolumesSnapshotListTestJSON-1057808077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.cbc8c566-7acb-4223-ac6b-7d217c7e53f0" returned: 0 in 0.538s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-57e4b79a-1616-455a-88b1-52757de5e49c tempest-VolumesSnapshotListTestJSON-1057808077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.cbc8c566-7acb-4223-ac6b-7d217c7e53f0 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:39 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.cbc8c566-7acb-4223-ac6b-7d217c7e53f0 Jul 31 10:55:39 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:40 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1f26455f-2dde-4ad6-b5c0-4cb209dfa6db tempest-CreateVolumesFromSnapshotTest-1820093262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e8ad2e02-419a-4609-9ed7-382b32d40860" returned: 0 in 0.572s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:40 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-1f26455f-2dde-4ad6-b5c0-4cb209dfa6db tempest-CreateVolumesFromSnapshotTest-1820093262 None] <== create_volume: return (1388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:55:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-1f26455f-2dde-4ad6-b5c0-4cb209dfa6db tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.391s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-93753093-1b30-413c-b021-9370585af4f9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.163s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:40 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-93753093-1b30-413c-b021-9370585af4f9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1858058230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0993e8b5-19a7-4a6a-87b7-4cf170c9f7c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7907a064637641e0b91c7cad9306dd24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:37Z,use_quota=True,user_id='56c43773ce504261baad25122f910bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:55:40 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-93753093-1b30-413c-b021-9370585af4f9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Creating volume 0993e8b5-19a7-4a6a-87b7-4cf170c9f7c7 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:55:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-93753093-1b30-413c-b021-9370585af4f9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-93753093-1b30-413c-b021-9370585af4f9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:40 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-93753093-1b30-413c-b021-9370585af4f9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:55:40 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-93753093-1b30-413c-b021-9370585af4f9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:55:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-93753093-1b30-413c-b021-9370585af4f9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:40 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-93753093-1b30-413c-b021-9370585af4f9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:55:40 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-93753093-1b30-413c-b021-9370585af4f9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:55:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-93753093-1b30-413c-b021-9370585af4f9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0993e8b5-19a7-4a6a-87b7-4cf170c9f7c7 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:40 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-1f26455f-2dde-4ad6-b5c0-4cb209dfa6db tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d74a6f37-8bc0-4634-bf07-a74f81ad2864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8ad2e02-419a-4609-9ed7-382b32d40860', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-1f26455f-2dde-4ad6-b5c0-4cb209dfa6db tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e739a6-f1e3-4f65-972b-2f8f08396ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:40 devstack sudo[105582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0993e8b5-19a7-4a6a-87b7-4cf170c9f7c7 1073741824 Jul 31 10:55:40 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-57e4b79a-1616-455a-88b1-52757de5e49c tempest-VolumesSnapshotListTestJSON-1057808077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84.cbc8c566-7acb-4223-ac6b-7d217c7e53f0" returned: 0 in 0.515s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:40 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-1f26455f-2dde-4ad6-b5c0-4cb209dfa6db tempest-CreateVolumesFromSnapshotTest-1820093262 None] Volume volume-e8ad2e02-419a-4609-9ed7-382b32d40860 (e8ad2e02-419a-4609-9ed7-382b32d40860): created successfully Jul 31 10:55:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-1f26455f-2dde-4ad6-b5c0-4cb209dfa6db tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e739a6-f1e3-4f65-972b-2f8f08396ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-1f26455f-2dde-4ad6-b5c0-4cb209dfa6db tempest-CreateVolumesFromSnapshotTest-1820093262 None] Flow 'volume_create_manager' (e0f55b6a-3184-4112-af61-9cb36041d625) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:40 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-1f26455f-2dde-4ad6-b5c0-4cb209dfa6db tempest-CreateVolumesFromSnapshotTest-1820093262 None] Created volume successfully. Jul 31 10:55:40 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-57e4b79a-1616-455a-88b1-52757de5e49c tempest-VolumesSnapshotListTestJSON-1057808077 None] Lock "cinder-quobyte-cbc8c566-7acb-4223-ac6b-7d217c7e53f0" released by "_delete_snapshot" :: held 2.505s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:40 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-57e4b79a-1616-455a-88b1-52757de5e49c tempest-VolumesSnapshotListTestJSON-1057808077 None] Lock "cinder-quobyte-3b112411-a782-430d-9605-bbfef0a21c84" released by "delete_snapshot" :: held 2.557s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:40 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-57e4b79a-1616-455a-88b1-52757de5e49c tempest-VolumesSnapshotListTestJSON-1057808077 None] Created reservations ['0d9f9ef5-b996-42e8-a632-5fbc365906fa', '02c4fb31-c92a-4ba2-b2bf-8e12c4b17ddc', '849fa001-c053-465f-9dca-64afe1491caf', '31e1bc27-5b00-4d0d-9629-ae2dd9a74700'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:55:40 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-57e4b79a-1616-455a-88b1-52757de5e49c tempest-VolumesSnapshotListTestJSON-1057808077 None] Delete snapshot completed successfully. Jul 31 10:55:40 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-57e4b79a-1616-455a-88b1-52757de5e49c tempest-VolumesSnapshotListTestJSON-1057808077 None] Lock "cinder-cbc8c566-7acb-4223-ac6b-7d217c7e53f0-delete_snapshot" released by "delete_snapshot" :: held 2.842s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:40 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-93753093-1b30-413c-b021-9370585af4f9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0993e8b5-19a7-4a6a-87b7-4cf170c9f7c7 1073741824" returned: 0 in 0.653s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-93753093-1b30-413c-b021-9370585af4f9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0993e8b5-19a7-4a6a-87b7-4cf170c9f7c7 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:40 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0993e8b5-19a7-4a6a-87b7-4cf170c9f7c7 Jul 31 10:55:40 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:41 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:41 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-541673f7-ca7a-4f33-82fb-d45b9097f2d5 tempest-VolumesSnapshotListTestJSON-1057808077 None] Acquiring lock "cinder-3b112411-a782-430d-9605-bbfef0a21c84-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-93753093-1b30-413c-b021-9370585af4f9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0993e8b5-19a7-4a6a-87b7-4cf170c9f7c7" returned: 0 in 0.384s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:41 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-93753093-1b30-413c-b021-9370585af4f9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:55:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-93753093-1b30-413c-b021-9370585af4f9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:41 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-541673f7-ca7a-4f33-82fb-d45b9097f2d5 tempest-VolumesSnapshotListTestJSON-1057808077 None] Lock "cinder-3b112411-a782-430d-9605-bbfef0a21c84-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:41 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-93753093-1b30-413c-b021-9370585af4f9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3df47f21-208a-4dac-94c2-3ba2bde7820e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0993e8b5-19a7-4a6a-87b7-4cf170c9f7c7', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:41 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-93753093-1b30-413c-b021-9370585af4f9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d186a58e-9715-412a-a03d-b9538cd73513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:41 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-541673f7-ca7a-4f33-82fb-d45b9097f2d5 tempest-VolumesSnapshotListTestJSON-1057808077 None] Acquiring lock "cinder-quobyte-3b112411-a782-430d-9605-bbfef0a21c84" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:41 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-541673f7-ca7a-4f33-82fb-d45b9097f2d5 tempest-VolumesSnapshotListTestJSON-1057808077 None] Lock "cinder-quobyte-3b112411-a782-430d-9605-bbfef0a21c84" acquired by "delete_volume" :: waited 0.025s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:41 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-93753093-1b30-413c-b021-9370585af4f9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Volume volume-0993e8b5-19a7-4a6a-87b7-4cf170c9f7c7 (0993e8b5-19a7-4a6a-87b7-4cf170c9f7c7): created successfully Jul 31 10:55:41 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-93753093-1b30-413c-b021-9370585af4f9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d186a58e-9715-412a-a03d-b9538cd73513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:41 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-93753093-1b30-413c-b021-9370585af4f9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Flow 'volume_create_manager' (674728fa-e3d3-49ea-99c2-185b036d601c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:41 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b55b18-d173-4438-bbab-8ec9b8fe3e12]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-541673f7-ca7a-4f33-82fb-d45b9097f2d5 tempest-VolumesSnapshotListTestJSON-1057808077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:41 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-93753093-1b30-413c-b021-9370585af4f9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Created volume successfully. Jul 31 10:55:41 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84 Jul 31 10:55:41 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:41 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-541673f7-ca7a-4f33-82fb-d45b9097f2d5 tempest-VolumesSnapshotListTestJSON-1057808077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84" returned: 0 in 0.447s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-541673f7-ca7a-4f33-82fb-d45b9097f2d5 tempest-VolumesSnapshotListTestJSON-1057808077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:41 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84 Jul 31 10:55:41 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:42 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-541673f7-ca7a-4f33-82fb-d45b9097f2d5 tempest-VolumesSnapshotListTestJSON-1057808077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3b112411-a782-430d-9605-bbfef0a21c84" returned: 0 in 0.262s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:42 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-541673f7-ca7a-4f33-82fb-d45b9097f2d5 tempest-VolumesSnapshotListTestJSON-1057808077 None] Lock "cinder-quobyte-3b112411-a782-430d-9605-bbfef0a21c84" released by "delete_volume" :: held 0.806s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:42 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-541673f7-ca7a-4f33-82fb-d45b9097f2d5 tempest-VolumesSnapshotListTestJSON-1057808077 None] Created reservations ['f778bd39-f1ed-453c-9223-c4703889e492', '684b18d9-d260-47a5-84c9-9b9bf68bd5c6', 'b3d4bed9-7496-41ce-bc15-b51d47935605', '68072f42-263f-4701-bd6d-9992771a6436'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:55:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-541673f7-ca7a-4f33-82fb-d45b9097f2d5 tempest-VolumesSnapshotListTestJSON-1057808077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-541673f7-ca7a-4f33-82fb-d45b9097f2d5 tempest-VolumesSnapshotListTestJSON-1057808077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:42 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-541673f7-ca7a-4f33-82fb-d45b9097f2d5 tempest-VolumesSnapshotListTestJSON-1057808077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:55:42 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-541673f7-ca7a-4f33-82fb-d45b9097f2d5 tempest-VolumesSnapshotListTestJSON-1057808077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:55:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-541673f7-ca7a-4f33-82fb-d45b9097f2d5 tempest-VolumesSnapshotListTestJSON-1057808077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-541673f7-ca7a-4f33-82fb-d45b9097f2d5 tempest-VolumesSnapshotListTestJSON-1057808077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:42 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:55:42 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:42 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-dd519f97-ccc0-4cd0-9ea3-88e982adbd83 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Acquiring lock "cinder-0993e8b5-19a7-4a6a-87b7-4cf170c9f7c7-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:42 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-dd519f97-ccc0-4cd0-9ea3-88e982adbd83 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "cinder-0993e8b5-19a7-4a6a-87b7-4cf170c9f7c7-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:42 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-541673f7-ca7a-4f33-82fb-d45b9097f2d5 tempest-VolumesSnapshotListTestJSON-1057808077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.404s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:42 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-541673f7-ca7a-4f33-82fb-d45b9097f2d5 tempest-VolumesSnapshotListTestJSON-1057808077 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:55:42 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-dd519f97-ccc0-4cd0-9ea3-88e982adbd83 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Acquiring lock "cinder-quobyte-0993e8b5-19a7-4a6a-87b7-4cf170c9f7c7" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:42 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-541673f7-ca7a-4f33-82fb-d45b9097f2d5 tempest-VolumesSnapshotListTestJSON-1057808077 None] Deleted volume successfully. Jul 31 10:55:42 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-dd519f97-ccc0-4cd0-9ea3-88e982adbd83 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "cinder-quobyte-0993e8b5-19a7-4a6a-87b7-4cf170c9f7c7" acquired by "delete_volume" :: waited 0.033s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:42 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-541673f7-ca7a-4f33-82fb-d45b9097f2d5 tempest-VolumesSnapshotListTestJSON-1057808077 None] Lock "cinder-3b112411-a782-430d-9605-bbfef0a21c84-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:42 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d1c74d-9b19-4222-8c13-e4447f2435a0]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dd519f97-ccc0-4cd0-9ea3-88e982adbd83 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0993e8b5-19a7-4a6a-87b7-4cf170c9f7c7 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:42 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0993e8b5-19a7-4a6a-87b7-4cf170c9f7c7 Jul 31 10:55:42 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:43 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dd519f97-ccc0-4cd0-9ea3-88e982adbd83 tempest-CreateVolumesFromSnapshotTest-1820093262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0993e8b5-19a7-4a6a-87b7-4cf170c9f7c7" returned: 0 in 0.454s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dd519f97-ccc0-4cd0-9ea3-88e982adbd83 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0993e8b5-19a7-4a6a-87b7-4cf170c9f7c7 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:43 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0993e8b5-19a7-4a6a-87b7-4cf170c9f7c7 Jul 31 10:55:43 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:43 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dd519f97-ccc0-4cd0-9ea3-88e982adbd83 tempest-CreateVolumesFromSnapshotTest-1820093262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0993e8b5-19a7-4a6a-87b7-4cf170c9f7c7" returned: 0 in 0.320s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:43 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-dd519f97-ccc0-4cd0-9ea3-88e982adbd83 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "cinder-quobyte-0993e8b5-19a7-4a6a-87b7-4cf170c9f7c7" released by "delete_volume" :: held 0.838s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:43 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-dd519f97-ccc0-4cd0-9ea3-88e982adbd83 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Created reservations ['b7d8c9eb-c83a-472f-82b5-8dd739acf80c', 'a438d2c4-e0e4-4422-af5b-66796a1aad81', 'db3f5c70-b952-46be-adeb-8003ee36fdba', '7c66228d-9f7b-4592-8606-448841b78285'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:55:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-dd519f97-ccc0-4cd0-9ea3-88e982adbd83 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-dd519f97-ccc0-4cd0-9ea3-88e982adbd83 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:43 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-dd519f97-ccc0-4cd0-9ea3-88e982adbd83 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:55:43 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-dd519f97-ccc0-4cd0-9ea3-88e982adbd83 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:55:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-dd519f97-ccc0-4cd0-9ea3-88e982adbd83 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dd519f97-ccc0-4cd0-9ea3-88e982adbd83 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:43 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:55:43 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:43 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6243bf6a-7e04-4246-b504-2cec94571faa tempest-CreateVolumesFromSnapshotTest-1820093262 None] Acquiring lock "cinder-e8ad2e02-419a-4609-9ed7-382b32d40860-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:43 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6243bf6a-7e04-4246-b504-2cec94571faa tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "cinder-e8ad2e02-419a-4609-9ed7-382b32d40860-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:44 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6243bf6a-7e04-4246-b504-2cec94571faa tempest-CreateVolumesFromSnapshotTest-1820093262 None] Acquiring lock "cinder-quobyte-e8ad2e02-419a-4609-9ed7-382b32d40860" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:44 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6243bf6a-7e04-4246-b504-2cec94571faa tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "cinder-quobyte-e8ad2e02-419a-4609-9ed7-382b32d40860" acquired by "delete_volume" :: waited 0.020s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:44 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3756fe1-ac39-4d9c-b56d-e0ed623d2a8b]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6243bf6a-7e04-4246-b504-2cec94571faa tempest-CreateVolumesFromSnapshotTest-1820093262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e8ad2e02-419a-4609-9ed7-382b32d40860 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:44 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dd519f97-ccc0-4cd0-9ea3-88e982adbd83 tempest-CreateVolumesFromSnapshotTest-1820093262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.419s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:44 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-dd519f97-ccc0-4cd0-9ea3-88e982adbd83 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:55:44 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-dd519f97-ccc0-4cd0-9ea3-88e982adbd83 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Deleted volume successfully. Jul 31 10:55:44 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e8ad2e02-419a-4609-9ed7-382b32d40860 Jul 31 10:55:44 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:44 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-dd519f97-ccc0-4cd0-9ea3-88e982adbd83 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "cinder-0993e8b5-19a7-4a6a-87b7-4cf170c9f7c7-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:44 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6243bf6a-7e04-4246-b504-2cec94571faa tempest-CreateVolumesFromSnapshotTest-1820093262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e8ad2e02-419a-4609-9ed7-382b32d40860" returned: 0 in 0.501s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6243bf6a-7e04-4246-b504-2cec94571faa tempest-CreateVolumesFromSnapshotTest-1820093262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e8ad2e02-419a-4609-9ed7-382b32d40860 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:44 devstack sudo[105621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e8ad2e02-419a-4609-9ed7-382b32d40860 Jul 31 10:55:44 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:45 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6243bf6a-7e04-4246-b504-2cec94571faa tempest-CreateVolumesFromSnapshotTest-1820093262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e8ad2e02-419a-4609-9ed7-382b32d40860" returned: 0 in 0.367s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:45 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6243bf6a-7e04-4246-b504-2cec94571faa tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "cinder-quobyte-e8ad2e02-419a-4609-9ed7-382b32d40860" released by "delete_volume" :: held 0.936s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:45 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-6243bf6a-7e04-4246-b504-2cec94571faa tempest-CreateVolumesFromSnapshotTest-1820093262 None] Created reservations ['cf7a10c3-6360-4949-a8fa-8f3c88797507', 'f16ff544-dafa-4547-929e-8ce0a1818c7b', 'a318ed8c-885e-41c1-91e8-4875ac83bf7b', 'd0b2c701-86cc-41e2-ace6-fad66d0a2082'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:55:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6243bf6a-7e04-4246-b504-2cec94571faa tempest-CreateVolumesFromSnapshotTest-1820093262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6243bf6a-7e04-4246-b504-2cec94571faa tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-6243bf6a-7e04-4246-b504-2cec94571faa tempest-CreateVolumesFromSnapshotTest-1820093262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:55:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-6243bf6a-7e04-4246-b504-2cec94571faa tempest-CreateVolumesFromSnapshotTest-1820093262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:55:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6243bf6a-7e04-4246-b504-2cec94571faa tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6243bf6a-7e04-4246-b504-2cec94571faa tempest-CreateVolumesFromSnapshotTest-1820093262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:45 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:55:45 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:45 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6243bf6a-7e04-4246-b504-2cec94571faa tempest-CreateVolumesFromSnapshotTest-1820093262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.348s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:45 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-6243bf6a-7e04-4246-b504-2cec94571faa tempest-CreateVolumesFromSnapshotTest-1820093262 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:55:45 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-6243bf6a-7e04-4246-b504-2cec94571faa tempest-CreateVolumesFromSnapshotTest-1820093262 None] Deleted volume successfully. Jul 31 10:55:45 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6243bf6a-7e04-4246-b504-2cec94571faa tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "cinder-e8ad2e02-419a-4609-9ed7-382b32d40860-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:45 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:55:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:55:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:55:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:46 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:55:46 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:46 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.284s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:46 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:55:46 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager._thread_info {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:55:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread count: 28 {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:55:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread info: [<_MainThread(MainThread, started 134005426110592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:55:46 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9486e213-8bdf-4a49-842d-314d549b7acb tempest-CreateVolumesFromSnapshotTest-1820093262 None] Acquiring lock "cinder-f7af0e29-4d01-49ed-9a10-b30b6772e9e2-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:46 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9486e213-8bdf-4a49-842d-314d549b7acb tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "cinder-f7af0e29-4d01-49ed-9a10-b30b6772e9e2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:46 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9486e213-8bdf-4a49-842d-314d549b7acb tempest-CreateVolumesFromSnapshotTest-1820093262 None] Acquiring lock "cinder-quobyte-f7af0e29-4d01-49ed-9a10-b30b6772e9e2" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:46 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9486e213-8bdf-4a49-842d-314d549b7acb tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "cinder-quobyte-f7af0e29-4d01-49ed-9a10-b30b6772e9e2" acquired by "delete_volume" :: waited 0.019s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:46 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a522ff-a32a-4d9b-b256-fac08700d218]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9486e213-8bdf-4a49-842d-314d549b7acb tempest-CreateVolumesFromSnapshotTest-1820093262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f7af0e29-4d01-49ed-9a10-b30b6772e9e2 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:46 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f7af0e29-4d01-49ed-9a10-b30b6772e9e2 Jul 31 10:55:46 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:46 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9486e213-8bdf-4a49-842d-314d549b7acb tempest-CreateVolumesFromSnapshotTest-1820093262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f7af0e29-4d01-49ed-9a10-b30b6772e9e2" returned: 0 in 0.437s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9486e213-8bdf-4a49-842d-314d549b7acb tempest-CreateVolumesFromSnapshotTest-1820093262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f7af0e29-4d01-49ed-9a10-b30b6772e9e2 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:46 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f7af0e29-4d01-49ed-9a10-b30b6772e9e2 Jul 31 10:55:46 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:47 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9486e213-8bdf-4a49-842d-314d549b7acb tempest-CreateVolumesFromSnapshotTest-1820093262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f7af0e29-4d01-49ed-9a10-b30b6772e9e2" returned: 0 in 0.309s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:47 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9486e213-8bdf-4a49-842d-314d549b7acb tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "cinder-quobyte-f7af0e29-4d01-49ed-9a10-b30b6772e9e2" released by "delete_volume" :: held 0.813s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:47 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-9486e213-8bdf-4a49-842d-314d549b7acb tempest-CreateVolumesFromSnapshotTest-1820093262 None] Created reservations ['c205b211-c3ad-4e8f-a733-0dd40891b811', '1833f47a-af68-447d-9fed-f4f1fcb944de', '5abf11ae-83cd-40bc-8e9a-1a65ec5de516', '3012638e-71e8-493b-b7c1-6e89df3a816e'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:55:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9486e213-8bdf-4a49-842d-314d549b7acb tempest-CreateVolumesFromSnapshotTest-1820093262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9486e213-8bdf-4a49-842d-314d549b7acb tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:47 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-9486e213-8bdf-4a49-842d-314d549b7acb tempest-CreateVolumesFromSnapshotTest-1820093262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:55:47 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-9486e213-8bdf-4a49-842d-314d549b7acb tempest-CreateVolumesFromSnapshotTest-1820093262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:55:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9486e213-8bdf-4a49-842d-314d549b7acb tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9486e213-8bdf-4a49-842d-314d549b7acb tempest-CreateVolumesFromSnapshotTest-1820093262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:47 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:55:47 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:47 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-b30f9e13-a941-4172-899f-815e599da3cb tempest-CreateVolumesFromSnapshotTest-1820093262 None] Acquiring lock "cinder-85d3f2e4-c477-4517-b75c-57e39bf98a39-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:47 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-b30f9e13-a941-4172-899f-815e599da3cb tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "cinder-85d3f2e4-c477-4517-b75c-57e39bf98a39-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:47 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-b30f9e13-a941-4172-899f-815e599da3cb tempest-CreateVolumesFromSnapshotTest-1820093262 None] Acquiring lock "cinder-quobyte-85d3f2e4-c477-4517-b75c-57e39bf98a39" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:47 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-b30f9e13-a941-4172-899f-815e599da3cb tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "cinder-quobyte-85d3f2e4-c477-4517-b75c-57e39bf98a39" acquired by "delete_volume" :: waited 0.019s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:47 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[13929e30-c910-41a6-9d77-3ed51c328e57]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b30f9e13-a941-4172-899f-815e599da3cb tempest-CreateVolumesFromSnapshotTest-1820093262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-85d3f2e4-c477-4517-b75c-57e39bf98a39 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:47 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9486e213-8bdf-4a49-842d-314d549b7acb tempest-CreateVolumesFromSnapshotTest-1820093262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.337s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:47 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-9486e213-8bdf-4a49-842d-314d549b7acb tempest-CreateVolumesFromSnapshotTest-1820093262 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:55:47 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-9486e213-8bdf-4a49-842d-314d549b7acb tempest-CreateVolumesFromSnapshotTest-1820093262 None] Deleted volume successfully. Jul 31 10:55:47 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9486e213-8bdf-4a49-842d-314d549b7acb tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "cinder-f7af0e29-4d01-49ed-9a10-b30b6772e9e2-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:47 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-85d3f2e4-c477-4517-b75c-57e39bf98a39 Jul 31 10:55:47 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:48 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b30f9e13-a941-4172-899f-815e599da3cb tempest-CreateVolumesFromSnapshotTest-1820093262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-85d3f2e4-c477-4517-b75c-57e39bf98a39" returned: 0 in 0.560s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b30f9e13-a941-4172-899f-815e599da3cb tempest-CreateVolumesFromSnapshotTest-1820093262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-85d3f2e4-c477-4517-b75c-57e39bf98a39 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:48 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-85d3f2e4-c477-4517-b75c-57e39bf98a39 Jul 31 10:55:48 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:48 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b30f9e13-a941-4172-899f-815e599da3cb tempest-CreateVolumesFromSnapshotTest-1820093262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-85d3f2e4-c477-4517-b75c-57e39bf98a39" returned: 0 in 0.330s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:48 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-b30f9e13-a941-4172-899f-815e599da3cb tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "cinder-quobyte-85d3f2e4-c477-4517-b75c-57e39bf98a39" released by "delete_volume" :: held 0.966s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:48 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-b30f9e13-a941-4172-899f-815e599da3cb tempest-CreateVolumesFromSnapshotTest-1820093262 None] Created reservations ['8046d9c3-6d9b-4dba-abaf-396055bcd738', '549b1cee-85b8-4fb7-863f-ea139b4e4031', '5b601c1b-889c-494f-9afe-9677818369fb', '46374ee2-3c06-4990-a3b6-fed03995366c'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:55:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b30f9e13-a941-4172-899f-815e599da3cb tempest-CreateVolumesFromSnapshotTest-1820093262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b30f9e13-a941-4172-899f-815e599da3cb tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:48 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-b30f9e13-a941-4172-899f-815e599da3cb tempest-CreateVolumesFromSnapshotTest-1820093262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:55:48 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-b30f9e13-a941-4172-899f-815e599da3cb tempest-CreateVolumesFromSnapshotTest-1820093262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:55:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b30f9e13-a941-4172-899f-815e599da3cb tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b30f9e13-a941-4172-899f-815e599da3cb tempest-CreateVolumesFromSnapshotTest-1820093262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:48 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:55:48 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:49 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b30f9e13-a941-4172-899f-815e599da3cb tempest-CreateVolumesFromSnapshotTest-1820093262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.274s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:49 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-b30f9e13-a941-4172-899f-815e599da3cb tempest-CreateVolumesFromSnapshotTest-1820093262 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:55:49 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-b30f9e13-a941-4172-899f-815e599da3cb tempest-CreateVolumesFromSnapshotTest-1820093262 None] Deleted volume successfully. Jul 31 10:55:49 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-b30f9e13-a941-4172-899f-815e599da3cb tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "cinder-85d3f2e4-c477-4517-b75c-57e39bf98a39-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:49 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7b65a9b2-73a4-42fd-bc5b-e73a8c173475 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Acquiring lock "cinder-b96f9d30-3c58-4b45-ae53-a32f3be812aa-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:49 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7b65a9b2-73a4-42fd-bc5b-e73a8c173475 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "cinder-b96f9d30-3c58-4b45-ae53-a32f3be812aa-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:49 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7b65a9b2-73a4-42fd-bc5b-e73a8c173475 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Acquiring lock "cinder-quobyte-b96f9d30-3c58-4b45-ae53-a32f3be812aa" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:49 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7b65a9b2-73a4-42fd-bc5b-e73a8c173475 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "cinder-quobyte-b96f9d30-3c58-4b45-ae53-a32f3be812aa" acquired by "delete_volume" :: waited 0.017s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:50 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aca943e-cba3-413f-aa2d-4fb28db3467a]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7b65a9b2-73a4-42fd-bc5b-e73a8c173475 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b96f9d30-3c58-4b45-ae53-a32f3be812aa {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:50 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b96f9d30-3c58-4b45-ae53-a32f3be812aa Jul 31 10:55:50 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:50 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7b65a9b2-73a4-42fd-bc5b-e73a8c173475 tempest-CreateVolumesFromSnapshotTest-1820093262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b96f9d30-3c58-4b45-ae53-a32f3be812aa" returned: 0 in 0.448s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7b65a9b2-73a4-42fd-bc5b-e73a8c173475 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b96f9d30-3c58-4b45-ae53-a32f3be812aa {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:50 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b96f9d30-3c58-4b45-ae53-a32f3be812aa Jul 31 10:55:50 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:50 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7b65a9b2-73a4-42fd-bc5b-e73a8c173475 tempest-CreateVolumesFromSnapshotTest-1820093262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b96f9d30-3c58-4b45-ae53-a32f3be812aa" returned: 0 in 0.317s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:50 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7b65a9b2-73a4-42fd-bc5b-e73a8c173475 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "cinder-quobyte-b96f9d30-3c58-4b45-ae53-a32f3be812aa" released by "delete_volume" :: held 0.817s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:50 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=155,cinder:UPDATE=200,cinder:INSERT=52,cinder:DELETE=13 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:55:50 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=136,cinder:UPDATE=194,cinder:INSERT=43,cinder:DELETE=23 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:55:50 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-7b65a9b2-73a4-42fd-bc5b-e73a8c173475 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Created reservations ['a48a83f5-1858-4537-835e-af036d8f9c19', 'f0b3aef9-db2a-43e1-83b2-2bfcecb34a0d', 'd2ea8690-beaa-4b56-91cc-077b936524c9', '51cdb78f-d494-4b90-a9f4-9de1869d517f'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:55:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7b65a9b2-73a4-42fd-bc5b-e73a8c173475 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7b65a9b2-73a4-42fd-bc5b-e73a8c173475 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:50 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-7b65a9b2-73a4-42fd-bc5b-e73a8c173475 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:55:51 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-7b65a9b2-73a4-42fd-bc5b-e73a8c173475 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:55:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7b65a9b2-73a4-42fd-bc5b-e73a8c173475 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7b65a9b2-73a4-42fd-bc5b-e73a8c173475 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:51 devstack sudo[105663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:55:51 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:51 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8e2a97db-2e48-41f5-bbcb-bd484b4f98e3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Acquiring lock "cinder-f4f832b3-364e-4e6b-a2bb-d7cac217054f-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:51 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8e2a97db-2e48-41f5-bbcb-bd484b4f98e3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "cinder-f4f832b3-364e-4e6b-a2bb-d7cac217054f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:51 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8e2a97db-2e48-41f5-bbcb-bd484b4f98e3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Acquiring lock "cinder-quobyte-e5cd813d-b339-429a-b1e7-a352fb0af94d" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:51 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8e2a97db-2e48-41f5-bbcb-bd484b4f98e3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "cinder-quobyte-e5cd813d-b339-429a-b1e7-a352fb0af94d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:51 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8e2a97db-2e48-41f5-bbcb-bd484b4f98e3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Acquiring lock "cinder-quobyte-f4f832b3-364e-4e6b-a2bb-d7cac217054f" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:51 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8e2a97db-2e48-41f5-bbcb-bd484b4f98e3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "cinder-quobyte-f4f832b3-364e-4e6b-a2bb-d7cac217054f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:51 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-8e2a97db-2e48-41f5-bbcb-bd484b4f98e3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Deleting offline snapshot f4f832b3-364e-4e6b-a2bb-d7cac217054f of volume e5cd813d-b339-429a-b1e7-a352fb0af94d {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:55:51 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-8e2a97db-2e48-41f5-bbcb-bd484b4f98e3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] snapshot_file for this snap is: volume-e5cd813d-b339-429a-b1e7-a352fb0af94d.f4f832b3-364e-4e6b-a2bb-d7cac217054f {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:55:51 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d2e9e7-d58f-4bec-8f93-03ab28776dd0]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8e2a97db-2e48-41f5-bbcb-bd484b4f98e3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d.f4f832b3-364e-4e6b-a2bb-d7cac217054f {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:51 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7b65a9b2-73a4-42fd-bc5b-e73a8c173475 tempest-CreateVolumesFromSnapshotTest-1820093262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.371s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:51 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-7b65a9b2-73a4-42fd-bc5b-e73a8c173475 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:55:51 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-7b65a9b2-73a4-42fd-bc5b-e73a8c173475 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Deleted volume successfully. Jul 31 10:55:51 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7b65a9b2-73a4-42fd-bc5b-e73a8c173475 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "cinder-b96f9d30-3c58-4b45-ae53-a32f3be812aa-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:51 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d.f4f832b3-364e-4e6b-a2bb-d7cac217054f Jul 31 10:55:51 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:51 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8e2a97db-2e48-41f5-bbcb-bd484b4f98e3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d.f4f832b3-364e-4e6b-a2bb-d7cac217054f" returned: 0 in 0.447s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:51 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-8e2a97db-2e48-41f5-bbcb-bd484b4f98e3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5cd813d-b339-429a-b1e7-a352fb0af94d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:55:51 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfea925-f709-470c-9b29-524438e8e74d]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8e2a97db-2e48-41f5-bbcb-bd484b4f98e3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:51 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d Jul 31 10:55:51 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:52 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8e2a97db-2e48-41f5-bbcb-bd484b4f98e3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d" returned: 0 in 0.419s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8e2a97db-2e48-41f5-bbcb-bd484b4f98e3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d.f4f832b3-364e-4e6b-a2bb-d7cac217054f {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:52 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d.f4f832b3-364e-4e6b-a2bb-d7cac217054f Jul 31 10:55:52 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:52 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8e2a97db-2e48-41f5-bbcb-bd484b4f98e3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d.f4f832b3-364e-4e6b-a2bb-d7cac217054f" returned: 0 in 0.575s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8e2a97db-2e48-41f5-bbcb-bd484b4f98e3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d.f4f832b3-364e-4e6b-a2bb-d7cac217054f {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:52 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d.f4f832b3-364e-4e6b-a2bb-d7cac217054f Jul 31 10:55:52 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:53 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8e2a97db-2e48-41f5-bbcb-bd484b4f98e3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d.f4f832b3-364e-4e6b-a2bb-d7cac217054f" returned: 0 in 0.337s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:53 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8e2a97db-2e48-41f5-bbcb-bd484b4f98e3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "cinder-quobyte-f4f832b3-364e-4e6b-a2bb-d7cac217054f" released by "_delete_snapshot" :: held 1.944s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:53 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8e2a97db-2e48-41f5-bbcb-bd484b4f98e3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "cinder-quobyte-e5cd813d-b339-429a-b1e7-a352fb0af94d" released by "delete_snapshot" :: held 1.975s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:53 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-8e2a97db-2e48-41f5-bbcb-bd484b4f98e3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Created reservations ['2739c21a-4b25-499a-b4b3-e9d328dc4676', '26c7927e-101f-4a27-aaf4-05dafbdd9dc0', 'dbc8821e-64ee-4f6e-aafc-a49e0c153e5f', 'f7ddf992-9c7a-4575-bfbe-60dfe7cd82c1'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:55:53 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-8e2a97db-2e48-41f5-bbcb-bd484b4f98e3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Delete snapshot completed successfully. Jul 31 10:55:53 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8e2a97db-2e48-41f5-bbcb-bd484b4f98e3 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "cinder-f4f832b3-364e-4e6b-a2bb-d7cac217054f-delete_snapshot" released by "delete_snapshot" :: held 2.234s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:54 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8450a6dd-afe4-46ee-9a02-9e5e2995a0c9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Acquiring lock "cinder-e5cd813d-b339-429a-b1e7-a352fb0af94d-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:54 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8450a6dd-afe4-46ee-9a02-9e5e2995a0c9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "cinder-e5cd813d-b339-429a-b1e7-a352fb0af94d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:54 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8450a6dd-afe4-46ee-9a02-9e5e2995a0c9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Acquiring lock "cinder-quobyte-e5cd813d-b339-429a-b1e7-a352fb0af94d" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:54 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8450a6dd-afe4-46ee-9a02-9e5e2995a0c9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "cinder-quobyte-e5cd813d-b339-429a-b1e7-a352fb0af94d" acquired by "delete_volume" :: waited 0.020s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:54 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4af6aa5-2d07-4e43-b760-ccf037659cac]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8450a6dd-afe4-46ee-9a02-9e5e2995a0c9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:54 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d Jul 31 10:55:54 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:55 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8450a6dd-afe4-46ee-9a02-9e5e2995a0c9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d" returned: 0 in 0.475s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8450a6dd-afe4-46ee-9a02-9e5e2995a0c9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:55 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d Jul 31 10:55:55 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:55 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8450a6dd-afe4-46ee-9a02-9e5e2995a0c9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e5cd813d-b339-429a-b1e7-a352fb0af94d" returned: 0 in 0.345s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:55 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8450a6dd-afe4-46ee-9a02-9e5e2995a0c9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "cinder-quobyte-e5cd813d-b339-429a-b1e7-a352fb0af94d" released by "delete_volume" :: held 0.891s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:55 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-8450a6dd-afe4-46ee-9a02-9e5e2995a0c9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Created reservations ['82ccf406-ff8b-4fde-8489-08066810c3a1', 'b279c078-6b31-46d9-97ad-63ccf464c638', '56749ffd-167d-4afa-9fb3-0efcc3c1b326', '97979bd8-3776-4e72-9d6b-e930b4b1ed0a'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:55:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8450a6dd-afe4-46ee-9a02-9e5e2995a0c9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8450a6dd-afe4-46ee-9a02-9e5e2995a0c9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:55 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-8450a6dd-afe4-46ee-9a02-9e5e2995a0c9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:55:55 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-8450a6dd-afe4-46ee-9a02-9e5e2995a0c9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:55:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8450a6dd-afe4-46ee-9a02-9e5e2995a0c9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8450a6dd-afe4-46ee-9a02-9e5e2995a0c9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:55 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:55:55 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:55 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8450a6dd-afe4-46ee-9a02-9e5e2995a0c9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.332s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:55 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-8450a6dd-afe4-46ee-9a02-9e5e2995a0c9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:55:55 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-8450a6dd-afe4-46ee-9a02-9e5e2995a0c9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Deleted volume successfully. Jul 31 10:55:55 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8450a6dd-afe4-46ee-9a02-9e5e2995a0c9 tempest-CreateVolumesFromSnapshotTest-1820093262 None] Lock "cinder-e5cd813d-b339-429a-b1e7-a352fb0af94d-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:02 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:56:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Flow 'volume_create_manager' (9f666076-2e11-4358-85c5-0e6c08dc11d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a41b4f4-d8fe-410d-9b4a-16cede6a3280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a41b4f4-d8fe-410d-9b4a-16cede6a3280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa4046d6-ff7b-4015-8a0d-11178cc8f072,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72030b8a20134cdbb1a066871acdf3b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:02Z,use_quota=True,user_id='0308626e4b424a6fb102f600af394420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b58b6027-2db3-4e5f-94e6-8e140f5dbae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b58b6027-2db3-4e5f-94e6-8e140f5dbae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6034654-c2a0-493c-969e-d5fe2b23e8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:02 devstack cinder-volume[89090]: DEBUG cinder.image.glance [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Creating Keystone auth plugin from conf {{(pid=89090) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 10:56:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6034654-c2a0-493c-969e-d5fe2b23e8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'aa4046d6-ff7b-4015-8a0d-11178cc8f072', 'volume_name': 'volume-aa4046d6-ff7b-4015-8a0d-11178cc8f072', 'volume_size': 1, 'image_id': '9665b66b-58f2-431d-af6f-e87c9a099bdd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9665b66b-58f2-431d-af6f-e87c9a099bdd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '972b7fe41275e96e8852caacba68d173', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '72030b8a20134cdbb1a066871acdf3b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '241ddb186f3b54b366a4bc468b0f32e1de9ca48b18e4a5bcf6d775ef81f1335fa84b4f5be8bad46af3d1c0bb850160a2981971a4c0e6414897c8486ad79bc2cf', 'id': '9665b66b-58f2-431d-af6f-e87c9a099bdd', 'created_at': datetime.datetime(2026, 7, 31, 8, 55, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 56, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9665b66b-58f2-431d-af6f-e87c9a099bdd/file', 'properties': {}}, 'image_service': }' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d58e765a-b3af-4daf-870d-21f0414a7e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d58e765a-b3af-4daf-870d-21f0414a7e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89d35e6f-a9ad-4059-a0a4-14d73b6bf1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:02 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Volume aa4046d6-ff7b-4015-8a0d-11178cc8f072: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-aa4046d6-ff7b-4015-8a0d-11178cc8f072', 'volume_size': 1, 'image_id': '9665b66b-58f2-431d-af6f-e87c9a099bdd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9665b66b-58f2-431d-af6f-e87c9a099bdd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '972b7fe41275e96e8852caacba68d173', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '72030b8a20134cdbb1a066871acdf3b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '241ddb186f3b54b366a4bc468b0f32e1de9ca48b18e4a5bcf6d775ef81f1335fa84b4f5be8bad46af3d1c0bb850160a2981971a4c0e6414897c8486ad79bc2cf', 'id': '9665b66b-58f2-431d-af6f-e87c9a099bdd', 'created_at': datetime.datetime(2026, 7, 31, 8, 55, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 56, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9665b66b-58f2-431d-af6f-e87c9a099bdd/file', 'properties': {}}, 'image_service': } Jul 31 10:56:02 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Trying to clone aa4046d6-ff7b-4015-8a0d-11178cc8f072 from image 9665b66b-58f2-431d-af6f-e87c9a099bdd at location (None, [{'url': 'file:///opt/stack/data/glance/images/9665b66b-58f2-431d-af6f-e87c9a099bdd', 'metadata': {}}]). {{(pid=89090) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 10:56:02 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9665b66b-58f2-431d-af6f-e87c9a099bdd_yxq8kuzadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89090) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 10:56:02 devstack cinder-volume[89090]: INFO cinder.image.image_utils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Image download 0.00 MB at 0.00 MB/s Jul 31 10:56:02 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1018e9b-0d37-4556-a947-86b343647976]: (4, 'raw') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9665b66b-58f2-431d-af6f-e87c9a099bdd_yxq8kuzadevstack@QuobyteHD {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:02 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9665b66b-58f2-431d-af6f-e87c9a099bdd_yxq8kuzadevstack@QuobyteHD Jul 31 10:56:02 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:03 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9665b66b-58f2-431d-af6f-e87c9a099bdd_yxq8kuzadevstack@QuobyteHD" returned: 0 in 0.429s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9665b66b-58f2-431d-af6f-e87c9a099bdd_yxq8kuzadevstack@QuobyteHD {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:03 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9665b66b-58f2-431d-af6f-e87c9a099bdd_yxq8kuzadevstack@QuobyteHD Jul 31 10:56:03 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:03 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9665b66b-58f2-431d-af6f-e87c9a099bdd_yxq8kuzadevstack@QuobyteHD" returned: 1 in 0.399s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9665b66b-58f2-431d-af6f-e87c9a099bdd_yxq8kuzadevstack@QuobyteHD' failed. Not Retrying. {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 10:56:03 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Temporary image 9665b66b-58f2-431d-af6f-e87c9a099bdd is fetched for user 0308626e4b424a6fb102f600af394420. {{(pid=89090) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 10:56:03 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[a176b79d-23c8-4657-ae0f-0964aeccdf6b]: (4, 'raw') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9665b66b-58f2-431d-af6f-e87c9a099bdd_yxq8kuzadevstack@QuobyteHD {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:03 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9665b66b-58f2-431d-af6f-e87c9a099bdd_yxq8kuzadevstack@QuobyteHD Jul 31 10:56:03 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:04 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9665b66b-58f2-431d-af6f-e87c9a099bdd_yxq8kuzadevstack@QuobyteHD" returned: 0 in 0.479s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9665b66b-58f2-431d-af6f-e87c9a099bdd_yxq8kuzadevstack@QuobyteHD {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:04 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9665b66b-58f2-431d-af6f-e87c9a099bdd_yxq8kuzadevstack@QuobyteHD Jul 31 10:56:04 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:04 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9665b66b-58f2-431d-af6f-e87c9a099bdd_yxq8kuzadevstack@QuobyteHD" returned: 1 in 0.379s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9665b66b-58f2-431d-af6f-e87c9a099bdd_yxq8kuzadevstack@QuobyteHD' failed. Not Retrying. {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 10:56:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa4046d6-ff7b-4015-8a0d-11178cc8f072,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72030b8a20134cdbb1a066871acdf3b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:02Z,use_quota=True,user_id='0308626e4b424a6fb102f600af394420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:56:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Creating volume aa4046d6-ff7b-4015-8a0d-11178cc8f072 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:56:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:56:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:56:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:56:04 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:56:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aa4046d6-ff7b-4015-8a0d-11178cc8f072 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:04 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aa4046d6-ff7b-4015-8a0d-11178cc8f072 1073741824 Jul 31 10:56:04 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:05 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aa4046d6-ff7b-4015-8a0d-11178cc8f072 1073741824" returned: 0 in 0.496s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aa4046d6-ff7b-4015-8a0d-11178cc8f072 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:05 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aa4046d6-ff7b-4015-8a0d-11178cc8f072 Jul 31 10:56:05 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:05 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aa4046d6-ff7b-4015-8a0d-11178cc8f072" returned: 0 in 0.256s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:05 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:56:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:05 devstack cinder-volume[89090]: DEBUG cinder.volume.volume_utils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Attempting download of 9665b66b-58f2-431d-af6f-e87c9a099bdd ((None, [{'url': 'file:///opt/stack/data/glance/images/9665b66b-58f2-431d-af6f-e87c9a099bdd', 'metadata': {}}])) to volume aa4046d6-ff7b-4015-8a0d-11178cc8f072. {{(pid=89090) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 10:56:05 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70573ae-43eb-4d21-a172-8092063e8b9a]: (4, 'raw') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9665b66b-58f2-431d-af6f-e87c9a099bdd_t8qxqi49 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:05 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9665b66b-58f2-431d-af6f-e87c9a099bdd_t8qxqi49 Jul 31 10:56:05 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:05 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9665b66b-58f2-431d-af6f-e87c9a099bdd_t8qxqi49" returned: 0 in 0.466s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9665b66b-58f2-431d-af6f-e87c9a099bdd_t8qxqi49 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:06 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9665b66b-58f2-431d-af6f-e87c9a099bdd_t8qxqi49 Jul 31 10:56:06 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:06 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9665b66b-58f2-431d-af6f-e87c9a099bdd_t8qxqi49" returned: 1 in 0.433s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9665b66b-58f2-431d-af6f-e87c9a099bdd_t8qxqi49' failed. Not Retrying. {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 10:56:06 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[5358e16b-801c-418d-9d4b-1fbc5aaeb0d2]: (4, 'raw') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9665b66b-58f2-431d-af6f-e87c9a099bdd_yxq8kuzadevstack@QuobyteHD {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:06 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9665b66b-58f2-431d-af6f-e87c9a099bdd_yxq8kuzadevstack@QuobyteHD Jul 31 10:56:06 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:06 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9665b66b-58f2-431d-af6f-e87c9a099bdd_yxq8kuzadevstack@QuobyteHD" returned: 0 in 0.403s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9665b66b-58f2-431d-af6f-e87c9a099bdd_yxq8kuzadevstack@QuobyteHD {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:06 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9665b66b-58f2-431d-af6f-e87c9a099bdd_yxq8kuzadevstack@QuobyteHD Jul 31 10:56:06 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:07 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9665b66b-58f2-431d-af6f-e87c9a099bdd_yxq8kuzadevstack@QuobyteHD" returned: 1 in 0.442s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9665b66b-58f2-431d-af6f-e87c9a099bdd_yxq8kuzadevstack@QuobyteHD' failed. Not Retrying. {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 10:56:07 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] 9665b66b-58f2-431d-af6f-e87c9a099bdd was raw, converting to qcow2 {{(pid=89090) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 10:56:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9665b66b-58f2-431d-af6f-e87c9a099bdd_yxq8kuzadevstack@QuobyteHD /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aa4046d6-ff7b-4015-8a0d-11178cc8f072 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:07 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9665b66b-58f2-431d-af6f-e87c9a099bdd_yxq8kuzadevstack@QuobyteHD /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aa4046d6-ff7b-4015-8a0d-11178cc8f072 Jul 31 10:56:07 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:07 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9665b66b-58f2-431d-af6f-e87c9a099bdd_yxq8kuzadevstack@QuobyteHD /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aa4046d6-ff7b-4015-8a0d-11178cc8f072" returned: 0 in 0.712s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:07 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9665b66b-58f2-431d-af6f-e87c9a099bdd_yxq8kuzadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aa4046d6-ff7b-4015-8a0d-11178cc8f072 {{(pid=89090) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 10:56:07 devstack cinder-volume[89090]: INFO cinder.image.image_utils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Converted 0.00 MB image at 0.00 MB/s Jul 31 10:56:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aa4046d6-ff7b-4015-8a0d-11178cc8f072 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:08 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aa4046d6-ff7b-4015-8a0d-11178cc8f072 1G Jul 31 10:56:08 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:08 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aa4046d6-ff7b-4015-8a0d-11178cc8f072 1G" returned: 0 in 0.502s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:08 devstack cinder-volume[89090]: DEBUG cinder.volume.volume_utils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Downloaded image 9665b66b-58f2-431d-af6f-e87c9a099bdd ((None, [{'url': 'file:///opt/stack/data/glance/images/9665b66b-58f2-431d-af6f-e87c9a099bdd', 'metadata': {}}])) to volume aa4046d6-ff7b-4015-8a0d-11178cc8f072 successfully. {{(pid=89090) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 10:56:08 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Temporary image 9665b66b-58f2-431d-af6f-e87c9a099bdd for user 0308626e4b424a6fb102f600af394420 is deleted. {{(pid=89090) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 10:56:08 devstack cinder-volume[89090]: DEBUG cinder.volume.volume_utils [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Marking volume aa4046d6-ff7b-4015-8a0d-11178cc8f072 as bootable. {{(pid=89090) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 10:56:08 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Copying metadata from image 9665b66b-58f2-431d-af6f-e87c9a099bdd to aa4046d6-ff7b-4015-8a0d-11178cc8f072. {{(pid=89090) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 10:56:08 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Creating volume glance metadata for volume aa4046d6-ff7b-4015-8a0d-11178cc8f072 backed by image 9665b66b-58f2-431d-af6f-e87c9a099bdd with: {'image_id': '9665b66b-58f2-431d-af6f-e87c9a099bdd', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '972b7fe41275e96e8852caacba68d173', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89090) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 10:56:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89d35e6f-a9ad-4059-a0a4-14d73b6bf1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa4046d6-ff7b-4015-8a0d-11178cc8f072', 'volume_size': 1, 'image_id': '9665b66b-58f2-431d-af6f-e87c9a099bdd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9665b66b-58f2-431d-af6f-e87c9a099bdd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '972b7fe41275e96e8852caacba68d173', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '72030b8a20134cdbb1a066871acdf3b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '241ddb186f3b54b366a4bc468b0f32e1de9ca48b18e4a5bcf6d775ef81f1335fa84b4f5be8bad46af3d1c0bb850160a2981971a4c0e6414897c8486ad79bc2cf', 'id': '9665b66b-58f2-431d-af6f-e87c9a099bdd', 'created_at': datetime.datetime(2026, 7, 31, 8, 55, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 56, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9665b66b-58f2-431d-af6f-e87c9a099bdd/file', 'properties': {}}, 'image_service': }' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5605f0a-2eb1-4423-947e-86a0bc587129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:08 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Volume volume-aa4046d6-ff7b-4015-8a0d-11178cc8f072 (aa4046d6-ff7b-4015-8a0d-11178cc8f072): created successfully Jul 31 10:56:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5605f0a-2eb1-4423-947e-86a0bc587129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Flow 'volume_create_manager' (9f666076-2e11-4358-85c5-0e6c08dc11d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:08 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-15394ec4-9e8a-4da6-b5dc-8673747269cc tempest-VolumeImageDependencyTests-560016254 None] Created volume successfully. Jul 31 10:56:09 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-0626253e-8a05-4637-9fd7-aefcfeedd8b6 tempest-VolumeImageDependencyTests-560016254 None] Acquiring lock "cinder-aa4046d6-ff7b-4015-8a0d-11178cc8f072-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:09 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-0626253e-8a05-4637-9fd7-aefcfeedd8b6 tempest-VolumeImageDependencyTests-560016254 None] Lock "cinder-aa4046d6-ff7b-4015-8a0d-11178cc8f072-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-0626253e-8a05-4637-9fd7-aefcfeedd8b6 tempest-VolumeImageDependencyTests-560016254 None] Acquiring lock "cinder-quobyte-aa4046d6-ff7b-4015-8a0d-11178cc8f072" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-0626253e-8a05-4637-9fd7-aefcfeedd8b6 tempest-VolumeImageDependencyTests-560016254 None] Lock "cinder-quobyte-aa4046d6-ff7b-4015-8a0d-11178cc8f072" acquired by "delete_volume" :: waited 0.019s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:10 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36b3252-0fa6-4e15-b3ae-82aea5140910]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0626253e-8a05-4637-9fd7-aefcfeedd8b6 tempest-VolumeImageDependencyTests-560016254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aa4046d6-ff7b-4015-8a0d-11178cc8f072 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:10 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aa4046d6-ff7b-4015-8a0d-11178cc8f072 Jul 31 10:56:10 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:10 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0626253e-8a05-4637-9fd7-aefcfeedd8b6 tempest-VolumeImageDependencyTests-560016254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aa4046d6-ff7b-4015-8a0d-11178cc8f072" returned: 0 in 0.482s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0626253e-8a05-4637-9fd7-aefcfeedd8b6 tempest-VolumeImageDependencyTests-560016254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aa4046d6-ff7b-4015-8a0d-11178cc8f072 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:10 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aa4046d6-ff7b-4015-8a0d-11178cc8f072 Jul 31 10:56:10 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:10 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0626253e-8a05-4637-9fd7-aefcfeedd8b6 tempest-VolumeImageDependencyTests-560016254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-aa4046d6-ff7b-4015-8a0d-11178cc8f072" returned: 0 in 0.289s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-0626253e-8a05-4637-9fd7-aefcfeedd8b6 tempest-VolumeImageDependencyTests-560016254 None] Lock "cinder-quobyte-aa4046d6-ff7b-4015-8a0d-11178cc8f072" released by "delete_volume" :: held 0.836s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:10 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-0626253e-8a05-4637-9fd7-aefcfeedd8b6 tempest-VolumeImageDependencyTests-560016254 None] Created reservations ['4f6ff748-dc75-4282-9fdb-b5f3b28449c1', 'f9f2389f-97b1-4e81-b056-d8b1c40abeca', 'f8a83d3a-8cc2-4631-9092-e5cf601f95a8', 'e8d04927-6b9f-4564-a241-0cbcc5ea37e9'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:56:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0626253e-8a05-4637-9fd7-aefcfeedd8b6 tempest-VolumeImageDependencyTests-560016254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0626253e-8a05-4637-9fd7-aefcfeedd8b6 tempest-VolumeImageDependencyTests-560016254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:11 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0626253e-8a05-4637-9fd7-aefcfeedd8b6 tempest-VolumeImageDependencyTests-560016254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:56:11 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0626253e-8a05-4637-9fd7-aefcfeedd8b6 tempest-VolumeImageDependencyTests-560016254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:56:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0626253e-8a05-4637-9fd7-aefcfeedd8b6 tempest-VolumeImageDependencyTests-560016254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0626253e-8a05-4637-9fd7-aefcfeedd8b6 tempest-VolumeImageDependencyTests-560016254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:11 devstack sudo[105800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:56:11 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:11 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0626253e-8a05-4637-9fd7-aefcfeedd8b6 tempest-VolumeImageDependencyTests-560016254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.361s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:11 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-0626253e-8a05-4637-9fd7-aefcfeedd8b6 tempest-VolumeImageDependencyTests-560016254 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:56:11 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-0626253e-8a05-4637-9fd7-aefcfeedd8b6 tempest-VolumeImageDependencyTests-560016254 None] Deleted volume successfully. Jul 31 10:56:11 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-0626253e-8a05-4637-9fd7-aefcfeedd8b6 tempest-VolumeImageDependencyTests-560016254 None] Lock "cinder-aa4046d6-ff7b-4015-8a0d-11178cc8f072-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:15 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-2424e332-e0a5-4112-987a-c41da204b9c1 tempest-TestInstancesWithCinderVolumes-699824951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:56:15 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2424e332-e0a5-4112-987a-c41da204b9c1 tempest-TestInstancesWithCinderVolumes-699824951 None] Flow 'volume_create_manager' (576dec4f-f03f-4d4d-b324-75993200f6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:15 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2424e332-e0a5-4112-987a-c41da204b9c1 tempest-TestInstancesWithCinderVolumes-699824951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0755fdf0-367f-4732-915e-b5fe4b405504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:15 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2424e332-e0a5-4112-987a-c41da204b9c1 tempest-TestInstancesWithCinderVolumes-699824951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0755fdf0-367f-4732-915e-b5fe4b405504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1466357766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd1d40cb-8104-4d23-b01e-63e30a893491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06604c5c507c4ae3a76eb776ce9c7f6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:16Z,use_quota=True,user_id='a67bd27a762745eca6233c07f4650387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad03d84d-addc-4a0a-87f6-20e6059ba372),volume_type_id=ad03d84d-addc-4a0a-87f6-20e6059ba372)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:15 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2424e332-e0a5-4112-987a-c41da204b9c1 tempest-TestInstancesWithCinderVolumes-699824951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb78e1da-c80b-4c11-9c70-1472c57867c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:15 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2424e332-e0a5-4112-987a-c41da204b9c1 tempest-TestInstancesWithCinderVolumes-699824951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb78e1da-c80b-4c11-9c70-1472c57867c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:15 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2424e332-e0a5-4112-987a-c41da204b9c1 tempest-TestInstancesWithCinderVolumes-699824951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bb2a1ab-4165-479f-bb4f-812b3580256e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:15 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2424e332-e0a5-4112-987a-c41da204b9c1 tempest-TestInstancesWithCinderVolumes-699824951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bb2a1ab-4165-479f-bb4f-812b3580256e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd1d40cb-8104-4d23-b01e-63e30a893491', 'volume_name': 'volume-cd1d40cb-8104-4d23-b01e-63e30a893491', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:15 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2424e332-e0a5-4112-987a-c41da204b9c1 tempest-TestInstancesWithCinderVolumes-699824951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fdd7b24-28b0-4007-9e9b-0ff8de5d8557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:15 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2424e332-e0a5-4112-987a-c41da204b9c1 tempest-TestInstancesWithCinderVolumes-699824951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fdd7b24-28b0-4007-9e9b-0ff8de5d8557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:15 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2424e332-e0a5-4112-987a-c41da204b9c1 tempest-TestInstancesWithCinderVolumes-699824951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19d7ab95-3ea5-4383-b5d6-80da2df163aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:15 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-2424e332-e0a5-4112-987a-c41da204b9c1 tempest-TestInstancesWithCinderVolumes-699824951 None] Volume cd1d40cb-8104-4d23-b01e-63e30a893491: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd1d40cb-8104-4d23-b01e-63e30a893491', 'volume_size': 1} Jul 31 10:56:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2424e332-e0a5-4112-987a-c41da204b9c1 tempest-TestInstancesWithCinderVolumes-699824951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2424e332-e0a5-4112-987a-c41da204b9c1 tempest-TestInstancesWithCinderVolumes-699824951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:15 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2424e332-e0a5-4112-987a-c41da204b9c1 tempest-TestInstancesWithCinderVolumes-699824951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1466357766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd1d40cb-8104-4d23-b01e-63e30a893491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06604c5c507c4ae3a76eb776ce9c7f6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:16Z,use_quota=True,user_id='a67bd27a762745eca6233c07f4650387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad03d84d-addc-4a0a-87f6-20e6059ba372),volume_type_id=ad03d84d-addc-4a0a-87f6-20e6059ba372)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:56:15 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-2424e332-e0a5-4112-987a-c41da204b9c1 tempest-TestInstancesWithCinderVolumes-699824951 None] Creating volume cd1d40cb-8104-4d23-b01e-63e30a893491 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:56:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2424e332-e0a5-4112-987a-c41da204b9c1 tempest-TestInstancesWithCinderVolumes-699824951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2424e332-e0a5-4112-987a-c41da204b9c1 tempest-TestInstancesWithCinderVolumes-699824951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:15 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2424e332-e0a5-4112-987a-c41da204b9c1 tempest-TestInstancesWithCinderVolumes-699824951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:56:15 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2424e332-e0a5-4112-987a-c41da204b9c1 tempest-TestInstancesWithCinderVolumes-699824951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:56:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2424e332-e0a5-4112-987a-c41da204b9c1 tempest-TestInstancesWithCinderVolumes-699824951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:15 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2424e332-e0a5-4112-987a-c41da204b9c1 tempest-TestInstancesWithCinderVolumes-699824951 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:56:15 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-2424e332-e0a5-4112-987a-c41da204b9c1 tempest-TestInstancesWithCinderVolumes-699824951 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:56:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2424e332-e0a5-4112-987a-c41da204b9c1 tempest-TestInstancesWithCinderVolumes-699824951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cd1d40cb-8104-4d23-b01e-63e30a893491 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:15 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cd1d40cb-8104-4d23-b01e-63e30a893491 1073741824 Jul 31 10:56:15 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:16 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0f14910-bc9b-4880-8be8-3affc8afe3b7 tempest-TestInstancesWithCinderVolumes-699824951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:56:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0f14910-bc9b-4880-8be8-3affc8afe3b7 tempest-TestInstancesWithCinderVolumes-699824951 None] Flow 'volume_create_manager' (fc1b9930-9d1d-4314-8184-2045a5f03c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0f14910-bc9b-4880-8be8-3affc8afe3b7 tempest-TestInstancesWithCinderVolumes-699824951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d50bcc6-95da-41d9-9f71-9b3abcf1fc84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0f14910-bc9b-4880-8be8-3affc8afe3b7 tempest-TestInstancesWithCinderVolumes-699824951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d50bcc6-95da-41d9-9f71-9b3abcf1fc84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1463034898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51334f43-3e33-462b-81b2-d2ff56d3f5f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06604c5c507c4ae3a76eb776ce9c7f6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:16Z,use_quota=True,user_id='a67bd27a762745eca6233c07f4650387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b7d695c-959d-406f-9c95-c0d43e6d7d86),volume_type_id=9b7d695c-959d-406f-9c95-c0d43e6d7d86)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0f14910-bc9b-4880-8be8-3affc8afe3b7 tempest-TestInstancesWithCinderVolumes-699824951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27a6f1dd-583e-4785-841f-3eabb75631b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0f14910-bc9b-4880-8be8-3affc8afe3b7 tempest-TestInstancesWithCinderVolumes-699824951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27a6f1dd-583e-4785-841f-3eabb75631b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0f14910-bc9b-4880-8be8-3affc8afe3b7 tempest-TestInstancesWithCinderVolumes-699824951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f6ddcdd-fd10-426e-a55a-faef9e605b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0f14910-bc9b-4880-8be8-3affc8afe3b7 tempest-TestInstancesWithCinderVolumes-699824951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f6ddcdd-fd10-426e-a55a-faef9e605b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51334f43-3e33-462b-81b2-d2ff56d3f5f9', 'volume_name': 'volume-51334f43-3e33-462b-81b2-d2ff56d3f5f9', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0f14910-bc9b-4880-8be8-3affc8afe3b7 tempest-TestInstancesWithCinderVolumes-699824951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55002c26-4c13-4893-bdf6-bca66163c202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0f14910-bc9b-4880-8be8-3affc8afe3b7 tempest-TestInstancesWithCinderVolumes-699824951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55002c26-4c13-4893-bdf6-bca66163c202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0f14910-bc9b-4880-8be8-3affc8afe3b7 tempest-TestInstancesWithCinderVolumes-699824951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a0fa57a-2e19-4df5-8fb8-530582ffdc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:16 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-c0f14910-bc9b-4880-8be8-3affc8afe3b7 tempest-TestInstancesWithCinderVolumes-699824951 None] Volume 51334f43-3e33-462b-81b2-d2ff56d3f5f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51334f43-3e33-462b-81b2-d2ff56d3f5f9', 'volume_size': 1} Jul 31 10:56:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c0f14910-bc9b-4880-8be8-3affc8afe3b7 tempest-TestInstancesWithCinderVolumes-699824951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:16 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2424e332-e0a5-4112-987a-c41da204b9c1 tempest-TestInstancesWithCinderVolumes-699824951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cd1d40cb-8104-4d23-b01e-63e30a893491 1073741824" returned: 0 in 0.703s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2424e332-e0a5-4112-987a-c41da204b9c1 tempest-TestInstancesWithCinderVolumes-699824951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cd1d40cb-8104-4d23-b01e-63e30a893491 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:16 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cd1d40cb-8104-4d23-b01e-63e30a893491 Jul 31 10:56:16 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:16 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2424e332-e0a5-4112-987a-c41da204b9c1 tempest-TestInstancesWithCinderVolumes-699824951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cd1d40cb-8104-4d23-b01e-63e30a893491" returned: 0 in 0.304s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:17 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2424e332-e0a5-4112-987a-c41da204b9c1 tempest-TestInstancesWithCinderVolumes-699824951 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:56:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2424e332-e0a5-4112-987a-c41da204b9c1 tempest-TestInstancesWithCinderVolumes-699824951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c0f14910-bc9b-4880-8be8-3affc8afe3b7 tempest-TestInstancesWithCinderVolumes-699824951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.423s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:17 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c0f14910-bc9b-4880-8be8-3affc8afe3b7 tempest-TestInstancesWithCinderVolumes-699824951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1463034898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51334f43-3e33-462b-81b2-d2ff56d3f5f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06604c5c507c4ae3a76eb776ce9c7f6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:16Z,use_quota=True,user_id='a67bd27a762745eca6233c07f4650387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b7d695c-959d-406f-9c95-c0d43e6d7d86),volume_type_id=9b7d695c-959d-406f-9c95-c0d43e6d7d86)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:56:17 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-c0f14910-bc9b-4880-8be8-3affc8afe3b7 tempest-TestInstancesWithCinderVolumes-699824951 None] Creating volume 51334f43-3e33-462b-81b2-d2ff56d3f5f9 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:56:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c0f14910-bc9b-4880-8be8-3affc8afe3b7 tempest-TestInstancesWithCinderVolumes-699824951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c0f14910-bc9b-4880-8be8-3affc8afe3b7 tempest-TestInstancesWithCinderVolumes-699824951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:17 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c0f14910-bc9b-4880-8be8-3affc8afe3b7 tempest-TestInstancesWithCinderVolumes-699824951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:56:17 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c0f14910-bc9b-4880-8be8-3affc8afe3b7 tempest-TestInstancesWithCinderVolumes-699824951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:56:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c0f14910-bc9b-4880-8be8-3affc8afe3b7 tempest-TestInstancesWithCinderVolumes-699824951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:17 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c0f14910-bc9b-4880-8be8-3affc8afe3b7 tempest-TestInstancesWithCinderVolumes-699824951 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:56:17 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-c0f14910-bc9b-4880-8be8-3affc8afe3b7 tempest-TestInstancesWithCinderVolumes-699824951 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:56:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c0f14910-bc9b-4880-8be8-3affc8afe3b7 tempest-TestInstancesWithCinderVolumes-699824951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-51334f43-3e33-462b-81b2-d2ff56d3f5f9 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2424e332-e0a5-4112-987a-c41da204b9c1 tempest-TestInstancesWithCinderVolumes-699824951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19d7ab95-3ea5-4383-b5d6-80da2df163aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd1d40cb-8104-4d23-b01e-63e30a893491', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2424e332-e0a5-4112-987a-c41da204b9c1 tempest-TestInstancesWithCinderVolumes-699824951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28c7ca30-afa0-405a-8a8c-618e0b688921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:17 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-2424e332-e0a5-4112-987a-c41da204b9c1 tempest-TestInstancesWithCinderVolumes-699824951 None] Volume volume-cd1d40cb-8104-4d23-b01e-63e30a893491 (cd1d40cb-8104-4d23-b01e-63e30a893491): created successfully Jul 31 10:56:17 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-51334f43-3e33-462b-81b2-d2ff56d3f5f9 1073741824 Jul 31 10:56:17 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2424e332-e0a5-4112-987a-c41da204b9c1 tempest-TestInstancesWithCinderVolumes-699824951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28c7ca30-afa0-405a-8a8c-618e0b688921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2424e332-e0a5-4112-987a-c41da204b9c1 tempest-TestInstancesWithCinderVolumes-699824951 None] Flow 'volume_create_manager' (576dec4f-f03f-4d4d-b324-75993200f6e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:17 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-2424e332-e0a5-4112-987a-c41da204b9c1 tempest-TestInstancesWithCinderVolumes-699824951 None] Created volume successfully. Jul 31 10:56:17 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:56:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Flow 'volume_create_manager' (11d2594b-bcda-4539-a405-094cbb124459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e44d25f3-fcac-48f7-a0cd-b62f2e63809e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e44d25f3-fcac-48f7-a0cd-b62f2e63809e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2135922147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d2bb2c4-df49-449b-bb40-7e88b84927f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06604c5c507c4ae3a76eb776ce9c7f6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:17Z,use_quota=True,user_id='a67bd27a762745eca6233c07f4650387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29333315-b885-47c6-a165-32ada517693a),volume_type_id=29333315-b885-47c6-a165-32ada517693a)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18fae18b-2548-4c14-801e-964980879a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18fae18b-2548-4c14-801e-964980879a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb6afc4c-e392-4295-a149-6fe2b2e81495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:17 devstack cinder-volume[89090]: DEBUG cinder.image.glance [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Creating Keystone auth plugin from conf {{(pid=89090) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 10:56:17 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c0f14910-bc9b-4880-8be8-3affc8afe3b7 tempest-TestInstancesWithCinderVolumes-699824951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-51334f43-3e33-462b-81b2-d2ff56d3f5f9 1073741824" returned: 0 in 0.639s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c0f14910-bc9b-4880-8be8-3affc8afe3b7 tempest-TestInstancesWithCinderVolumes-699824951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-51334f43-3e33-462b-81b2-d2ff56d3f5f9 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:17 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-51334f43-3e33-462b-81b2-d2ff56d3f5f9 Jul 31 10:56:17 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb6afc4c-e392-4295-a149-6fe2b2e81495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6d2bb2c4-df49-449b-bb40-7e88b84927f1', 'volume_name': 'volume-6d2bb2c4-df49-449b-bb40-7e88b84927f1', 'volume_size': 1, 'image_id': '1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--389899871', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '06604c5c507c4ae3a76eb776ce9c7f6c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd', 'created_at': datetime.datetime(2026, 7, 31, 8, 56, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 56, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd/file', 'properties': {}}, 'image_service': }' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05db7f2b-7ec4-441c-98c7-1242ce9a6b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05db7f2b-7ec4-441c-98c7-1242ce9a6b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c3e855c-732b-4255-9eea-cb55e80425f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:17 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Volume 6d2bb2c4-df49-449b-bb40-7e88b84927f1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6d2bb2c4-df49-449b-bb40-7e88b84927f1', 'volume_size': 1, 'image_id': '1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--389899871', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '06604c5c507c4ae3a76eb776ce9c7f6c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd', 'created_at': datetime.datetime(2026, 7, 31, 8, 56, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 56, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd/file', 'properties': {}}, 'image_service': } Jul 31 10:56:17 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Trying to clone 6d2bb2c4-df49-449b-bb40-7e88b84927f1 from image 1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd at location (None, [{'url': 'file:///opt/stack/data/glance/images/1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd', 'metadata': {}}]). {{(pid=89090) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 10:56:18 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c0f14910-bc9b-4880-8be8-3affc8afe3b7 tempest-TestInstancesWithCinderVolumes-699824951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-51334f43-3e33-462b-81b2-d2ff56d3f5f9" returned: 0 in 0.335s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c0f14910-bc9b-4880-8be8-3affc8afe3b7 tempest-TestInstancesWithCinderVolumes-699824951 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:56:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c0f14910-bc9b-4880-8be8-3affc8afe3b7 tempest-TestInstancesWithCinderVolumes-699824951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:18 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0f14910-bc9b-4880-8be8-3affc8afe3b7 tempest-TestInstancesWithCinderVolumes-699824951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a0fa57a-2e19-4df5-8fb8-530582ffdc35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51334f43-3e33-462b-81b2-d2ff56d3f5f9', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:18 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0f14910-bc9b-4880-8be8-3affc8afe3b7 tempest-TestInstancesWithCinderVolumes-699824951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8c3082b-7987-4c7c-aa39-fdf0859cf9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:18 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-c0f14910-bc9b-4880-8be8-3affc8afe3b7 tempest-TestInstancesWithCinderVolumes-699824951 None] Volume volume-51334f43-3e33-462b-81b2-d2ff56d3f5f9 (51334f43-3e33-462b-81b2-d2ff56d3f5f9): created successfully Jul 31 10:56:18 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0f14910-bc9b-4880-8be8-3affc8afe3b7 tempest-TestInstancesWithCinderVolumes-699824951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8c3082b-7987-4c7c-aa39-fdf0859cf9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:18 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c0f14910-bc9b-4880-8be8-3affc8afe3b7 tempest-TestInstancesWithCinderVolumes-699824951 None] Flow 'volume_create_manager' (fc1b9930-9d1d-4314-8184-2045a5f03c0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:18 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-c0f14910-bc9b-4880-8be8-3affc8afe3b7 tempest-TestInstancesWithCinderVolumes-699824951 None] Created volume successfully. Jul 31 10:56:21 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd_5lsya5u_devstack@QuobyteHD, size 20.69 MB, duration 3.37 sec {{(pid=89090) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 10:56:21 devstack cinder-volume[89090]: INFO cinder.image.image_utils [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Image download 20.69 MB at 6.14 MB/s Jul 31 10:56:21 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[575592d2-7126-4442-a530-1e9b27a9c139]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd_5lsya5u_devstack@QuobyteHD {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:21 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd_5lsya5u_devstack@QuobyteHD Jul 31 10:56:21 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:21 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd_5lsya5u_devstack@QuobyteHD" returned: 0 in 0.354s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:21 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Temporary image 1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd is fetched for user a67bd27a762745eca6233c07f4650387. {{(pid=89090) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 10:56:21 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4dbace0-5ac1-4ce1-bd70-b60e66a3d44f]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd_5lsya5u_devstack@QuobyteHD {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:21 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd_5lsya5u_devstack@QuobyteHD Jul 31 10:56:21 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:22 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd_5lsya5u_devstack@QuobyteHD" returned: 0 in 0.382s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:22 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2135922147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d2bb2c4-df49-449b-bb40-7e88b84927f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06604c5c507c4ae3a76eb776ce9c7f6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:17Z,use_quota=True,user_id='a67bd27a762745eca6233c07f4650387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29333315-b885-47c6-a165-32ada517693a),volume_type_id=29333315-b885-47c6-a165-32ada517693a)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:56:22 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Creating volume 6d2bb2c4-df49-449b-bb40-7e88b84927f1 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:56:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:22 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:56:22 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:56:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:22 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:56:22 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:56:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6d2bb2c4-df49-449b-bb40-7e88b84927f1 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:22 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6d2bb2c4-df49-449b-bb40-7e88b84927f1 1073741824 Jul 31 10:56:22 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:22 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6d2bb2c4-df49-449b-bb40-7e88b84927f1 1073741824" returned: 0 in 0.466s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6d2bb2c4-df49-449b-bb40-7e88b84927f1 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:22 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6d2bb2c4-df49-449b-bb40-7e88b84927f1 Jul 31 10:56:22 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:22 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6d2bb2c4-df49-449b-bb40-7e88b84927f1" returned: 0 in 0.261s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:22 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:56:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:22 devstack cinder-volume[89090]: DEBUG cinder.volume.volume_utils [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Attempting download of 1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd ((None, [{'url': 'file:///opt/stack/data/glance/images/1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd', 'metadata': {}}])) to volume 6d2bb2c4-df49-449b-bb40-7e88b84927f1. {{(pid=89090) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 10:56:22 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[9215fb71-1292-4666-a321-d8f3f894fbf8]: (4, 'raw') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd_gvu_iroj {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:23 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd_gvu_iroj Jul 31 10:56:23 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:23 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd_gvu_iroj" returned: 0 in 0.342s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd_gvu_iroj {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:23 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd_gvu_iroj Jul 31 10:56:23 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:23 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd_gvu_iroj" returned: 1 in 0.349s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd_gvu_iroj' failed. Not Retrying. {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 10:56:23 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[715ff06b-5729-46b4-b847-80c6a43b6b83]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd_5lsya5u_devstack@QuobyteHD {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:23 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd_5lsya5u_devstack@QuobyteHD Jul 31 10:56:23 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:24 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd_5lsya5u_devstack@QuobyteHD" returned: 0 in 0.364s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:24 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] 1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd was qcow2, converting to qcow2 {{(pid=89090) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 10:56:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd_5lsya5u_devstack@QuobyteHD /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6d2bb2c4-df49-449b-bb40-7e88b84927f1 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:24 devstack sudo[105860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd_5lsya5u_devstack@QuobyteHD /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6d2bb2c4-df49-449b-bb40-7e88b84927f1 Jul 31 10:56:24 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:25 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd_5lsya5u_devstack@QuobyteHD /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6d2bb2c4-df49-449b-bb40-7e88b84927f1" returned: 0 in 1.803s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:25 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd_5lsya5u_devstack@QuobyteHD, size 112.00 MB, duration 1.80 sec, destination /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6d2bb2c4-df49-449b-bb40-7e88b84927f1 {{(pid=89090) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 10:56:25 devstack cinder-volume[89090]: INFO cinder.image.image_utils [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Converted 112.00 MB image at 62.08 MB/s Jul 31 10:56:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6d2bb2c4-df49-449b-bb40-7e88b84927f1 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:25 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6d2bb2c4-df49-449b-bb40-7e88b84927f1 1G Jul 31 10:56:25 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:26 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6d2bb2c4-df49-449b-bb40-7e88b84927f1 1G" returned: 0 in 0.364s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:26 devstack cinder-volume[89090]: DEBUG cinder.volume.volume_utils [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Downloaded image 1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd ((None, [{'url': 'file:///opt/stack/data/glance/images/1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd', 'metadata': {}}])) to volume 6d2bb2c4-df49-449b-bb40-7e88b84927f1 successfully. {{(pid=89090) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 10:56:26 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Temporary image 1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd for user a67bd27a762745eca6233c07f4650387 is deleted. {{(pid=89090) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 10:56:26 devstack cinder-volume[89090]: DEBUG cinder.volume.volume_utils [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Marking volume 6d2bb2c4-df49-449b-bb40-7e88b84927f1 as bootable. {{(pid=89090) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 10:56:26 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Copying metadata from image 1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd to 6d2bb2c4-df49-449b-bb40-7e88b84927f1. {{(pid=89090) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 10:56:26 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Creating volume glance metadata for volume 6d2bb2c4-df49-449b-bb40-7e88b84927f1 backed by image 1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd with: {'image_id': '1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd', 'image_name': 'tempest-scenario-img--389899871', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89090) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 10:56:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c3e855c-732b-4255-9eea-cb55e80425f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d2bb2c4-df49-449b-bb40-7e88b84927f1', 'volume_size': 1, 'image_id': '1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--389899871', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '06604c5c507c4ae3a76eb776ce9c7f6c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd', 'created_at': datetime.datetime(2026, 7, 31, 8, 56, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 56, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c4dbcf5-9b4f-4cf3-9d5d-a114e7644fbd/file', 'properties': {}}, 'image_service': }' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fca7977b-2235-40e5-ae78-9048ee7723a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:26 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Volume volume-6d2bb2c4-df49-449b-bb40-7e88b84927f1 (6d2bb2c4-df49-449b-bb40-7e88b84927f1): created successfully Jul 31 10:56:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fca7977b-2235-40e5-ae78-9048ee7723a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Flow 'volume_create_manager' (11d2594b-bcda-4539-a405-094cbb124459) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:26 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-ed451fa4-2b78-424d-8022-1a26b7fe194e tempest-TestInstancesWithCinderVolumes-699824951 None] Created volume successfully. Jul 31 10:56:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-ebc1ba46-ca11-4557-abda-cc1a28eca814 req-da6063f4-e089-438f-befc-0eada6ad1f3b tempest-TestInstancesWithCinderVolumes-699824951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-ebc1ba46-ca11-4557-abda-cc1a28eca814 req-da6063f4-e089-438f-befc-0eada6ad1f3b tempest-TestInstancesWithCinderVolumes-699824951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-ebc1ba46-ca11-4557-abda-cc1a28eca814 req-da6063f4-e089-438f-befc-0eada6ad1f3b tempest-TestInstancesWithCinderVolumes-699824951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-ebc1ba46-ca11-4557-abda-cc1a28eca814 req-da6063f4-e089-438f-befc-0eada6ad1f3b tempest-TestInstancesWithCinderVolumes-699824951 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c', 'name': 'volume-6d2bb2c4-df49-449b-bb40-7e88b84927f1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f8395a48-4e34-4f92-bc65-c2991787dbb2', 'enforce_multipath': True} {{(pid=89090) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:56:30 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-ebc1ba46-ca11-4557-abda-cc1a28eca814 req-da6063f4-e089-438f-befc-0eada6ad1f3b tempest-TestInstancesWithCinderVolumes-699824951 None] attachment_update completed successfully. Jul 31 10:56:40 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=47,cinder:INSERT=25,cinder:UPDATE=46,cinder:DELETE=3 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:56:40 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:UPDATE=46,cinder:SELECT=42,cinder:DELETE=4,cinder:INSERT=13 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:56:45 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:56:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:56:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:56:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:46 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:56:46 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:46 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.283s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:46 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:56:46 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager._thread_info {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:56:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread count: 28 {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:56:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread info: [<_MainThread(MainThread, started 134005426110592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:57:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-d3b1238f-fa75-4698-99b1-22f72ad65bcd req-9b3fcf72-9e52-481f-baa8-47fa3c60ad70 tempest-TestInstancesWithCinderVolumes-699824951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-d3b1238f-fa75-4698-99b1-22f72ad65bcd req-9b3fcf72-9e52-481f-baa8-47fa3c60ad70 tempest-TestInstancesWithCinderVolumes-699824951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-d3b1238f-fa75-4698-99b1-22f72ad65bcd req-9b3fcf72-9e52-481f-baa8-47fa3c60ad70 tempest-TestInstancesWithCinderVolumes-699824951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-d3b1238f-fa75-4698-99b1-22f72ad65bcd req-9b3fcf72-9e52-481f-baa8-47fa3c60ad70 tempest-TestInstancesWithCinderVolumes-699824951 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c', 'name': 'volume-cd1d40cb-8104-4d23-b01e-63e30a893491', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c7c7593e-8400-46e8-a5c0-5be54cc71ead', 'enforce_multipath': True} {{(pid=89090) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:57:03 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-d3b1238f-fa75-4698-99b1-22f72ad65bcd req-9b3fcf72-9e52-481f-baa8-47fa3c60ad70 tempest-TestInstancesWithCinderVolumes-699824951 None] attachment_update completed successfully. Jul 31 10:57:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-3f975e2c-94d3-4696-a429-26aebb048139 req-f6cac943-6871-4a8a-a98a-424877a02b26 tempest-TestInstancesWithCinderVolumes-699824951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-3f975e2c-94d3-4696-a429-26aebb048139 req-f6cac943-6871-4a8a-a98a-424877a02b26 tempest-TestInstancesWithCinderVolumes-699824951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [req-3f975e2c-94d3-4696-a429-26aebb048139 req-f6cac943-6871-4a8a-a98a-424877a02b26 tempest-TestInstancesWithCinderVolumes-699824951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:06 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-3f975e2c-94d3-4696-a429-26aebb048139 req-f6cac943-6871-4a8a-a98a-424877a02b26 tempest-TestInstancesWithCinderVolumes-699824951 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c', 'name': 'volume-51334f43-3e33-462b-81b2-d2ff56d3f5f9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5be6850f-6844-437b-8143-e075ea700ee2', 'enforce_multipath': True} {{(pid=89090) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:57:06 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-3f975e2c-94d3-4696-a429-26aebb048139 req-f6cac943-6871-4a8a-a98a-424877a02b26 tempest-TestInstancesWithCinderVolumes-699824951 None] attachment_update completed successfully. Jul 31 10:57:11 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-c4b619ed-3fcd-4a1a-bbc1-659ff3ffa918 req-bba07047-9af0-44c6-aca6-ae9d2063b379 tempest-TestInstancesWithCinderVolumes-699824951 None] Terminate volume connection completed successfully. Jul 31 10:57:11 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-c4b619ed-3fcd-4a1a-bbc1-659ff3ffa918 req-bba07047-9af0-44c6-aca6-ae9d2063b379 tempest-TestInstancesWithCinderVolumes-699824951 None] Deleting attachment c7c7593e-8400-46e8-a5c0-5be54cc71ead. {{(pid=89090) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:57:11 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-b9d8168d-9162-4977-993e-b436085e69ac tempest-TestInstancesWithCinderVolumes-699824951 None] Acquiring lock "cinder-cd1d40cb-8104-4d23-b01e-63e30a893491-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:11 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-b9d8168d-9162-4977-993e-b436085e69ac tempest-TestInstancesWithCinderVolumes-699824951 None] Lock "cinder-cd1d40cb-8104-4d23-b01e-63e30a893491-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:11 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-b9d8168d-9162-4977-993e-b436085e69ac tempest-TestInstancesWithCinderVolumes-699824951 None] Acquiring lock "cinder-quobyte-cd1d40cb-8104-4d23-b01e-63e30a893491" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:11 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-b9d8168d-9162-4977-993e-b436085e69ac tempest-TestInstancesWithCinderVolumes-699824951 None] Lock "cinder-quobyte-cd1d40cb-8104-4d23-b01e-63e30a893491" acquired by "delete_volume" :: waited 0.023s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:11 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b2b061-c477-4876-b4d5-615b95313b80]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b9d8168d-9162-4977-993e-b436085e69ac tempest-TestInstancesWithCinderVolumes-699824951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cd1d40cb-8104-4d23-b01e-63e30a893491 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:11 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cd1d40cb-8104-4d23-b01e-63e30a893491 Jul 31 10:57:11 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:12 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b9d8168d-9162-4977-993e-b436085e69ac tempest-TestInstancesWithCinderVolumes-699824951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cd1d40cb-8104-4d23-b01e-63e30a893491" returned: 0 in 0.491s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b9d8168d-9162-4977-993e-b436085e69ac tempest-TestInstancesWithCinderVolumes-699824951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cd1d40cb-8104-4d23-b01e-63e30a893491 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:12 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cd1d40cb-8104-4d23-b01e-63e30a893491 Jul 31 10:57:12 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:12 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b9d8168d-9162-4977-993e-b436085e69ac tempest-TestInstancesWithCinderVolumes-699824951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cd1d40cb-8104-4d23-b01e-63e30a893491" returned: 0 in 0.300s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:12 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-b9d8168d-9162-4977-993e-b436085e69ac tempest-TestInstancesWithCinderVolumes-699824951 None] Lock "cinder-quobyte-cd1d40cb-8104-4d23-b01e-63e30a893491" released by "delete_volume" :: held 0.846s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:12 devstack cinder-volume[89090]: WARNING cinder.quota [None req-b9d8168d-9162-4977-993e-b436085e69ac tempest-TestInstancesWithCinderVolumes-699824951 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1017132238-464644001 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1017132238-464644001, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:57:12 devstack cinder-volume[89090]: WARNING cinder.quota [None req-b9d8168d-9162-4977-993e-b436085e69ac tempest-TestInstancesWithCinderVolumes-699824951 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1017132238-464644001 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1017132238-464644001, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:57:12 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-b9d8168d-9162-4977-993e-b436085e69ac tempest-TestInstancesWithCinderVolumes-699824951 None] Created reservations ['0ec031c6-e526-4a45-a5db-659ed3b016bc', 'd209decc-2113-491c-b909-47fe95e4c994', 'e3ef0599-4687-437a-8952-24da93d3913b', '0f7e76cf-5bc0-44bf-9005-71e75a2a85e3'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:57:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b9d8168d-9162-4977-993e-b436085e69ac tempest-TestInstancesWithCinderVolumes-699824951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b9d8168d-9162-4977-993e-b436085e69ac tempest-TestInstancesWithCinderVolumes-699824951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:12 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-b9d8168d-9162-4977-993e-b436085e69ac tempest-TestInstancesWithCinderVolumes-699824951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:57:12 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-b9d8168d-9162-4977-993e-b436085e69ac tempest-TestInstancesWithCinderVolumes-699824951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:57:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b9d8168d-9162-4977-993e-b436085e69ac tempest-TestInstancesWithCinderVolumes-699824951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b9d8168d-9162-4977-993e-b436085e69ac tempest-TestInstancesWithCinderVolumes-699824951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:12 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:57:12 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:13 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b9d8168d-9162-4977-993e-b436085e69ac tempest-TestInstancesWithCinderVolumes-699824951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.321s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:13 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-b9d8168d-9162-4977-993e-b436085e69ac tempest-TestInstancesWithCinderVolumes-699824951 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:57:13 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-b9d8168d-9162-4977-993e-b436085e69ac tempest-TestInstancesWithCinderVolumes-699824951 None] Deleted volume successfully. Jul 31 10:57:13 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-b9d8168d-9162-4977-993e-b436085e69ac tempest-TestInstancesWithCinderVolumes-699824951 None] Lock "cinder-cd1d40cb-8104-4d23-b01e-63e30a893491-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:15 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-0e1f7350-2bf4-4748-929b-e932f99519eb req-b8e8eaad-c774-45e1-b29e-c166792efe27 tempest-TestInstancesWithCinderVolumes-699824951 None] Terminate volume connection completed successfully. Jul 31 10:57:15 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-0e1f7350-2bf4-4748-929b-e932f99519eb req-b8e8eaad-c774-45e1-b29e-c166792efe27 tempest-TestInstancesWithCinderVolumes-699824951 None] Deleting attachment 5be6850f-6844-437b-8143-e075ea700ee2. {{(pid=89090) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:57:16 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f0e695c8-f002-4bd8-bbec-bc528350123f tempest-TestInstancesWithCinderVolumes-699824951 None] Acquiring lock "cinder-51334f43-3e33-462b-81b2-d2ff56d3f5f9-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:16 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f0e695c8-f002-4bd8-bbec-bc528350123f tempest-TestInstancesWithCinderVolumes-699824951 None] Lock "cinder-51334f43-3e33-462b-81b2-d2ff56d3f5f9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:16 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f0e695c8-f002-4bd8-bbec-bc528350123f tempest-TestInstancesWithCinderVolumes-699824951 None] Acquiring lock "cinder-quobyte-51334f43-3e33-462b-81b2-d2ff56d3f5f9" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:16 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f0e695c8-f002-4bd8-bbec-bc528350123f tempest-TestInstancesWithCinderVolumes-699824951 None] Lock "cinder-quobyte-51334f43-3e33-462b-81b2-d2ff56d3f5f9" acquired by "delete_volume" :: waited 0.016s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:16 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb16cf7f-2315-4545-bbff-e63a29557ca3]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f0e695c8-f002-4bd8-bbec-bc528350123f tempest-TestInstancesWithCinderVolumes-699824951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-51334f43-3e33-462b-81b2-d2ff56d3f5f9 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:16 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-51334f43-3e33-462b-81b2-d2ff56d3f5f9 Jul 31 10:57:16 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:16 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f0e695c8-f002-4bd8-bbec-bc528350123f tempest-TestInstancesWithCinderVolumes-699824951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-51334f43-3e33-462b-81b2-d2ff56d3f5f9" returned: 0 in 0.416s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f0e695c8-f002-4bd8-bbec-bc528350123f tempest-TestInstancesWithCinderVolumes-699824951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-51334f43-3e33-462b-81b2-d2ff56d3f5f9 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:16 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-51334f43-3e33-462b-81b2-d2ff56d3f5f9 Jul 31 10:57:16 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:17 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f0e695c8-f002-4bd8-bbec-bc528350123f tempest-TestInstancesWithCinderVolumes-699824951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-51334f43-3e33-462b-81b2-d2ff56d3f5f9" returned: 0 in 0.275s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:17 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f0e695c8-f002-4bd8-bbec-bc528350123f tempest-TestInstancesWithCinderVolumes-699824951 None] Lock "cinder-quobyte-51334f43-3e33-462b-81b2-d2ff56d3f5f9" released by "delete_volume" :: held 0.733s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:17 devstack cinder-volume[89090]: WARNING cinder.quota [None req-f0e695c8-f002-4bd8-bbec-bc528350123f tempest-TestInstancesWithCinderVolumes-699824951 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-628855524-2074103422 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-628855524-2074103422, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:57:17 devstack cinder-volume[89090]: WARNING cinder.quota [None req-f0e695c8-f002-4bd8-bbec-bc528350123f tempest-TestInstancesWithCinderVolumes-699824951 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-628855524-2074103422 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-628855524-2074103422, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:57:17 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-f0e695c8-f002-4bd8-bbec-bc528350123f tempest-TestInstancesWithCinderVolumes-699824951 None] Created reservations ['09012f00-7191-49c8-82d6-25f163503cea', '275d4e79-8175-4bf9-bc88-d816c9acd46b', 'a52a712f-2c7d-4278-8249-61d61baa137a', 'c6f64fe8-0eb2-40f8-b74b-e6ea57763834'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:57:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f0e695c8-f002-4bd8-bbec-bc528350123f tempest-TestInstancesWithCinderVolumes-699824951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f0e695c8-f002-4bd8-bbec-bc528350123f tempest-TestInstancesWithCinderVolumes-699824951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:17 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f0e695c8-f002-4bd8-bbec-bc528350123f tempest-TestInstancesWithCinderVolumes-699824951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:57:17 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f0e695c8-f002-4bd8-bbec-bc528350123f tempest-TestInstancesWithCinderVolumes-699824951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:57:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f0e695c8-f002-4bd8-bbec-bc528350123f tempest-TestInstancesWithCinderVolumes-699824951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f0e695c8-f002-4bd8-bbec-bc528350123f tempest-TestInstancesWithCinderVolumes-699824951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:17 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:57:17 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:17 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f0e695c8-f002-4bd8-bbec-bc528350123f tempest-TestInstancesWithCinderVolumes-699824951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.288s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:17 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-f0e695c8-f002-4bd8-bbec-bc528350123f tempest-TestInstancesWithCinderVolumes-699824951 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:57:17 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-f0e695c8-f002-4bd8-bbec-bc528350123f tempest-TestInstancesWithCinderVolumes-699824951 None] Deleted volume successfully. Jul 31 10:57:17 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f0e695c8-f002-4bd8-bbec-bc528350123f tempest-TestInstancesWithCinderVolumes-699824951 None] Lock "cinder-51334f43-3e33-462b-81b2-d2ff56d3f5f9-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:20 devstack cinder-volume[89090]: INFO cinder.volume.manager [req-8483f551-e98c-4241-981c-b7faa3ce0894 req-1633158f-8039-4f38-b2bb-482b7ca28cc8 tempest-TestInstancesWithCinderVolumes-699824951 None] Terminate volume connection completed successfully. Jul 31 10:57:20 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [req-8483f551-e98c-4241-981c-b7faa3ce0894 req-1633158f-8039-4f38-b2bb-482b7ca28cc8 tempest-TestInstancesWithCinderVolumes-699824951 None] Deleting attachment f8395a48-4e34-4f92-bc65-c2991787dbb2. {{(pid=89090) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:57:21 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-3ae32be0-ea95-485e-9cc0-e087695544cd tempest-TestInstancesWithCinderVolumes-699824951 None] Acquiring lock "cinder-6d2bb2c4-df49-449b-bb40-7e88b84927f1-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:21 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-3ae32be0-ea95-485e-9cc0-e087695544cd tempest-TestInstancesWithCinderVolumes-699824951 None] Lock "cinder-6d2bb2c4-df49-449b-bb40-7e88b84927f1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:21 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-3ae32be0-ea95-485e-9cc0-e087695544cd tempest-TestInstancesWithCinderVolumes-699824951 None] Acquiring lock "cinder-quobyte-6d2bb2c4-df49-449b-bb40-7e88b84927f1" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:21 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-3ae32be0-ea95-485e-9cc0-e087695544cd tempest-TestInstancesWithCinderVolumes-699824951 None] Lock "cinder-quobyte-6d2bb2c4-df49-449b-bb40-7e88b84927f1" acquired by "delete_volume" :: waited 0.019s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:21 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[289593dd-4e6d-4d72-9a76-2630b3c4e728]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3ae32be0-ea95-485e-9cc0-e087695544cd tempest-TestInstancesWithCinderVolumes-699824951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6d2bb2c4-df49-449b-bb40-7e88b84927f1 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:21 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6d2bb2c4-df49-449b-bb40-7e88b84927f1 Jul 31 10:57:21 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:22 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3ae32be0-ea95-485e-9cc0-e087695544cd tempest-TestInstancesWithCinderVolumes-699824951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6d2bb2c4-df49-449b-bb40-7e88b84927f1" returned: 0 in 0.395s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3ae32be0-ea95-485e-9cc0-e087695544cd tempest-TestInstancesWithCinderVolumes-699824951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6d2bb2c4-df49-449b-bb40-7e88b84927f1 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:22 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6d2bb2c4-df49-449b-bb40-7e88b84927f1 Jul 31 10:57:22 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:22 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3ae32be0-ea95-485e-9cc0-e087695544cd tempest-TestInstancesWithCinderVolumes-699824951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-6d2bb2c4-df49-449b-bb40-7e88b84927f1" returned: 0 in 0.247s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:22 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-3ae32be0-ea95-485e-9cc0-e087695544cd tempest-TestInstancesWithCinderVolumes-699824951 None] Lock "cinder-quobyte-6d2bb2c4-df49-449b-bb40-7e88b84927f1" released by "delete_volume" :: held 0.687s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:22 devstack cinder-volume[89090]: WARNING cinder.quota [None req-3ae32be0-ea95-485e-9cc0-e087695544cd tempest-TestInstancesWithCinderVolumes-699824951 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-898573709-1571298052 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-898573709-1571298052, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:57:22 devstack cinder-volume[89090]: WARNING cinder.quota [None req-3ae32be0-ea95-485e-9cc0-e087695544cd tempest-TestInstancesWithCinderVolumes-699824951 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-898573709-1571298052 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-898573709-1571298052, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:57:22 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-3ae32be0-ea95-485e-9cc0-e087695544cd tempest-TestInstancesWithCinderVolumes-699824951 None] Created reservations ['338893a6-06b3-4c84-9411-589443fd9026', 'ac7c3c60-615e-490d-9b20-17d1108d22f5', 'db5f298d-5d0f-4eba-94c7-27505c692ab8', '2c8b206f-28f7-43a9-9150-0036343e90dd'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:57:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3ae32be0-ea95-485e-9cc0-e087695544cd tempest-TestInstancesWithCinderVolumes-699824951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3ae32be0-ea95-485e-9cc0-e087695544cd tempest-TestInstancesWithCinderVolumes-699824951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:22 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-3ae32be0-ea95-485e-9cc0-e087695544cd tempest-TestInstancesWithCinderVolumes-699824951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:57:22 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-3ae32be0-ea95-485e-9cc0-e087695544cd tempest-TestInstancesWithCinderVolumes-699824951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:57:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3ae32be0-ea95-485e-9cc0-e087695544cd tempest-TestInstancesWithCinderVolumes-699824951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3ae32be0-ea95-485e-9cc0-e087695544cd tempest-TestInstancesWithCinderVolumes-699824951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:22 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:57:22 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:22 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3ae32be0-ea95-485e-9cc0-e087695544cd tempest-TestInstancesWithCinderVolumes-699824951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.267s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:22 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-3ae32be0-ea95-485e-9cc0-e087695544cd tempest-TestInstancesWithCinderVolumes-699824951 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:57:22 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-3ae32be0-ea95-485e-9cc0-e087695544cd tempest-TestInstancesWithCinderVolumes-699824951 None] Deleted volume successfully. Jul 31 10:57:22 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-3ae32be0-ea95-485e-9cc0-e087695544cd tempest-TestInstancesWithCinderVolumes-699824951 None] Lock "cinder-6d2bb2c4-df49-449b-bb40-7e88b84927f1-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:32 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=30,cinder:UPDATE=24,cinder:INSERT=7,cinder:DELETE=1 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:57:32 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=32,cinder:UPDATE=30,cinder:INSERT=5,cinder:DELETE=2 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:57:38 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:57:38 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Flow 'volume_create_manager' (2108016f-215d-4da0-af8f-832a8b93ca3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:38 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf78e2a6-eae7-43c7-bb1c-af5bbff5f8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:38 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf78e2a6-eae7-43c7-bb1c-af5bbff5f8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6ee7065-bb7c-4bd1-a4a9-cfede05d410a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85043c23e4aa47aab0b447b690c480db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:57:39Z,use_quota=True,user_id='79fdf17408b540a3a0eadb1fd931ecc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d03e70c-6c35-4137-adb0-16a1301e3529),volume_type_id=5d03e70c-6c35-4137-adb0-16a1301e3529)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:38 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7d00a3c-67f6-4bbf-872e-a741a5fb2107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:38 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7d00a3c-67f6-4bbf-872e-a741a5fb2107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:38 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9897c96d-fb4c-4b08-b8dd-de9d2f25013d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:38 devstack cinder-volume[89090]: DEBUG cinder.image.glance [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Creating Keystone auth plugin from conf {{(pid=89090) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 10:57:38 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9897c96d-fb4c-4b08-b8dd-de9d2f25013d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b6ee7065-bb7c-4bd1-a4a9-cfede05d410a', 'volume_name': 'volume-b6ee7065-bb7c-4bd1-a4a9-cfede05d410a', 'volume_size': 1, 'image_id': '0eeab9ec-906b-4fc0-a5e6-857e4395d7a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0eeab9ec-906b-4fc0-a5e6-857e4395d7a0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '980781813d802659b53f4dcbd82437b3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '85043c23e4aa47aab0b447b690c480db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '61bb96cfa5f9b4e7fbdf883d72a08226efb62185eb30d2d98cc60748a3b6c4319cf314f5240f0f276e550cd9873d02194cdb3e44ce5e8c472f4bd3b73cc27596', 'id': '0eeab9ec-906b-4fc0-a5e6-857e4395d7a0', 'created_at': datetime.datetime(2026, 7, 31, 8, 57, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 57, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0eeab9ec-906b-4fc0-a5e6-857e4395d7a0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:38 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6e2fc33-dbb9-4e70-8ee0-0ad0d75a1303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:38 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6e2fc33-dbb9-4e70-8ee0-0ad0d75a1303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:38 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f59b9dd5-d3a2-43db-b697-8e313c8ae03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:38 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Volume b6ee7065-bb7c-4bd1-a4a9-cfede05d410a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b6ee7065-bb7c-4bd1-a4a9-cfede05d410a', 'volume_size': 1, 'image_id': '0eeab9ec-906b-4fc0-a5e6-857e4395d7a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0eeab9ec-906b-4fc0-a5e6-857e4395d7a0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '980781813d802659b53f4dcbd82437b3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '85043c23e4aa47aab0b447b690c480db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '61bb96cfa5f9b4e7fbdf883d72a08226efb62185eb30d2d98cc60748a3b6c4319cf314f5240f0f276e550cd9873d02194cdb3e44ce5e8c472f4bd3b73cc27596', 'id': '0eeab9ec-906b-4fc0-a5e6-857e4395d7a0', 'created_at': datetime.datetime(2026, 7, 31, 8, 57, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 57, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0eeab9ec-906b-4fc0-a5e6-857e4395d7a0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 31 10:57:38 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Trying to clone b6ee7065-bb7c-4bd1-a4a9-cfede05d410a from image 0eeab9ec-906b-4fc0-a5e6-857e4395d7a0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0eeab9ec-906b-4fc0-a5e6-857e4395d7a0', 'metadata': {}}]). {{(pid=89090) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 10:57:39 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0eeab9ec-906b-4fc0-a5e6-857e4395d7a0_5g58b8l0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89090) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 10:57:39 devstack cinder-volume[89090]: INFO cinder.image.image_utils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Image download 0.00 MB at 0.00 MB/s Jul 31 10:57:39 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[7995209b-be73-433d-9dca-152ea427bcee]: (4, 'raw') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0eeab9ec-906b-4fc0-a5e6-857e4395d7a0_5g58b8l0devstack@QuobyteHD {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:39 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0eeab9ec-906b-4fc0-a5e6-857e4395d7a0_5g58b8l0devstack@QuobyteHD Jul 31 10:57:39 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:39 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0eeab9ec-906b-4fc0-a5e6-857e4395d7a0_5g58b8l0devstack@QuobyteHD" returned: 0 in 0.365s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0eeab9ec-906b-4fc0-a5e6-857e4395d7a0_5g58b8l0devstack@QuobyteHD {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:39 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0eeab9ec-906b-4fc0-a5e6-857e4395d7a0_5g58b8l0devstack@QuobyteHD Jul 31 10:57:39 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:39 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0eeab9ec-906b-4fc0-a5e6-857e4395d7a0_5g58b8l0devstack@QuobyteHD" returned: 1 in 0.328s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0eeab9ec-906b-4fc0-a5e6-857e4395d7a0_5g58b8l0devstack@QuobyteHD' failed. Not Retrying. {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 10:57:39 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Temporary image 0eeab9ec-906b-4fc0-a5e6-857e4395d7a0 is fetched for user 79fdf17408b540a3a0eadb1fd931ecc1. {{(pid=89090) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 10:57:39 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4897fa-ff2d-4243-afab-59ae8d4ccf69]: (4, 'raw') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0eeab9ec-906b-4fc0-a5e6-857e4395d7a0_5g58b8l0devstack@QuobyteHD {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:39 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0eeab9ec-906b-4fc0-a5e6-857e4395d7a0_5g58b8l0devstack@QuobyteHD Jul 31 10:57:39 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:40 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0eeab9ec-906b-4fc0-a5e6-857e4395d7a0_5g58b8l0devstack@QuobyteHD" returned: 0 in 0.325s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0eeab9ec-906b-4fc0-a5e6-857e4395d7a0_5g58b8l0devstack@QuobyteHD {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:40 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0eeab9ec-906b-4fc0-a5e6-857e4395d7a0_5g58b8l0devstack@QuobyteHD Jul 31 10:57:40 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:40 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0eeab9ec-906b-4fc0-a5e6-857e4395d7a0_5g58b8l0devstack@QuobyteHD" returned: 1 in 0.326s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0eeab9ec-906b-4fc0-a5e6-857e4395d7a0_5g58b8l0devstack@QuobyteHD' failed. Not Retrying. {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 10:57:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:40 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6ee7065-bb7c-4bd1-a4a9-cfede05d410a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85043c23e4aa47aab0b447b690c480db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:57:39Z,use_quota=True,user_id='79fdf17408b540a3a0eadb1fd931ecc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d03e70c-6c35-4137-adb0-16a1301e3529),volume_type_id=5d03e70c-6c35-4137-adb0-16a1301e3529)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:57:40 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Creating volume b6ee7065-bb7c-4bd1-a4a9-cfede05d410a {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:57:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:40 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:57:40 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:57:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:40 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:57:40 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:57:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b6ee7065-bb7c-4bd1-a4a9-cfede05d410a 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:40 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b6ee7065-bb7c-4bd1-a4a9-cfede05d410a 1073741824 Jul 31 10:57:40 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:40 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b6ee7065-bb7c-4bd1-a4a9-cfede05d410a 1073741824" returned: 0 in 0.444s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b6ee7065-bb7c-4bd1-a4a9-cfede05d410a {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:41 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b6ee7065-bb7c-4bd1-a4a9-cfede05d410a Jul 31 10:57:41 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:41 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b6ee7065-bb7c-4bd1-a4a9-cfede05d410a" returned: 0 in 0.267s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:41 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:57:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:41 devstack cinder-volume[89090]: DEBUG cinder.volume.volume_utils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Attempting download of 0eeab9ec-906b-4fc0-a5e6-857e4395d7a0 ((None, [{'url': 'file:///opt/stack/data/glance/images/0eeab9ec-906b-4fc0-a5e6-857e4395d7a0', 'metadata': {}}])) to volume b6ee7065-bb7c-4bd1-a4a9-cfede05d410a. {{(pid=89090) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 10:57:41 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b350131-3dfd-44a8-9d03-d2aca1a39d06]: (4, 'raw') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0eeab9ec-906b-4fc0-a5e6-857e4395d7a0_3042u0j1 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:41 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0eeab9ec-906b-4fc0-a5e6-857e4395d7a0_3042u0j1 Jul 31 10:57:41 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:41 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0eeab9ec-906b-4fc0-a5e6-857e4395d7a0_3042u0j1" returned: 0 in 0.353s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0eeab9ec-906b-4fc0-a5e6-857e4395d7a0_3042u0j1 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:41 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0eeab9ec-906b-4fc0-a5e6-857e4395d7a0_3042u0j1 Jul 31 10:57:41 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:42 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0eeab9ec-906b-4fc0-a5e6-857e4395d7a0_3042u0j1" returned: 1 in 0.362s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0eeab9ec-906b-4fc0-a5e6-857e4395d7a0_3042u0j1' failed. Not Retrying. {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 10:57:42 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d3948e-08e4-480d-9ba1-3af82d441bc9]: (4, 'raw') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0eeab9ec-906b-4fc0-a5e6-857e4395d7a0_5g58b8l0devstack@QuobyteHD {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:42 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0eeab9ec-906b-4fc0-a5e6-857e4395d7a0_5g58b8l0devstack@QuobyteHD Jul 31 10:57:42 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:42 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0eeab9ec-906b-4fc0-a5e6-857e4395d7a0_5g58b8l0devstack@QuobyteHD" returned: 0 in 0.378s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0eeab9ec-906b-4fc0-a5e6-857e4395d7a0_5g58b8l0devstack@QuobyteHD {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:42 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0eeab9ec-906b-4fc0-a5e6-857e4395d7a0_5g58b8l0devstack@QuobyteHD Jul 31 10:57:42 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:42 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0eeab9ec-906b-4fc0-a5e6-857e4395d7a0_5g58b8l0devstack@QuobyteHD" returned: 1 in 0.351s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0eeab9ec-906b-4fc0-a5e6-857e4395d7a0_5g58b8l0devstack@QuobyteHD' failed. Not Retrying. {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 10:57:42 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] 0eeab9ec-906b-4fc0-a5e6-857e4395d7a0 was raw, converting to qcow2 {{(pid=89090) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 10:57:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0eeab9ec-906b-4fc0-a5e6-857e4395d7a0_5g58b8l0devstack@QuobyteHD /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b6ee7065-bb7c-4bd1-a4a9-cfede05d410a {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:42 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0eeab9ec-906b-4fc0-a5e6-857e4395d7a0_5g58b8l0devstack@QuobyteHD /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b6ee7065-bb7c-4bd1-a4a9-cfede05d410a Jul 31 10:57:42 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:43 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0eeab9ec-906b-4fc0-a5e6-857e4395d7a0_5g58b8l0devstack@QuobyteHD /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b6ee7065-bb7c-4bd1-a4a9-cfede05d410a" returned: 0 in 0.435s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:43 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0eeab9ec-906b-4fc0-a5e6-857e4395d7a0_5g58b8l0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b6ee7065-bb7c-4bd1-a4a9-cfede05d410a {{(pid=89090) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 10:57:43 devstack cinder-volume[89090]: INFO cinder.image.image_utils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Converted 0.00 MB image at 0.00 MB/s Jul 31 10:57:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b6ee7065-bb7c-4bd1-a4a9-cfede05d410a 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:43 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b6ee7065-bb7c-4bd1-a4a9-cfede05d410a 1G Jul 31 10:57:43 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:43 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b6ee7065-bb7c-4bd1-a4a9-cfede05d410a 1G" returned: 0 in 0.323s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:43 devstack cinder-volume[89090]: DEBUG cinder.volume.volume_utils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Downloaded image 0eeab9ec-906b-4fc0-a5e6-857e4395d7a0 ((None, [{'url': 'file:///opt/stack/data/glance/images/0eeab9ec-906b-4fc0-a5e6-857e4395d7a0', 'metadata': {}}])) to volume b6ee7065-bb7c-4bd1-a4a9-cfede05d410a successfully. {{(pid=89090) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 10:57:43 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Temporary image 0eeab9ec-906b-4fc0-a5e6-857e4395d7a0 for user 79fdf17408b540a3a0eadb1fd931ecc1 is deleted. {{(pid=89090) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 10:57:43 devstack cinder-volume[89090]: DEBUG cinder.volume.volume_utils [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Marking volume b6ee7065-bb7c-4bd1-a4a9-cfede05d410a as bootable. {{(pid=89090) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 10:57:43 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Copying metadata from image 0eeab9ec-906b-4fc0-a5e6-857e4395d7a0 to b6ee7065-bb7c-4bd1-a4a9-cfede05d410a. {{(pid=89090) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 10:57:43 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Creating volume glance metadata for volume b6ee7065-bb7c-4bd1-a4a9-cfede05d410a backed by image 0eeab9ec-906b-4fc0-a5e6-857e4395d7a0 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '0eeab9ec-906b-4fc0-a5e6-857e4395d7a0', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '980781813d802659b53f4dcbd82437b3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89090) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 10:57:43 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f59b9dd5-d3a2-43db-b697-8e313c8ae03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6ee7065-bb7c-4bd1-a4a9-cfede05d410a', 'volume_size': 1, 'image_id': '0eeab9ec-906b-4fc0-a5e6-857e4395d7a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0eeab9ec-906b-4fc0-a5e6-857e4395d7a0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '980781813d802659b53f4dcbd82437b3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '85043c23e4aa47aab0b447b690c480db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '61bb96cfa5f9b4e7fbdf883d72a08226efb62185eb30d2d98cc60748a3b6c4319cf314f5240f0f276e550cd9873d02194cdb3e44ce5e8c472f4bd3b73cc27596', 'id': '0eeab9ec-906b-4fc0-a5e6-857e4395d7a0', 'created_at': datetime.datetime(2026, 7, 31, 8, 57, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 57, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0eeab9ec-906b-4fc0-a5e6-857e4395d7a0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:43 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (062d1793-511f-405c-bf9b-c8ddf42bee78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:43 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Volume volume-b6ee7065-bb7c-4bd1-a4a9-cfede05d410a (b6ee7065-bb7c-4bd1-a4a9-cfede05d410a): created successfully Jul 31 10:57:43 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (062d1793-511f-405c-bf9b-c8ddf42bee78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:43 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Flow 'volume_create_manager' (2108016f-215d-4da0-af8f-832a8b93ca3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:43 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-f96f433d-a8ac-40f1-8f83-6450128aa7ae tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Created volume successfully. Jul 31 10:57:43 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-b57b081f-a6b3-4cdc-a5b1-6dfe88050756 tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Acquiring lock "cinder-b6ee7065-bb7c-4bd1-a4a9-cfede05d410a-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:43 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-b57b081f-a6b3-4cdc-a5b1-6dfe88050756 tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Lock "cinder-b6ee7065-bb7c-4bd1-a4a9-cfede05d410a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:44 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-b57b081f-a6b3-4cdc-a5b1-6dfe88050756 tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Acquiring lock "cinder-quobyte-b6ee7065-bb7c-4bd1-a4a9-cfede05d410a" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:44 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-b57b081f-a6b3-4cdc-a5b1-6dfe88050756 tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Lock "cinder-quobyte-b6ee7065-bb7c-4bd1-a4a9-cfede05d410a" acquired by "delete_volume" :: waited 0.025s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:44 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf9c761-44cd-41c2-9a63-bf0753d89b69]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b57b081f-a6b3-4cdc-a5b1-6dfe88050756 tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b6ee7065-bb7c-4bd1-a4a9-cfede05d410a {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:44 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b6ee7065-bb7c-4bd1-a4a9-cfede05d410a Jul 31 10:57:44 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:44 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b57b081f-a6b3-4cdc-a5b1-6dfe88050756 tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b6ee7065-bb7c-4bd1-a4a9-cfede05d410a" returned: 0 in 0.415s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b57b081f-a6b3-4cdc-a5b1-6dfe88050756 tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b6ee7065-bb7c-4bd1-a4a9-cfede05d410a {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:44 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b6ee7065-bb7c-4bd1-a4a9-cfede05d410a Jul 31 10:57:44 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:44 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b57b081f-a6b3-4cdc-a5b1-6dfe88050756 tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b6ee7065-bb7c-4bd1-a4a9-cfede05d410a" returned: 0 in 0.271s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:44 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-b57b081f-a6b3-4cdc-a5b1-6dfe88050756 tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Lock "cinder-quobyte-b6ee7065-bb7c-4bd1-a4a9-cfede05d410a" released by "delete_volume" :: held 0.726s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:44 devstack cinder-volume[89090]: WARNING cinder.quota [None req-b57b081f-a6b3-4cdc-a5b1-6dfe88050756 tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:57:44 devstack cinder-volume[89090]: WARNING cinder.quota [None req-b57b081f-a6b3-4cdc-a5b1-6dfe88050756 tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:57:44 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-b57b081f-a6b3-4cdc-a5b1-6dfe88050756 tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Created reservations ['7bf25798-2d8f-4474-a919-b048d5d1b513', 'f8360cb6-f0bc-49da-bc25-57c64a1ea765', 'b1ee27b2-9ba1-4dd5-a34d-171b54bbf431', '8669c335-7933-46c7-be6f-c17fa274e36e'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:57:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b57b081f-a6b3-4cdc-a5b1-6dfe88050756 tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b57b081f-a6b3-4cdc-a5b1-6dfe88050756 tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:44 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-b57b081f-a6b3-4cdc-a5b1-6dfe88050756 tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:57:44 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-b57b081f-a6b3-4cdc-a5b1-6dfe88050756 tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:57:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b57b081f-a6b3-4cdc-a5b1-6dfe88050756 tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b57b081f-a6b3-4cdc-a5b1-6dfe88050756 tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:44 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:57:44 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:45 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b57b081f-a6b3-4cdc-a5b1-6dfe88050756 tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.266s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:45 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-b57b081f-a6b3-4cdc-a5b1-6dfe88050756 tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:57:45 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-b57b081f-a6b3-4cdc-a5b1-6dfe88050756 tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Deleted volume successfully. Jul 31 10:57:45 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-b57b081f-a6b3-4cdc-a5b1-6dfe88050756 tempest-VolumeAndVolumeTypeFromImageTest-2085092176 None] Lock "cinder-b6ee7065-bb7c-4bd1-a4a9-cfede05d410a-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:45 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:57:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:57:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:57:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:46 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:57:46 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:46 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.301s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:46 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:57:46 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager._thread_info {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:57:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread count: 28 {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:57:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread info: [<_MainThread(MainThread, started 134005426110592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:57:49 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb224619-a71e-4624-a7ae-88038d9eef5d tempest-VolumeDependencyTests-299075907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:57:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bb224619-a71e-4624-a7ae-88038d9eef5d tempest-VolumeDependencyTests-299075907 None] Flow 'volume_create_manager' (37e253ab-ec24-4361-b394-56869b2acc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bb224619-a71e-4624-a7ae-88038d9eef5d tempest-VolumeDependencyTests-299075907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a651f6b2-6c3c-4fc8-bb4a-bbcf2d5ff274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bb224619-a71e-4624-a7ae-88038d9eef5d tempest-VolumeDependencyTests-299075907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a651f6b2-6c3c-4fc8-bb4a-bbcf2d5ff274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1042224309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca112e4b-1fee-4fe2-9758-1c54a8aefb2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ce8e84c5605434fb6f10ad0db15ab40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:57:50Z,use_quota=True,user_id='9e02d591fdc740ecbdc501fb1df8696e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bb224619-a71e-4624-a7ae-88038d9eef5d tempest-VolumeDependencyTests-299075907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0b8b106-0584-4d43-ad65-657049503c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bb224619-a71e-4624-a7ae-88038d9eef5d tempest-VolumeDependencyTests-299075907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0b8b106-0584-4d43-ad65-657049503c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bb224619-a71e-4624-a7ae-88038d9eef5d tempest-VolumeDependencyTests-299075907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6543749d-7827-46ad-ba80-f0daf81fdbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bb224619-a71e-4624-a7ae-88038d9eef5d tempest-VolumeDependencyTests-299075907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6543749d-7827-46ad-ba80-f0daf81fdbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca112e4b-1fee-4fe2-9758-1c54a8aefb2b', 'volume_name': 'volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bb224619-a71e-4624-a7ae-88038d9eef5d tempest-VolumeDependencyTests-299075907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65c05e67-8a11-4459-98e3-8a5e6da0e13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bb224619-a71e-4624-a7ae-88038d9eef5d tempest-VolumeDependencyTests-299075907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65c05e67-8a11-4459-98e3-8a5e6da0e13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bb224619-a71e-4624-a7ae-88038d9eef5d tempest-VolumeDependencyTests-299075907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a928ee-cbb1-42f8-9755-aa1795003118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:49 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-bb224619-a71e-4624-a7ae-88038d9eef5d tempest-VolumeDependencyTests-299075907 None] Volume ca112e4b-1fee-4fe2-9758-1c54a8aefb2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b', 'volume_size': 1} Jul 31 10:57:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-bb224619-a71e-4624-a7ae-88038d9eef5d tempest-VolumeDependencyTests-299075907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-bb224619-a71e-4624-a7ae-88038d9eef5d tempest-VolumeDependencyTests-299075907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-bb224619-a71e-4624-a7ae-88038d9eef5d tempest-VolumeDependencyTests-299075907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1042224309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca112e4b-1fee-4fe2-9758-1c54a8aefb2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ce8e84c5605434fb6f10ad0db15ab40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:57:50Z,use_quota=True,user_id='9e02d591fdc740ecbdc501fb1df8696e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:57:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-bb224619-a71e-4624-a7ae-88038d9eef5d tempest-VolumeDependencyTests-299075907 None] Creating volume ca112e4b-1fee-4fe2-9758-1c54a8aefb2b {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:57:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-bb224619-a71e-4624-a7ae-88038d9eef5d tempest-VolumeDependencyTests-299075907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-bb224619-a71e-4624-a7ae-88038d9eef5d tempest-VolumeDependencyTests-299075907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-bb224619-a71e-4624-a7ae-88038d9eef5d tempest-VolumeDependencyTests-299075907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:57:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-bb224619-a71e-4624-a7ae-88038d9eef5d tempest-VolumeDependencyTests-299075907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:57:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-bb224619-a71e-4624-a7ae-88038d9eef5d tempest-VolumeDependencyTests-299075907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-bb224619-a71e-4624-a7ae-88038d9eef5d tempest-VolumeDependencyTests-299075907 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:57:49 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-bb224619-a71e-4624-a7ae-88038d9eef5d tempest-VolumeDependencyTests-299075907 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:57:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bb224619-a71e-4624-a7ae-88038d9eef5d tempest-VolumeDependencyTests-299075907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:49 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b 1073741824 Jul 31 10:57:49 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:50 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bb224619-a71e-4624-a7ae-88038d9eef5d tempest-VolumeDependencyTests-299075907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b 1073741824" returned: 0 in 0.438s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bb224619-a71e-4624-a7ae-88038d9eef5d tempest-VolumeDependencyTests-299075907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:50 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b Jul 31 10:57:50 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:50 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bb224619-a71e-4624-a7ae-88038d9eef5d tempest-VolumeDependencyTests-299075907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b" returned: 0 in 0.254s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:50 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-bb224619-a71e-4624-a7ae-88038d9eef5d tempest-VolumeDependencyTests-299075907 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:57:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-bb224619-a71e-4624-a7ae-88038d9eef5d tempest-VolumeDependencyTests-299075907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bb224619-a71e-4624-a7ae-88038d9eef5d tempest-VolumeDependencyTests-299075907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a928ee-cbb1-42f8-9755-aa1795003118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bb224619-a71e-4624-a7ae-88038d9eef5d tempest-VolumeDependencyTests-299075907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2b1a8f6-aee7-4d9f-897f-e00b34e1711a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:50 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-bb224619-a71e-4624-a7ae-88038d9eef5d tempest-VolumeDependencyTests-299075907 None] Volume volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b (ca112e4b-1fee-4fe2-9758-1c54a8aefb2b): created successfully Jul 31 10:57:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bb224619-a71e-4624-a7ae-88038d9eef5d tempest-VolumeDependencyTests-299075907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2b1a8f6-aee7-4d9f-897f-e00b34e1711a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bb224619-a71e-4624-a7ae-88038d9eef5d tempest-VolumeDependencyTests-299075907 None] Flow 'volume_create_manager' (37e253ab-ec24-4361-b394-56869b2acc00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:50 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-bb224619-a71e-4624-a7ae-88038d9eef5d tempest-VolumeDependencyTests-299075907 None] Created volume successfully. Jul 31 10:57:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-dbd29824-0d7b-4d3c-9160-1a164b90bbcf tempest-VolumeDependencyTests-299075907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-dbd29824-0d7b-4d3c-9160-1a164b90bbcf tempest-VolumeDependencyTests-299075907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:51 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-dbd29824-0d7b-4d3c-9160-1a164b90bbcf tempest-VolumeDependencyTests-299075907 None] Creating offline snapshot d9554524-615e-442f-b1eb-158336515a47 of volume ca112e4b-1fee-4fe2-9758-1c54a8aefb2b {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:57:51 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b7e863-a1e6-48d5-97e1-a8e5b6052990]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dbd29824-0d7b-4d3c-9160-1a164b90bbcf tempest-VolumeDependencyTests-299075907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:51 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b Jul 31 10:57:51 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:51 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dbd29824-0d7b-4d3c-9160-1a164b90bbcf tempest-VolumeDependencyTests-299075907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b" returned: 0 in 0.370s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dbd29824-0d7b-4d3c-9160-1a164b90bbcf tempest-VolumeDependencyTests-299075907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b.d9554524-615e-442f-b1eb-158336515a47 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:51 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b.d9554524-615e-442f-b1eb-158336515a47 1G Jul 31 10:57:51 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:51 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dbd29824-0d7b-4d3c-9160-1a164b90bbcf tempest-VolumeDependencyTests-299075907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b.d9554524-615e-442f-b1eb-158336515a47 1G" returned: 0 in 0.398s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dbd29824-0d7b-4d3c-9160-1a164b90bbcf tempest-VolumeDependencyTests-299075907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b.d9554524-615e-442f-b1eb-158336515a47 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:51 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b.d9554524-615e-442f-b1eb-158336515a47 Jul 31 10:57:51 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:52 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dbd29824-0d7b-4d3c-9160-1a164b90bbcf tempest-VolumeDependencyTests-299075907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b.d9554524-615e-442f-b1eb-158336515a47" returned: 0 in 0.287s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:52 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-dbd29824-0d7b-4d3c-9160-1a164b90bbcf tempest-VolumeDependencyTests-299075907 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b.d9554524-615e-442f-b1eb-158336515a47 is being set with open permissions: ugo+rw Jul 31 10:57:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dbd29824-0d7b-4d3c-9160-1a164b90bbcf tempest-VolumeDependencyTests-299075907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b.d9554524-615e-442f-b1eb-158336515a47 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:52 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b.d9554524-615e-442f-b1eb-158336515a47 Jul 31 10:57:52 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:52 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dbd29824-0d7b-4d3c-9160-1a164b90bbcf tempest-VolumeDependencyTests-299075907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b.d9554524-615e-442f-b1eb-158336515a47" returned: 0 in 0.238s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dbd29824-0d7b-4d3c-9160-1a164b90bbcf tempest-VolumeDependencyTests-299075907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:52 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b.info Jul 31 10:57:52 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:52 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dbd29824-0d7b-4d3c-9160-1a164b90bbcf tempest-VolumeDependencyTests-299075907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b.info" returned: 0 in 0.242s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:52 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-dbd29824-0d7b-4d3c-9160-1a164b90bbcf tempest-VolumeDependencyTests-299075907 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b.info is being set with open permissions: ugo+rw Jul 31 10:57:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dbd29824-0d7b-4d3c-9160-1a164b90bbcf tempest-VolumeDependencyTests-299075907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:52 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b.info Jul 31 10:57:52 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:52 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dbd29824-0d7b-4d3c-9160-1a164b90bbcf tempest-VolumeDependencyTests-299075907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b.info" returned: 0 in 0.263s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-dbd29824-0d7b-4d3c-9160-1a164b90bbcf tempest-VolumeDependencyTests-299075907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.881s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:52 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-dbd29824-0d7b-4d3c-9160-1a164b90bbcf tempest-VolumeDependencyTests-299075907 None] Create snapshot completed successfully Jul 31 10:57:53 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:57:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Flow 'volume_create_manager' (7a70ffd7-9e22-462d-a85e-2c017e055126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7465e0fe-15a7-4c77-9959-613b9152d803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7465e0fe-15a7-4c77-9959-613b9152d803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1067551898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a576c9-2ac9-4f9c-b75c-06990fd40136,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ce8e84c5605434fb6f10ad0db15ab40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d9554524-615e-442f-b1eb-158336515a47,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:57:54Z,use_quota=True,user_id='9e02d591fdc740ecbdc501fb1df8696e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bee208bc-7b45-4919-b6fa-d206d759c295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bee208bc-7b45-4919-b6fa-d206d759c295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eae94b29-8e08-4804-aa97-63a66d074ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eae94b29-8e08-4804-aa97-63a66d074ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c0a576c9-2ac9-4f9c-b75c-06990fd40136', 'volume_name': 'volume-c0a576c9-2ac9-4f9c-b75c-06990fd40136', 'volume_size': 1, 'snapshot_id': 'd9554524-615e-442f-b1eb-158336515a47'}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (960c7236-3b20-4cbc-8fca-c67b18fe6c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (960c7236-3b20-4cbc-8fca-c67b18fe6c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b53c619b-4518-4bea-b00f-eed0bc5e784a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:53 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Volume c0a576c9-2ac9-4f9c-b75c-06990fd40136: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c0a576c9-2ac9-4f9c-b75c-06990fd40136', 'volume_size': 1, 'snapshot_id': 'd9554524-615e-442f-b1eb-158336515a47'} Jul 31 10:57:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:53 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Acquiring lock "cinder-quobyte-d9554524-615e-442f-b1eb-158336515a47-c0a576c9-2ac9-4f9c-b75c-06990fd40136" by "_create_volume_from_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:53 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Lock "cinder-quobyte-d9554524-615e-442f-b1eb-158336515a47-c0a576c9-2ac9-4f9c-b75c-06990fd40136" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:53 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Creating volume c0a576c9-2ac9-4f9c-b75c-06990fd40136 from snapshot d9554524-615e-442f-b1eb-158336515a47 {{(pid=89090) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 10:57:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:53 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:57:53 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:57:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:53 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:57:53 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Acquiring lock "cinder-quobyte-c0a576c9-2ac9-4f9c-b75c-06990fd40136" by "_copy_volume_from_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:53 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Lock "cinder-quobyte-c0a576c9-2ac9-4f9c-b75c-06990fd40136" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:53 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] snapshot: d9554524-615e-442f-b1eb-158336515a47, volume: c0a576c9-2ac9-4f9c-b75c-06990fd40136, {{(pid=89090) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 10:57:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:53 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:57:53 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:57:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:53 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ffa74d-ce55-4829-a925-fd0280dcc6d8]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b.d9554524-615e-442f-b1eb-158336515a47 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:54 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b.d9554524-615e-442f-b1eb-158336515a47 Jul 31 10:57:54 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:54 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b.d9554524-615e-442f-b1eb-158336515a47" returned: 0 in 0.357s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:54 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:57:54 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[712b6db0-aeb3-45c6-aaef-450d1bcf20fa]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:54 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b Jul 31 10:57:54 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:54 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b" returned: 0 in 0.390s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:54 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b {{(pid=89090) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 10:57:54 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Creating direct copy from snapshot {{(pid=89090) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 10:57:54 devstack cinder-volume[89090]: DEBUG cinder.utils [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Path /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c0a576c9-2ac9-4f9c-b75c-06990fd40136 not found in is_blk_device check {{(pid=89090) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 10:57:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c0a576c9-2ac9-4f9c-b75c-06990fd40136 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:54 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c0a576c9-2ac9-4f9c-b75c-06990fd40136 Jul 31 10:57:54 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:58 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c0a576c9-2ac9-4f9c-b75c-06990fd40136" returned: 0 in 4.296s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:58 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Image conversion details: src /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b, size 1024.00 MB, duration 4.30 sec, destination /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c0a576c9-2ac9-4f9c-b75c-06990fd40136 {{(pid=89090) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 10:57:58 devstack cinder-volume[89090]: INFO cinder.image.image_utils [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Converted 1024.00 MB image at 238.28 MB/s Jul 31 10:57:58 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c0a576c9-2ac9-4f9c-b75c-06990fd40136 is being set with open permissions: ugo+rw Jul 31 10:57:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c0a576c9-2ac9-4f9c-b75c-06990fd40136 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:58 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c0a576c9-2ac9-4f9c-b75c-06990fd40136 Jul 31 10:57:59 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:59 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c0a576c9-2ac9-4f9c-b75c-06990fd40136" returned: 0 in 0.273s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:59 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Lock "cinder-quobyte-c0a576c9-2ac9-4f9c-b75c-06990fd40136" released by "_copy_volume_from_snapshot" :: held 5.396s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:59 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Lock "cinder-quobyte-d9554524-615e-442f-b1eb-158336515a47-c0a576c9-2ac9-4f9c-b75c-06990fd40136" released by "_create_volume_from_snapshot" :: held 5.475s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.490s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:59 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b53c619b-4518-4bea-b00f-eed0bc5e784a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0a576c9-2ac9-4f9c-b75c-06990fd40136', 'volume_size': 1, 'snapshot_id': 'd9554524-615e-442f-b1eb-158336515a47'}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:59 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e2b793b-ec27-41c0-924a-48b926999924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:59 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Volume volume-c0a576c9-2ac9-4f9c-b75c-06990fd40136 (c0a576c9-2ac9-4f9c-b75c-06990fd40136): created successfully Jul 31 10:57:59 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e2b793b-ec27-41c0-924a-48b926999924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:59 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Flow 'volume_create_manager' (7a70ffd7-9e22-462d-a85e-2c017e055126) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:59 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-05702e81-4c4d-4d55-abc2-4679de037739 tempest-VolumeDependencyTests-299075907 None] Created volume successfully. Jul 31 10:58:00 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2f69ec81-2f83-42a5-922f-87c7f6559d3d tempest-VolumeDependencyTests-299075907 None] Acquiring lock "cinder-d9554524-615e-442f-b1eb-158336515a47-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:00 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2f69ec81-2f83-42a5-922f-87c7f6559d3d tempest-VolumeDependencyTests-299075907 None] Lock "cinder-d9554524-615e-442f-b1eb-158336515a47-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:00 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2f69ec81-2f83-42a5-922f-87c7f6559d3d tempest-VolumeDependencyTests-299075907 None] Acquiring lock "cinder-quobyte-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:00 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2f69ec81-2f83-42a5-922f-87c7f6559d3d tempest-VolumeDependencyTests-299075907 None] Lock "cinder-quobyte-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:00 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2f69ec81-2f83-42a5-922f-87c7f6559d3d tempest-VolumeDependencyTests-299075907 None] Acquiring lock "cinder-quobyte-d9554524-615e-442f-b1eb-158336515a47" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:00 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2f69ec81-2f83-42a5-922f-87c7f6559d3d tempest-VolumeDependencyTests-299075907 None] Lock "cinder-quobyte-d9554524-615e-442f-b1eb-158336515a47" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:00 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-2f69ec81-2f83-42a5-922f-87c7f6559d3d tempest-VolumeDependencyTests-299075907 None] Deleting offline snapshot d9554524-615e-442f-b1eb-158336515a47 of volume ca112e4b-1fee-4fe2-9758-1c54a8aefb2b {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:58:00 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-2f69ec81-2f83-42a5-922f-87c7f6559d3d tempest-VolumeDependencyTests-299075907 None] snapshot_file for this snap is: volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b.d9554524-615e-442f-b1eb-158336515a47 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:58:00 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[60380273-d062-46aa-8613-b0305b9c95b8]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2f69ec81-2f83-42a5-922f-87c7f6559d3d tempest-VolumeDependencyTests-299075907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b.d9554524-615e-442f-b1eb-158336515a47 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:00 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b.d9554524-615e-442f-b1eb-158336515a47 Jul 31 10:58:00 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:00 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2f69ec81-2f83-42a5-922f-87c7f6559d3d tempest-VolumeDependencyTests-299075907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b.d9554524-615e-442f-b1eb-158336515a47" returned: 0 in 0.373s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:00 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-2f69ec81-2f83-42a5-922f-87c7f6559d3d tempest-VolumeDependencyTests-299075907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:58:00 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[90bd0a24-d2c0-4c75-954c-8765ec751a65]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2f69ec81-2f83-42a5-922f-87c7f6559d3d tempest-VolumeDependencyTests-299075907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:00 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b Jul 31 10:58:00 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:01 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2f69ec81-2f83-42a5-922f-87c7f6559d3d tempest-VolumeDependencyTests-299075907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b" returned: 0 in 0.637s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2f69ec81-2f83-42a5-922f-87c7f6559d3d tempest-VolumeDependencyTests-299075907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b.d9554524-615e-442f-b1eb-158336515a47 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:01 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b.d9554524-615e-442f-b1eb-158336515a47 Jul 31 10:58:01 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:01 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2f69ec81-2f83-42a5-922f-87c7f6559d3d tempest-VolumeDependencyTests-299075907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b.d9554524-615e-442f-b1eb-158336515a47" returned: 0 in 0.400s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2f69ec81-2f83-42a5-922f-87c7f6559d3d tempest-VolumeDependencyTests-299075907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b.d9554524-615e-442f-b1eb-158336515a47 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:01 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b.d9554524-615e-442f-b1eb-158336515a47 Jul 31 10:58:01 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:02 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2f69ec81-2f83-42a5-922f-87c7f6559d3d tempest-VolumeDependencyTests-299075907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b.d9554524-615e-442f-b1eb-158336515a47" returned: 0 in 0.279s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:02 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2f69ec81-2f83-42a5-922f-87c7f6559d3d tempest-VolumeDependencyTests-299075907 None] Lock "cinder-quobyte-d9554524-615e-442f-b1eb-158336515a47" released by "_delete_snapshot" :: held 1.809s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:02 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2f69ec81-2f83-42a5-922f-87c7f6559d3d tempest-VolumeDependencyTests-299075907 None] Lock "cinder-quobyte-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b" released by "delete_snapshot" :: held 1.841s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:02 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-2f69ec81-2f83-42a5-922f-87c7f6559d3d tempest-VolumeDependencyTests-299075907 None] Created reservations ['f3661ac0-d1c1-4720-99e8-f96bb250a716', '01d64567-073e-4abc-b7f4-77b231a39d0b', 'cab487c9-23e7-4ef5-97db-4dae1c2674ff', 'a79b82b4-3636-4f36-9872-9f5f37512c87'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:58:02 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-2f69ec81-2f83-42a5-922f-87c7f6559d3d tempest-VolumeDependencyTests-299075907 None] Delete snapshot completed successfully. Jul 31 10:58:02 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2f69ec81-2f83-42a5-922f-87c7f6559d3d tempest-VolumeDependencyTests-299075907 None] Lock "cinder-d9554524-615e-442f-b1eb-158336515a47-delete_snapshot" released by "delete_snapshot" :: held 2.007s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:02 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-26cab689-5825-440a-a82c-00d759aef1ce tempest-VolumeDependencyTests-299075907 None] Acquiring lock "cinder-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:02 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-26cab689-5825-440a-a82c-00d759aef1ce tempest-VolumeDependencyTests-299075907 None] Lock "cinder-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:02 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-26cab689-5825-440a-a82c-00d759aef1ce tempest-VolumeDependencyTests-299075907 None] Acquiring lock "cinder-quobyte-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:02 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-26cab689-5825-440a-a82c-00d759aef1ce tempest-VolumeDependencyTests-299075907 None] Lock "cinder-quobyte-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b" acquired by "delete_volume" :: waited 0.017s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:02 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e383ae-d56c-47a0-bfcd-034dbd6282ce]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-26cab689-5825-440a-a82c-00d759aef1ce tempest-VolumeDependencyTests-299075907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:02 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b Jul 31 10:58:02 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:03 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-26cab689-5825-440a-a82c-00d759aef1ce tempest-VolumeDependencyTests-299075907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b" returned: 0 in 0.409s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-26cab689-5825-440a-a82c-00d759aef1ce tempest-VolumeDependencyTests-299075907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:03 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b Jul 31 10:58:03 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:03 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-26cab689-5825-440a-a82c-00d759aef1ce tempest-VolumeDependencyTests-299075907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b" returned: 0 in 0.296s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:03 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-26cab689-5825-440a-a82c-00d759aef1ce tempest-VolumeDependencyTests-299075907 None] Lock "cinder-quobyte-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b" released by "delete_volume" :: held 0.777s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:03 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-26cab689-5825-440a-a82c-00d759aef1ce tempest-VolumeDependencyTests-299075907 None] Created reservations ['901fa408-1dc2-47fc-9ec1-bd2af7200ae2', '48573825-bc53-4db1-9e0d-dec4769eff6c', '41600a3c-1cc5-4ba9-99e4-7401831119ac', '60316da9-7b40-4243-a76f-feb7c3948eb4'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:58:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-26cab689-5825-440a-a82c-00d759aef1ce tempest-VolumeDependencyTests-299075907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-26cab689-5825-440a-a82c-00d759aef1ce tempest-VolumeDependencyTests-299075907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:03 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-26cab689-5825-440a-a82c-00d759aef1ce tempest-VolumeDependencyTests-299075907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:58:03 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-26cab689-5825-440a-a82c-00d759aef1ce tempest-VolumeDependencyTests-299075907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:58:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-26cab689-5825-440a-a82c-00d759aef1ce tempest-VolumeDependencyTests-299075907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-26cab689-5825-440a-a82c-00d759aef1ce tempest-VolumeDependencyTests-299075907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:03 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:58:03 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:03 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8bb5be20-df97-40a8-b14d-ab73baa740f0 tempest-VolumeDependencyTests-299075907 None] Acquiring lock "cinder-c0a576c9-2ac9-4f9c-b75c-06990fd40136-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:03 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8bb5be20-df97-40a8-b14d-ab73baa740f0 tempest-VolumeDependencyTests-299075907 None] Lock "cinder-c0a576c9-2ac9-4f9c-b75c-06990fd40136-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:03 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8bb5be20-df97-40a8-b14d-ab73baa740f0 tempest-VolumeDependencyTests-299075907 None] Acquiring lock "cinder-quobyte-c0a576c9-2ac9-4f9c-b75c-06990fd40136" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:03 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8bb5be20-df97-40a8-b14d-ab73baa740f0 tempest-VolumeDependencyTests-299075907 None] Lock "cinder-quobyte-c0a576c9-2ac9-4f9c-b75c-06990fd40136" acquired by "delete_volume" :: waited 0.018s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:03 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-26cab689-5825-440a-a82c-00d759aef1ce tempest-VolumeDependencyTests-299075907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.310s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:03 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-26cab689-5825-440a-a82c-00d759aef1ce tempest-VolumeDependencyTests-299075907 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:58:03 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-26cab689-5825-440a-a82c-00d759aef1ce tempest-VolumeDependencyTests-299075907 None] Deleted volume successfully. Jul 31 10:58:03 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4357d9-519b-42a7-8a07-f0586810a510]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8bb5be20-df97-40a8-b14d-ab73baa740f0 tempest-VolumeDependencyTests-299075907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c0a576c9-2ac9-4f9c-b75c-06990fd40136 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:03 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-26cab689-5825-440a-a82c-00d759aef1ce tempest-VolumeDependencyTests-299075907 None] Lock "cinder-ca112e4b-1fee-4fe2-9758-1c54a8aefb2b-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:03 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c0a576c9-2ac9-4f9c-b75c-06990fd40136 Jul 31 10:58:03 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:04 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8bb5be20-df97-40a8-b14d-ab73baa740f0 tempest-VolumeDependencyTests-299075907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c0a576c9-2ac9-4f9c-b75c-06990fd40136" returned: 0 in 0.392s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8bb5be20-df97-40a8-b14d-ab73baa740f0 tempest-VolumeDependencyTests-299075907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c0a576c9-2ac9-4f9c-b75c-06990fd40136 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:04 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c0a576c9-2ac9-4f9c-b75c-06990fd40136 Jul 31 10:58:04 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:04 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8bb5be20-df97-40a8-b14d-ab73baa740f0 tempest-VolumeDependencyTests-299075907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c0a576c9-2ac9-4f9c-b75c-06990fd40136" returned: 0 in 0.275s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:04 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8bb5be20-df97-40a8-b14d-ab73baa740f0 tempest-VolumeDependencyTests-299075907 None] Lock "cinder-quobyte-c0a576c9-2ac9-4f9c-b75c-06990fd40136" released by "delete_volume" :: held 0.724s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:04 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-8bb5be20-df97-40a8-b14d-ab73baa740f0 tempest-VolumeDependencyTests-299075907 None] Created reservations ['ced27bd6-7258-45bf-a2dc-72cd45b487ad', 'ca2c8374-8c2b-4ac7-bab9-5b306e4488fd', '9851e099-fb84-41ce-898d-665d3403d8f8', '35460831-fe92-4600-8ab0-16e53a42c31a'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:58:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8bb5be20-df97-40a8-b14d-ab73baa740f0 tempest-VolumeDependencyTests-299075907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8bb5be20-df97-40a8-b14d-ab73baa740f0 tempest-VolumeDependencyTests-299075907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-8bb5be20-df97-40a8-b14d-ab73baa740f0 tempest-VolumeDependencyTests-299075907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:58:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-8bb5be20-df97-40a8-b14d-ab73baa740f0 tempest-VolumeDependencyTests-299075907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:58:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8bb5be20-df97-40a8-b14d-ab73baa740f0 tempest-VolumeDependencyTests-299075907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8bb5be20-df97-40a8-b14d-ab73baa740f0 tempest-VolumeDependencyTests-299075907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:04 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:58:04 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:04 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8bb5be20-df97-40a8-b14d-ab73baa740f0 tempest-VolumeDependencyTests-299075907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.305s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:05 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-8bb5be20-df97-40a8-b14d-ab73baa740f0 tempest-VolumeDependencyTests-299075907 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:58:05 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-8bb5be20-df97-40a8-b14d-ab73baa740f0 tempest-VolumeDependencyTests-299075907 None] Deleted volume successfully. Jul 31 10:58:05 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8bb5be20-df97-40a8-b14d-ab73baa740f0 tempest-VolumeDependencyTests-299075907 None] Lock "cinder-c0a576c9-2ac9-4f9c-b75c-06990fd40136-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:08 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-622f04df-27f9-4cf8-bdf4-1e6cb16e0a7e tempest-CinderUnicodeTest-1915563821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:58:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-622f04df-27f9-4cf8-bdf4-1e6cb16e0a7e tempest-CinderUnicodeTest-1915563821 None] Flow 'volume_create_manager' (3a614d46-9c11-45bc-977d-d86405cbfb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-622f04df-27f9-4cf8-bdf4-1e6cb16e0a7e tempest-CinderUnicodeTest-1915563821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c6e10a7-9a64-426a-9772-dde182cf2ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-622f04df-27f9-4cf8-bdf4-1e6cb16e0a7e tempest-CinderUnicodeTest-1915563821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c6e10a7-9a64-426a-9772-dde182cf2ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3da811ee-9f7e-4556-917c-3c6df03507be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac87ab7e095e4f8781818615eba4b9e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:08Z,use_quota=True,user_id='2e83339ec53e4aa18e4dddfcb5253f59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-622f04df-27f9-4cf8-bdf4-1e6cb16e0a7e tempest-CinderUnicodeTest-1915563821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ae5b220-68c0-4ac8-9f59-b7c3dce52a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-622f04df-27f9-4cf8-bdf4-1e6cb16e0a7e tempest-CinderUnicodeTest-1915563821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ae5b220-68c0-4ac8-9f59-b7c3dce52a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-622f04df-27f9-4cf8-bdf4-1e6cb16e0a7e tempest-CinderUnicodeTest-1915563821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b05c2be-8468-4533-95d1-4820030d12e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-622f04df-27f9-4cf8-bdf4-1e6cb16e0a7e tempest-CinderUnicodeTest-1915563821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b05c2be-8468-4533-95d1-4820030d12e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3da811ee-9f7e-4556-917c-3c6df03507be', 'volume_name': 'volume-3da811ee-9f7e-4556-917c-3c6df03507be', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-622f04df-27f9-4cf8-bdf4-1e6cb16e0a7e tempest-CinderUnicodeTest-1915563821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9f7afe0-7665-4fdf-81d7-4c2bbe09ed72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-622f04df-27f9-4cf8-bdf4-1e6cb16e0a7e tempest-CinderUnicodeTest-1915563821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9f7afe0-7665-4fdf-81d7-4c2bbe09ed72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-622f04df-27f9-4cf8-bdf4-1e6cb16e0a7e tempest-CinderUnicodeTest-1915563821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b83fff5-a43c-4a8d-8161-bc0ca701c221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:08 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-622f04df-27f9-4cf8-bdf4-1e6cb16e0a7e tempest-CinderUnicodeTest-1915563821 None] Volume 3da811ee-9f7e-4556-917c-3c6df03507be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3da811ee-9f7e-4556-917c-3c6df03507be', 'volume_size': 1} Jul 31 10:58:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-622f04df-27f9-4cf8-bdf4-1e6cb16e0a7e tempest-CinderUnicodeTest-1915563821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-622f04df-27f9-4cf8-bdf4-1e6cb16e0a7e tempest-CinderUnicodeTest-1915563821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:08 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-622f04df-27f9-4cf8-bdf4-1e6cb16e0a7e tempest-CinderUnicodeTest-1915563821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3da811ee-9f7e-4556-917c-3c6df03507be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac87ab7e095e4f8781818615eba4b9e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:08Z,use_quota=True,user_id='2e83339ec53e4aa18e4dddfcb5253f59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:58:08 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-622f04df-27f9-4cf8-bdf4-1e6cb16e0a7e tempest-CinderUnicodeTest-1915563821 None] Creating volume 3da811ee-9f7e-4556-917c-3c6df03507be {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:58:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-622f04df-27f9-4cf8-bdf4-1e6cb16e0a7e tempest-CinderUnicodeTest-1915563821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-622f04df-27f9-4cf8-bdf4-1e6cb16e0a7e tempest-CinderUnicodeTest-1915563821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:08 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-622f04df-27f9-4cf8-bdf4-1e6cb16e0a7e tempest-CinderUnicodeTest-1915563821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:58:08 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-622f04df-27f9-4cf8-bdf4-1e6cb16e0a7e tempest-CinderUnicodeTest-1915563821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:58:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-622f04df-27f9-4cf8-bdf4-1e6cb16e0a7e tempest-CinderUnicodeTest-1915563821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:08 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-622f04df-27f9-4cf8-bdf4-1e6cb16e0a7e tempest-CinderUnicodeTest-1915563821 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:58:08 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-622f04df-27f9-4cf8-bdf4-1e6cb16e0a7e tempest-CinderUnicodeTest-1915563821 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:58:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-622f04df-27f9-4cf8-bdf4-1e6cb16e0a7e tempest-CinderUnicodeTest-1915563821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3da811ee-9f7e-4556-917c-3c6df03507be 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:08 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3da811ee-9f7e-4556-917c-3c6df03507be 1073741824 Jul 31 10:58:08 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:08 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-622f04df-27f9-4cf8-bdf4-1e6cb16e0a7e tempest-CinderUnicodeTest-1915563821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3da811ee-9f7e-4556-917c-3c6df03507be 1073741824" returned: 0 in 0.467s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-622f04df-27f9-4cf8-bdf4-1e6cb16e0a7e tempest-CinderUnicodeTest-1915563821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3da811ee-9f7e-4556-917c-3c6df03507be {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:08 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3da811ee-9f7e-4556-917c-3c6df03507be Jul 31 10:58:08 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:09 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-622f04df-27f9-4cf8-bdf4-1e6cb16e0a7e tempest-CinderUnicodeTest-1915563821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3da811ee-9f7e-4556-917c-3c6df03507be" returned: 0 in 0.304s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:09 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-622f04df-27f9-4cf8-bdf4-1e6cb16e0a7e tempest-CinderUnicodeTest-1915563821 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:58:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-622f04df-27f9-4cf8-bdf4-1e6cb16e0a7e tempest-CinderUnicodeTest-1915563821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:09 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-622f04df-27f9-4cf8-bdf4-1e6cb16e0a7e tempest-CinderUnicodeTest-1915563821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b83fff5-a43c-4a8d-8161-bc0ca701c221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3da811ee-9f7e-4556-917c-3c6df03507be', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:09 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-622f04df-27f9-4cf8-bdf4-1e6cb16e0a7e tempest-CinderUnicodeTest-1915563821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ea6ee2-003b-4246-91f4-8bcbf9a1e098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:09 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-622f04df-27f9-4cf8-bdf4-1e6cb16e0a7e tempest-CinderUnicodeTest-1915563821 None] Volume volume-3da811ee-9f7e-4556-917c-3c6df03507be (3da811ee-9f7e-4556-917c-3c6df03507be): created successfully Jul 31 10:58:09 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-622f04df-27f9-4cf8-bdf4-1e6cb16e0a7e tempest-CinderUnicodeTest-1915563821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ea6ee2-003b-4246-91f4-8bcbf9a1e098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:09 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-622f04df-27f9-4cf8-bdf4-1e6cb16e0a7e tempest-CinderUnicodeTest-1915563821 None] Flow 'volume_create_manager' (3a614d46-9c11-45bc-977d-d86405cbfb2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:09 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-622f04df-27f9-4cf8-bdf4-1e6cb16e0a7e tempest-CinderUnicodeTest-1915563821 None] Created volume successfully. Jul 31 10:58:10 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc368ceb-4f8d-48e4-a5d4-c7f88a637231 tempest-CinderUnicodeTest-1915563821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:58:10 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cc368ceb-4f8d-48e4-a5d4-c7f88a637231 tempest-CinderUnicodeTest-1915563821 None] Flow 'volume_create_manager' (f0fbac76-9876-455b-bce2-107becc7ad42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:10 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cc368ceb-4f8d-48e4-a5d4-c7f88a637231 tempest-CinderUnicodeTest-1915563821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a48bb98e-18ef-468d-bd91-8ca139f531c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:10 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cc368ceb-4f8d-48e4-a5d4-c7f88a637231 tempest-CinderUnicodeTest-1915563821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a48bb98e-18ef-468d-bd91-8ca139f531c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-475160973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1245670-d1a3-43f6-b453-c098aed8830d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac87ab7e095e4f8781818615eba4b9e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:11Z,use_quota=True,user_id='2e83339ec53e4aa18e4dddfcb5253f59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:10 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cc368ceb-4f8d-48e4-a5d4-c7f88a637231 tempest-CinderUnicodeTest-1915563821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e880753-6226-48ea-b86e-d06c61c97c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:10 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cc368ceb-4f8d-48e4-a5d4-c7f88a637231 tempest-CinderUnicodeTest-1915563821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e880753-6226-48ea-b86e-d06c61c97c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:10 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cc368ceb-4f8d-48e4-a5d4-c7f88a637231 tempest-CinderUnicodeTest-1915563821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08153eca-ed34-4e15-b875-dc8bda626375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:10 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cc368ceb-4f8d-48e4-a5d4-c7f88a637231 tempest-CinderUnicodeTest-1915563821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08153eca-ed34-4e15-b875-dc8bda626375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1245670-d1a3-43f6-b453-c098aed8830d', 'volume_name': 'volume-d1245670-d1a3-43f6-b453-c098aed8830d', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:10 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cc368ceb-4f8d-48e4-a5d4-c7f88a637231 tempest-CinderUnicodeTest-1915563821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df49b89c-5edc-4985-abe0-aa0e1b13ab06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:10 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cc368ceb-4f8d-48e4-a5d4-c7f88a637231 tempest-CinderUnicodeTest-1915563821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df49b89c-5edc-4985-abe0-aa0e1b13ab06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:10 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cc368ceb-4f8d-48e4-a5d4-c7f88a637231 tempest-CinderUnicodeTest-1915563821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b4a23c9-3076-4613-97e0-d10db5879dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:10 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-cc368ceb-4f8d-48e4-a5d4-c7f88a637231 tempest-CinderUnicodeTest-1915563821 None] Volume d1245670-d1a3-43f6-b453-c098aed8830d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1245670-d1a3-43f6-b453-c098aed8830d', 'volume_size': 1} Jul 31 10:58:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-cc368ceb-4f8d-48e4-a5d4-c7f88a637231 tempest-CinderUnicodeTest-1915563821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-cc368ceb-4f8d-48e4-a5d4-c7f88a637231 tempest-CinderUnicodeTest-1915563821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:10 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-cc368ceb-4f8d-48e4-a5d4-c7f88a637231 tempest-CinderUnicodeTest-1915563821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-475160973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1245670-d1a3-43f6-b453-c098aed8830d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac87ab7e095e4f8781818615eba4b9e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:11Z,use_quota=True,user_id='2e83339ec53e4aa18e4dddfcb5253f59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:58:10 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-cc368ceb-4f8d-48e4-a5d4-c7f88a637231 tempest-CinderUnicodeTest-1915563821 None] Creating volume d1245670-d1a3-43f6-b453-c098aed8830d {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:58:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-cc368ceb-4f8d-48e4-a5d4-c7f88a637231 tempest-CinderUnicodeTest-1915563821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-cc368ceb-4f8d-48e4-a5d4-c7f88a637231 tempest-CinderUnicodeTest-1915563821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:10 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-cc368ceb-4f8d-48e4-a5d4-c7f88a637231 tempest-CinderUnicodeTest-1915563821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:58:10 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-cc368ceb-4f8d-48e4-a5d4-c7f88a637231 tempest-CinderUnicodeTest-1915563821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:58:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-cc368ceb-4f8d-48e4-a5d4-c7f88a637231 tempest-CinderUnicodeTest-1915563821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:10 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-cc368ceb-4f8d-48e4-a5d4-c7f88a637231 tempest-CinderUnicodeTest-1915563821 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:58:10 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-cc368ceb-4f8d-48e4-a5d4-c7f88a637231 tempest-CinderUnicodeTest-1915563821 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:58:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-cc368ceb-4f8d-48e4-a5d4-c7f88a637231 tempest-CinderUnicodeTest-1915563821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:11 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d 1073741824 Jul 31 10:58:11 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:11 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-cc368ceb-4f8d-48e4-a5d4-c7f88a637231 tempest-CinderUnicodeTest-1915563821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d 1073741824" returned: 0 in 0.479s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-cc368ceb-4f8d-48e4-a5d4-c7f88a637231 tempest-CinderUnicodeTest-1915563821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:11 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d Jul 31 10:58:11 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:11 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-cc368ceb-4f8d-48e4-a5d4-c7f88a637231 tempest-CinderUnicodeTest-1915563821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d" returned: 0 in 0.287s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:11 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-cc368ceb-4f8d-48e4-a5d4-c7f88a637231 tempest-CinderUnicodeTest-1915563821 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:58:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-cc368ceb-4f8d-48e4-a5d4-c7f88a637231 tempest-CinderUnicodeTest-1915563821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:11 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cc368ceb-4f8d-48e4-a5d4-c7f88a637231 tempest-CinderUnicodeTest-1915563821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b4a23c9-3076-4613-97e0-d10db5879dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1245670-d1a3-43f6-b453-c098aed8830d', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:11 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cc368ceb-4f8d-48e4-a5d4-c7f88a637231 tempest-CinderUnicodeTest-1915563821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23e9431d-3e54-4c67-b467-7855e92fff14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:11 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-cc368ceb-4f8d-48e4-a5d4-c7f88a637231 tempest-CinderUnicodeTest-1915563821 None] Volume volume-d1245670-d1a3-43f6-b453-c098aed8830d (d1245670-d1a3-43f6-b453-c098aed8830d): created successfully Jul 31 10:58:11 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cc368ceb-4f8d-48e4-a5d4-c7f88a637231 tempest-CinderUnicodeTest-1915563821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23e9431d-3e54-4c67-b467-7855e92fff14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:11 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-cc368ceb-4f8d-48e4-a5d4-c7f88a637231 tempest-CinderUnicodeTest-1915563821 None] Flow 'volume_create_manager' (f0fbac76-9876-455b-bce2-107becc7ad42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:11 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-cc368ceb-4f8d-48e4-a5d4-c7f88a637231 tempest-CinderUnicodeTest-1915563821 None] Created volume successfully. Jul 31 10:58:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-16938d2b-e86a-41e7-b177-cb24419539a1 tempest-CinderUnicodeTest-1915563821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-16938d2b-e86a-41e7-b177-cb24419539a1 tempest-CinderUnicodeTest-1915563821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:13 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-16938d2b-e86a-41e7-b177-cb24419539a1 tempest-CinderUnicodeTest-1915563821 None] Creating offline snapshot 09790099-ae0a-4cae-a0cd-7038753f2654 of volume d1245670-d1a3-43f6-b453-c098aed8830d {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:58:13 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[d420ecfc-b916-47ed-9ae4-cfc6b06c72e4]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-16938d2b-e86a-41e7-b177-cb24419539a1 tempest-CinderUnicodeTest-1915563821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:13 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d Jul 31 10:58:13 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:13 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-16938d2b-e86a-41e7-b177-cb24419539a1 tempest-CinderUnicodeTest-1915563821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d" returned: 0 in 0.364s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-16938d2b-e86a-41e7-b177-cb24419539a1 tempest-CinderUnicodeTest-1915563821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d.09790099-ae0a-4cae-a0cd-7038753f2654 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:13 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d.09790099-ae0a-4cae-a0cd-7038753f2654 1G Jul 31 10:58:13 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:13 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-16938d2b-e86a-41e7-b177-cb24419539a1 tempest-CinderUnicodeTest-1915563821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d.09790099-ae0a-4cae-a0cd-7038753f2654 1G" returned: 0 in 0.389s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-16938d2b-e86a-41e7-b177-cb24419539a1 tempest-CinderUnicodeTest-1915563821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1245670-d1a3-43f6-b453-c098aed8830d -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d.09790099-ae0a-4cae-a0cd-7038753f2654 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:14 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1245670-d1a3-43f6-b453-c098aed8830d -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d.09790099-ae0a-4cae-a0cd-7038753f2654 Jul 31 10:58:14 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:14 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-16938d2b-e86a-41e7-b177-cb24419539a1 tempest-CinderUnicodeTest-1915563821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1245670-d1a3-43f6-b453-c098aed8830d -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d.09790099-ae0a-4cae-a0cd-7038753f2654" returned: 0 in 0.313s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:14 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-16938d2b-e86a-41e7-b177-cb24419539a1 tempest-CinderUnicodeTest-1915563821 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d.09790099-ae0a-4cae-a0cd-7038753f2654 is being set with open permissions: ugo+rw Jul 31 10:58:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-16938d2b-e86a-41e7-b177-cb24419539a1 tempest-CinderUnicodeTest-1915563821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d.09790099-ae0a-4cae-a0cd-7038753f2654 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:14 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d.09790099-ae0a-4cae-a0cd-7038753f2654 Jul 31 10:58:14 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:14 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-16938d2b-e86a-41e7-b177-cb24419539a1 tempest-CinderUnicodeTest-1915563821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d.09790099-ae0a-4cae-a0cd-7038753f2654" returned: 0 in 0.252s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-16938d2b-e86a-41e7-b177-cb24419539a1 tempest-CinderUnicodeTest-1915563821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:14 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d.info Jul 31 10:58:14 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:14 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-16938d2b-e86a-41e7-b177-cb24419539a1 tempest-CinderUnicodeTest-1915563821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d.info" returned: 0 in 0.288s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:14 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-16938d2b-e86a-41e7-b177-cb24419539a1 tempest-CinderUnicodeTest-1915563821 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d.info is being set with open permissions: ugo+rw Jul 31 10:58:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-16938d2b-e86a-41e7-b177-cb24419539a1 tempest-CinderUnicodeTest-1915563821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:14 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d.info Jul 31 10:58:14 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:15 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-16938d2b-e86a-41e7-b177-cb24419539a1 tempest-CinderUnicodeTest-1915563821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d.info" returned: 0 in 0.265s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-16938d2b-e86a-41e7-b177-cb24419539a1 tempest-CinderUnicodeTest-1915563821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.967s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:15 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-16938d2b-e86a-41e7-b177-cb24419539a1 tempest-CinderUnicodeTest-1915563821 None] Create snapshot completed successfully Jul 31 10:58:16 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2fee1c6f-f8f4-44f1-8489-d9c6c69046d6 tempest-CinderUnicodeTest-1915563821 None] Acquiring lock "cinder-09790099-ae0a-4cae-a0cd-7038753f2654-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:16 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2fee1c6f-f8f4-44f1-8489-d9c6c69046d6 tempest-CinderUnicodeTest-1915563821 None] Lock "cinder-09790099-ae0a-4cae-a0cd-7038753f2654-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:16 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2fee1c6f-f8f4-44f1-8489-d9c6c69046d6 tempest-CinderUnicodeTest-1915563821 None] Acquiring lock "cinder-quobyte-d1245670-d1a3-43f6-b453-c098aed8830d" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:16 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2fee1c6f-f8f4-44f1-8489-d9c6c69046d6 tempest-CinderUnicodeTest-1915563821 None] Lock "cinder-quobyte-d1245670-d1a3-43f6-b453-c098aed8830d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:16 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2fee1c6f-f8f4-44f1-8489-d9c6c69046d6 tempest-CinderUnicodeTest-1915563821 None] Acquiring lock "cinder-quobyte-09790099-ae0a-4cae-a0cd-7038753f2654" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:16 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2fee1c6f-f8f4-44f1-8489-d9c6c69046d6 tempest-CinderUnicodeTest-1915563821 None] Lock "cinder-quobyte-09790099-ae0a-4cae-a0cd-7038753f2654" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:16 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-2fee1c6f-f8f4-44f1-8489-d9c6c69046d6 tempest-CinderUnicodeTest-1915563821 None] Deleting offline snapshot 09790099-ae0a-4cae-a0cd-7038753f2654 of volume d1245670-d1a3-43f6-b453-c098aed8830d {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:58:16 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-2fee1c6f-f8f4-44f1-8489-d9c6c69046d6 tempest-CinderUnicodeTest-1915563821 None] snapshot_file for this snap is: volume-d1245670-d1a3-43f6-b453-c098aed8830d.09790099-ae0a-4cae-a0cd-7038753f2654 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:58:16 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f71f552-b6d1-49e6-8ebf-50a93945eacb]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2fee1c6f-f8f4-44f1-8489-d9c6c69046d6 tempest-CinderUnicodeTest-1915563821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d.09790099-ae0a-4cae-a0cd-7038753f2654 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:16 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d.09790099-ae0a-4cae-a0cd-7038753f2654 Jul 31 10:58:16 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:16 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2fee1c6f-f8f4-44f1-8489-d9c6c69046d6 tempest-CinderUnicodeTest-1915563821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d.09790099-ae0a-4cae-a0cd-7038753f2654" returned: 0 in 0.401s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:16 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-2fee1c6f-f8f4-44f1-8489-d9c6c69046d6 tempest-CinderUnicodeTest-1915563821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1245670-d1a3-43f6-b453-c098aed8830d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:58:16 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[9069ce29-da86-4151-9a4e-5d6be9869816]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2fee1c6f-f8f4-44f1-8489-d9c6c69046d6 tempest-CinderUnicodeTest-1915563821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:17 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d Jul 31 10:58:17 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:17 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2fee1c6f-f8f4-44f1-8489-d9c6c69046d6 tempest-CinderUnicodeTest-1915563821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d" returned: 0 in 0.406s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2fee1c6f-f8f4-44f1-8489-d9c6c69046d6 tempest-CinderUnicodeTest-1915563821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d.09790099-ae0a-4cae-a0cd-7038753f2654 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:17 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d.09790099-ae0a-4cae-a0cd-7038753f2654 Jul 31 10:58:17 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:17 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2fee1c6f-f8f4-44f1-8489-d9c6c69046d6 tempest-CinderUnicodeTest-1915563821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d.09790099-ae0a-4cae-a0cd-7038753f2654" returned: 0 in 0.360s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2fee1c6f-f8f4-44f1-8489-d9c6c69046d6 tempest-CinderUnicodeTest-1915563821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d.09790099-ae0a-4cae-a0cd-7038753f2654 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:17 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d.09790099-ae0a-4cae-a0cd-7038753f2654 Jul 31 10:58:17 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:17 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2fee1c6f-f8f4-44f1-8489-d9c6c69046d6 tempest-CinderUnicodeTest-1915563821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d.09790099-ae0a-4cae-a0cd-7038753f2654" returned: 0 in 0.270s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:18 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2fee1c6f-f8f4-44f1-8489-d9c6c69046d6 tempest-CinderUnicodeTest-1915563821 None] Lock "cinder-quobyte-09790099-ae0a-4cae-a0cd-7038753f2654" released by "_delete_snapshot" :: held 1.552s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:18 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2fee1c6f-f8f4-44f1-8489-d9c6c69046d6 tempest-CinderUnicodeTest-1915563821 None] Lock "cinder-quobyte-d1245670-d1a3-43f6-b453-c098aed8830d" released by "delete_snapshot" :: held 1.583s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:18 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-2fee1c6f-f8f4-44f1-8489-d9c6c69046d6 tempest-CinderUnicodeTest-1915563821 None] Created reservations ['ce32d484-cd66-4cb7-ae38-997715af8f6f', '5634480b-ce15-4e04-81e6-55e2600fef98', '82f90776-d43c-4916-bb29-d8d20291a595', 'b153a791-71aa-4cbc-b62e-33fb96cf06f2'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:58:18 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-2fee1c6f-f8f4-44f1-8489-d9c6c69046d6 tempest-CinderUnicodeTest-1915563821 None] Delete snapshot completed successfully. Jul 31 10:58:18 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2fee1c6f-f8f4-44f1-8489-d9c6c69046d6 tempest-CinderUnicodeTest-1915563821 None] Lock "cinder-09790099-ae0a-4cae-a0cd-7038753f2654-delete_snapshot" released by "delete_snapshot" :: held 1.729s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:18 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d77bdda7-60be-4e6e-a2e2-bc61613afdfd tempest-CinderUnicodeTest-1915563821 None] Acquiring lock "cinder-d1245670-d1a3-43f6-b453-c098aed8830d-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:18 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d77bdda7-60be-4e6e-a2e2-bc61613afdfd tempest-CinderUnicodeTest-1915563821 None] Lock "cinder-d1245670-d1a3-43f6-b453-c098aed8830d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:18 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d77bdda7-60be-4e6e-a2e2-bc61613afdfd tempest-CinderUnicodeTest-1915563821 None] Acquiring lock "cinder-quobyte-d1245670-d1a3-43f6-b453-c098aed8830d" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:18 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d77bdda7-60be-4e6e-a2e2-bc61613afdfd tempest-CinderUnicodeTest-1915563821 None] Lock "cinder-quobyte-d1245670-d1a3-43f6-b453-c098aed8830d" acquired by "delete_volume" :: waited 0.019s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:18 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d04bfd7-8ad1-47a4-9bf0-8cbd3d0f6111]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d77bdda7-60be-4e6e-a2e2-bc61613afdfd tempest-CinderUnicodeTest-1915563821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:18 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d Jul 31 10:58:18 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:19 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d77bdda7-60be-4e6e-a2e2-bc61613afdfd tempest-CinderUnicodeTest-1915563821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d" returned: 0 in 0.369s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d77bdda7-60be-4e6e-a2e2-bc61613afdfd tempest-CinderUnicodeTest-1915563821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:19 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d Jul 31 10:58:19 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:19 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d77bdda7-60be-4e6e-a2e2-bc61613afdfd tempest-CinderUnicodeTest-1915563821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d1245670-d1a3-43f6-b453-c098aed8830d" returned: 0 in 0.248s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:19 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d77bdda7-60be-4e6e-a2e2-bc61613afdfd tempest-CinderUnicodeTest-1915563821 None] Lock "cinder-quobyte-d1245670-d1a3-43f6-b453-c098aed8830d" released by "delete_volume" :: held 0.678s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:19 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-d77bdda7-60be-4e6e-a2e2-bc61613afdfd tempest-CinderUnicodeTest-1915563821 None] Created reservations ['ca2ced06-cebc-4bac-aa8b-4f7030c24361', 'd051617e-9d64-4c6d-b164-dd07a7ddfaf8', '341895e1-9463-4d42-84ca-af2965899e3c', '8593d881-9865-406c-a4f9-b54143468964'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:58:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d77bdda7-60be-4e6e-a2e2-bc61613afdfd tempest-CinderUnicodeTest-1915563821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d77bdda7-60be-4e6e-a2e2-bc61613afdfd tempest-CinderUnicodeTest-1915563821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:19 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d77bdda7-60be-4e6e-a2e2-bc61613afdfd tempest-CinderUnicodeTest-1915563821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:58:19 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d77bdda7-60be-4e6e-a2e2-bc61613afdfd tempest-CinderUnicodeTest-1915563821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:58:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d77bdda7-60be-4e6e-a2e2-bc61613afdfd tempest-CinderUnicodeTest-1915563821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d77bdda7-60be-4e6e-a2e2-bc61613afdfd tempest-CinderUnicodeTest-1915563821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:19 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:58:19 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:19 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d77bdda7-60be-4e6e-a2e2-bc61613afdfd tempest-CinderUnicodeTest-1915563821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.268s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:19 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-d77bdda7-60be-4e6e-a2e2-bc61613afdfd tempest-CinderUnicodeTest-1915563821 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:58:19 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-d77bdda7-60be-4e6e-a2e2-bc61613afdfd tempest-CinderUnicodeTest-1915563821 None] Deleted volume successfully. Jul 31 10:58:19 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d77bdda7-60be-4e6e-a2e2-bc61613afdfd tempest-CinderUnicodeTest-1915563821 None] Lock "cinder-d1245670-d1a3-43f6-b453-c098aed8830d-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:19 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-3534953e-b4fc-4c41-95f5-480645c18c6e tempest-CinderUnicodeTest-1915563821 None] Acquiring lock "cinder-3da811ee-9f7e-4556-917c-3c6df03507be-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:19 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-3534953e-b4fc-4c41-95f5-480645c18c6e tempest-CinderUnicodeTest-1915563821 None] Lock "cinder-3da811ee-9f7e-4556-917c-3c6df03507be-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:19 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-3534953e-b4fc-4c41-95f5-480645c18c6e tempest-CinderUnicodeTest-1915563821 None] Acquiring lock "cinder-quobyte-3da811ee-9f7e-4556-917c-3c6df03507be" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:19 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-3534953e-b4fc-4c41-95f5-480645c18c6e tempest-CinderUnicodeTest-1915563821 None] Lock "cinder-quobyte-3da811ee-9f7e-4556-917c-3c6df03507be" acquired by "delete_volume" :: waited 0.018s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:19 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cdca34-f1c7-488c-989a-43fbb3d7470b]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3534953e-b4fc-4c41-95f5-480645c18c6e tempest-CinderUnicodeTest-1915563821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3da811ee-9f7e-4556-917c-3c6df03507be {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:20 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3da811ee-9f7e-4556-917c-3c6df03507be Jul 31 10:58:20 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:20 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3534953e-b4fc-4c41-95f5-480645c18c6e tempest-CinderUnicodeTest-1915563821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3da811ee-9f7e-4556-917c-3c6df03507be" returned: 0 in 0.413s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3534953e-b4fc-4c41-95f5-480645c18c6e tempest-CinderUnicodeTest-1915563821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3da811ee-9f7e-4556-917c-3c6df03507be {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:20 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3da811ee-9f7e-4556-917c-3c6df03507be Jul 31 10:58:20 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:20 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3534953e-b4fc-4c41-95f5-480645c18c6e tempest-CinderUnicodeTest-1915563821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3da811ee-9f7e-4556-917c-3c6df03507be" returned: 0 in 0.280s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:20 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-3534953e-b4fc-4c41-95f5-480645c18c6e tempest-CinderUnicodeTest-1915563821 None] Lock "cinder-quobyte-3da811ee-9f7e-4556-917c-3c6df03507be" released by "delete_volume" :: held 0.730s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:20 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-3534953e-b4fc-4c41-95f5-480645c18c6e tempest-CinderUnicodeTest-1915563821 None] Created reservations ['2956b26a-1849-4fb9-97ba-af38bd7f166b', '5894c714-7143-4ed9-9b82-94074f6f69b2', 'b8acd128-9c22-4605-9244-25b182b60eb4', '8038e657-1c33-4fb2-a631-18e0c84b4378'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:58:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3534953e-b4fc-4c41-95f5-480645c18c6e tempest-CinderUnicodeTest-1915563821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3534953e-b4fc-4c41-95f5-480645c18c6e tempest-CinderUnicodeTest-1915563821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:20 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-3534953e-b4fc-4c41-95f5-480645c18c6e tempest-CinderUnicodeTest-1915563821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:58:20 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-3534953e-b4fc-4c41-95f5-480645c18c6e tempest-CinderUnicodeTest-1915563821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:58:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3534953e-b4fc-4c41-95f5-480645c18c6e tempest-CinderUnicodeTest-1915563821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3534953e-b4fc-4c41-95f5-480645c18c6e tempest-CinderUnicodeTest-1915563821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:20 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:58:20 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:21 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3534953e-b4fc-4c41-95f5-480645c18c6e tempest-CinderUnicodeTest-1915563821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.292s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:21 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-3534953e-b4fc-4c41-95f5-480645c18c6e tempest-CinderUnicodeTest-1915563821 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:58:21 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-3534953e-b4fc-4c41-95f5-480645c18c6e tempest-CinderUnicodeTest-1915563821 None] Deleted volume successfully. Jul 31 10:58:21 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-3534953e-b4fc-4c41-95f5-480645c18c6e tempest-CinderUnicodeTest-1915563821 None] Lock "cinder-3da811ee-9f7e-4556-917c-3c6df03507be-delete_volume" released by "delete_volume" :: held 1.251s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:29 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-d562792e-13f9-4b21-aa87-48357818eab3 tempest-ProjectReaderTests-1773540423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:58:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d562792e-13f9-4b21-aa87-48357818eab3 tempest-ProjectReaderTests-1773540423 None] Flow 'volume_create_manager' (42313459-5910-4247-a6da-3e29a12428b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d562792e-13f9-4b21-aa87-48357818eab3 tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cef4643-ea8d-497a-b2cf-968a643ecda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d562792e-13f9-4b21-aa87-48357818eab3 tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cef4643-ea8d-497a-b2cf-968a643ecda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-688492243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8428c93e-99cc-4687-a172-6ad755904ff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf62cf2d7454688b5cf5bdc21447408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:30Z,use_quota=True,user_id='2e9b5b6f102e42f7b84aa722df428d85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d562792e-13f9-4b21-aa87-48357818eab3 tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d60899a1-4bde-4fd5-a192-b20f4a53d9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d562792e-13f9-4b21-aa87-48357818eab3 tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d60899a1-4bde-4fd5-a192-b20f4a53d9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d562792e-13f9-4b21-aa87-48357818eab3 tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (958a8fe7-51f2-478b-b2b1-f9c0d51d92d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d562792e-13f9-4b21-aa87-48357818eab3 tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (958a8fe7-51f2-478b-b2b1-f9c0d51d92d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8428c93e-99cc-4687-a172-6ad755904ff7', 'volume_name': 'volume-8428c93e-99cc-4687-a172-6ad755904ff7', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d562792e-13f9-4b21-aa87-48357818eab3 tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d49dacbf-e905-4229-88d7-b8e4f94dff95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d562792e-13f9-4b21-aa87-48357818eab3 tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d49dacbf-e905-4229-88d7-b8e4f94dff95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d562792e-13f9-4b21-aa87-48357818eab3 tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07455ee6-8be5-485e-afef-b15de5d40309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:29 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-d562792e-13f9-4b21-aa87-48357818eab3 tempest-ProjectReaderTests-1773540423 None] Volume 8428c93e-99cc-4687-a172-6ad755904ff7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8428c93e-99cc-4687-a172-6ad755904ff7', 'volume_size': 1} Jul 31 10:58:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d562792e-13f9-4b21-aa87-48357818eab3 tempest-ProjectReaderTests-1773540423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d562792e-13f9-4b21-aa87-48357818eab3 tempest-ProjectReaderTests-1773540423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:29 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d562792e-13f9-4b21-aa87-48357818eab3 tempest-ProjectReaderTests-1773540423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-688492243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8428c93e-99cc-4687-a172-6ad755904ff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf62cf2d7454688b5cf5bdc21447408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:30Z,use_quota=True,user_id='2e9b5b6f102e42f7b84aa722df428d85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:58:29 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-d562792e-13f9-4b21-aa87-48357818eab3 tempest-ProjectReaderTests-1773540423 None] Creating volume 8428c93e-99cc-4687-a172-6ad755904ff7 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:58:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d562792e-13f9-4b21-aa87-48357818eab3 tempest-ProjectReaderTests-1773540423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d562792e-13f9-4b21-aa87-48357818eab3 tempest-ProjectReaderTests-1773540423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:29 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d562792e-13f9-4b21-aa87-48357818eab3 tempest-ProjectReaderTests-1773540423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:58:29 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d562792e-13f9-4b21-aa87-48357818eab3 tempest-ProjectReaderTests-1773540423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:58:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d562792e-13f9-4b21-aa87-48357818eab3 tempest-ProjectReaderTests-1773540423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:29 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d562792e-13f9-4b21-aa87-48357818eab3 tempest-ProjectReaderTests-1773540423 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:58:29 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-d562792e-13f9-4b21-aa87-48357818eab3 tempest-ProjectReaderTests-1773540423 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:58:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d562792e-13f9-4b21-aa87-48357818eab3 tempest-ProjectReaderTests-1773540423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8428c93e-99cc-4687-a172-6ad755904ff7 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:30 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8428c93e-99cc-4687-a172-6ad755904ff7 1073741824 Jul 31 10:58:30 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:30 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d562792e-13f9-4b21-aa87-48357818eab3 tempest-ProjectReaderTests-1773540423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8428c93e-99cc-4687-a172-6ad755904ff7 1073741824" returned: 0 in 0.489s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d562792e-13f9-4b21-aa87-48357818eab3 tempest-ProjectReaderTests-1773540423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8428c93e-99cc-4687-a172-6ad755904ff7 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:30 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8428c93e-99cc-4687-a172-6ad755904ff7 Jul 31 10:58:30 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:30 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d562792e-13f9-4b21-aa87-48357818eab3 tempest-ProjectReaderTests-1773540423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8428c93e-99cc-4687-a172-6ad755904ff7" returned: 0 in 0.285s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:30 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d562792e-13f9-4b21-aa87-48357818eab3 tempest-ProjectReaderTests-1773540423 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:58:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d562792e-13f9-4b21-aa87-48357818eab3 tempest-ProjectReaderTests-1773540423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d562792e-13f9-4b21-aa87-48357818eab3 tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07455ee6-8be5-485e-afef-b15de5d40309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8428c93e-99cc-4687-a172-6ad755904ff7', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d562792e-13f9-4b21-aa87-48357818eab3 tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a17f5ad5-6d1f-4231-ba04-47096d8a9c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:30 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-d562792e-13f9-4b21-aa87-48357818eab3 tempest-ProjectReaderTests-1773540423 None] Volume volume-8428c93e-99cc-4687-a172-6ad755904ff7 (8428c93e-99cc-4687-a172-6ad755904ff7): created successfully Jul 31 10:58:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d562792e-13f9-4b21-aa87-48357818eab3 tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a17f5ad5-6d1f-4231-ba04-47096d8a9c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d562792e-13f9-4b21-aa87-48357818eab3 tempest-ProjectReaderTests-1773540423 None] Flow 'volume_create_manager' (42313459-5910-4247-a6da-3e29a12428b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:30 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-d562792e-13f9-4b21-aa87-48357818eab3 tempest-ProjectReaderTests-1773540423 None] Created volume successfully. Jul 31 10:58:32 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-75c17987-31bb-4c10-86e1-c755437424f2 tempest-ProjectReaderTests-1773540423 None] Acquiring lock "cinder-8428c93e-99cc-4687-a172-6ad755904ff7-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:32 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-75c17987-31bb-4c10-86e1-c755437424f2 tempest-ProjectReaderTests-1773540423 None] Lock "cinder-8428c93e-99cc-4687-a172-6ad755904ff7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:32 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-75c17987-31bb-4c10-86e1-c755437424f2 tempest-ProjectReaderTests-1773540423 None] Acquiring lock "cinder-quobyte-8428c93e-99cc-4687-a172-6ad755904ff7" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:32 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-75c17987-31bb-4c10-86e1-c755437424f2 tempest-ProjectReaderTests-1773540423 None] Lock "cinder-quobyte-8428c93e-99cc-4687-a172-6ad755904ff7" acquired by "delete_volume" :: waited 0.017s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:32 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f079b4-2bdd-4fff-bf9c-ea55511ea44c]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-75c17987-31bb-4c10-86e1-c755437424f2 tempest-ProjectReaderTests-1773540423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8428c93e-99cc-4687-a172-6ad755904ff7 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:32 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8428c93e-99cc-4687-a172-6ad755904ff7 Jul 31 10:58:32 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:32 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-75c17987-31bb-4c10-86e1-c755437424f2 tempest-ProjectReaderTests-1773540423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8428c93e-99cc-4687-a172-6ad755904ff7" returned: 0 in 0.407s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-75c17987-31bb-4c10-86e1-c755437424f2 tempest-ProjectReaderTests-1773540423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8428c93e-99cc-4687-a172-6ad755904ff7 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:32 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8428c93e-99cc-4687-a172-6ad755904ff7 Jul 31 10:58:32 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:32 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-75c17987-31bb-4c10-86e1-c755437424f2 tempest-ProjectReaderTests-1773540423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8428c93e-99cc-4687-a172-6ad755904ff7" returned: 0 in 0.294s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:33 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-75c17987-31bb-4c10-86e1-c755437424f2 tempest-ProjectReaderTests-1773540423 None] Lock "cinder-quobyte-8428c93e-99cc-4687-a172-6ad755904ff7" released by "delete_volume" :: held 0.748s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:33 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=69,cinder:UPDATE=73,cinder:INSERT=19,cinder:DELETE=6 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:58:33 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=61,cinder:INSERT=27,cinder:UPDATE=76,cinder:DELETE=7 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:58:33 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-75c17987-31bb-4c10-86e1-c755437424f2 tempest-ProjectReaderTests-1773540423 None] Created reservations ['c8d8b27a-d7f0-47b3-b5c7-024fd4516ae1', 'fe03623b-30c7-4bca-866d-7cf4e7af0077', 'c0641566-94d3-4548-98f8-6e728e22f331', '5651b293-ad39-4692-ab8d-fafbe1935003'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:58:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-75c17987-31bb-4c10-86e1-c755437424f2 tempest-ProjectReaderTests-1773540423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-75c17987-31bb-4c10-86e1-c755437424f2 tempest-ProjectReaderTests-1773540423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:33 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-75c17987-31bb-4c10-86e1-c755437424f2 tempest-ProjectReaderTests-1773540423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:58:33 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-75c17987-31bb-4c10-86e1-c755437424f2 tempest-ProjectReaderTests-1773540423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:58:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-75c17987-31bb-4c10-86e1-c755437424f2 tempest-ProjectReaderTests-1773540423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-75c17987-31bb-4c10-86e1-c755437424f2 tempest-ProjectReaderTests-1773540423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:33 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:58:33 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:33 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-75c17987-31bb-4c10-86e1-c755437424f2 tempest-ProjectReaderTests-1773540423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.279s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:33 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-75c17987-31bb-4c10-86e1-c755437424f2 tempest-ProjectReaderTests-1773540423 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:58:33 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-75c17987-31bb-4c10-86e1-c755437424f2 tempest-ProjectReaderTests-1773540423 None] Deleted volume successfully. Jul 31 10:58:33 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-75c17987-31bb-4c10-86e1-c755437424f2 tempest-ProjectReaderTests-1773540423 None] Lock "cinder-8428c93e-99cc-4687-a172-6ad755904ff7-delete_volume" released by "delete_volume" :: held 1.265s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:33 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ae7072a-4ec9-49e4-9770-d68ecdb0887d tempest-ProjectReaderTests-1773540423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:58:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-1ae7072a-4ec9-49e4-9770-d68ecdb0887d tempest-ProjectReaderTests-1773540423 None] Flow 'volume_create_manager' (7c2ff0e8-33bc-498b-b9da-329a97cf4119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-1ae7072a-4ec9-49e4-9770-d68ecdb0887d tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33d624ed-ded3-418a-bc2d-9db9807610cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-1ae7072a-4ec9-49e4-9770-d68ecdb0887d tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33d624ed-ded3-418a-bc2d-9db9807610cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1187241316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc2478a5-b0aa-4c93-8382-84272c0967dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf62cf2d7454688b5cf5bdc21447408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:34Z,use_quota=True,user_id='2e9b5b6f102e42f7b84aa722df428d85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-1ae7072a-4ec9-49e4-9770-d68ecdb0887d tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a08b4a6-a8a3-4efe-98b5-c257de4a0af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-1ae7072a-4ec9-49e4-9770-d68ecdb0887d tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a08b4a6-a8a3-4efe-98b5-c257de4a0af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-1ae7072a-4ec9-49e4-9770-d68ecdb0887d tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8dd584a-9921-4b5e-b873-aa76fc1a6f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-1ae7072a-4ec9-49e4-9770-d68ecdb0887d tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8dd584a-9921-4b5e-b873-aa76fc1a6f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc2478a5-b0aa-4c93-8382-84272c0967dc', 'volume_name': 'volume-fc2478a5-b0aa-4c93-8382-84272c0967dc', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-1ae7072a-4ec9-49e4-9770-d68ecdb0887d tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd17e74f-9e04-43e1-b8d2-dee4999f0366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-1ae7072a-4ec9-49e4-9770-d68ecdb0887d tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd17e74f-9e04-43e1-b8d2-dee4999f0366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:33 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-1ae7072a-4ec9-49e4-9770-d68ecdb0887d tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10dddd48-0dfa-4a99-9865-3950b65daba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:33 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-1ae7072a-4ec9-49e4-9770-d68ecdb0887d tempest-ProjectReaderTests-1773540423 None] Volume fc2478a5-b0aa-4c93-8382-84272c0967dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc2478a5-b0aa-4c93-8382-84272c0967dc', 'volume_size': 1} Jul 31 10:58:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-1ae7072a-4ec9-49e4-9770-d68ecdb0887d tempest-ProjectReaderTests-1773540423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-1ae7072a-4ec9-49e4-9770-d68ecdb0887d tempest-ProjectReaderTests-1773540423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:33 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-1ae7072a-4ec9-49e4-9770-d68ecdb0887d tempest-ProjectReaderTests-1773540423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1187241316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc2478a5-b0aa-4c93-8382-84272c0967dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf62cf2d7454688b5cf5bdc21447408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:34Z,use_quota=True,user_id='2e9b5b6f102e42f7b84aa722df428d85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:58:33 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-1ae7072a-4ec9-49e4-9770-d68ecdb0887d tempest-ProjectReaderTests-1773540423 None] Creating volume fc2478a5-b0aa-4c93-8382-84272c0967dc {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:58:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-1ae7072a-4ec9-49e4-9770-d68ecdb0887d tempest-ProjectReaderTests-1773540423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-1ae7072a-4ec9-49e4-9770-d68ecdb0887d tempest-ProjectReaderTests-1773540423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:33 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-1ae7072a-4ec9-49e4-9770-d68ecdb0887d tempest-ProjectReaderTests-1773540423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:58:33 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-1ae7072a-4ec9-49e4-9770-d68ecdb0887d tempest-ProjectReaderTests-1773540423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:58:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-1ae7072a-4ec9-49e4-9770-d68ecdb0887d tempest-ProjectReaderTests-1773540423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:33 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-1ae7072a-4ec9-49e4-9770-d68ecdb0887d tempest-ProjectReaderTests-1773540423 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:58:33 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-1ae7072a-4ec9-49e4-9770-d68ecdb0887d tempest-ProjectReaderTests-1773540423 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:58:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1ae7072a-4ec9-49e4-9770-d68ecdb0887d tempest-ProjectReaderTests-1773540423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fc2478a5-b0aa-4c93-8382-84272c0967dc 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:33 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fc2478a5-b0aa-4c93-8382-84272c0967dc 1073741824 Jul 31 10:58:33 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:34 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1ae7072a-4ec9-49e4-9770-d68ecdb0887d tempest-ProjectReaderTests-1773540423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fc2478a5-b0aa-4c93-8382-84272c0967dc 1073741824" returned: 0 in 0.489s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1ae7072a-4ec9-49e4-9770-d68ecdb0887d tempest-ProjectReaderTests-1773540423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fc2478a5-b0aa-4c93-8382-84272c0967dc {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:34 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fc2478a5-b0aa-4c93-8382-84272c0967dc Jul 31 10:58:34 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:34 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1ae7072a-4ec9-49e4-9770-d68ecdb0887d tempest-ProjectReaderTests-1773540423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fc2478a5-b0aa-4c93-8382-84272c0967dc" returned: 0 in 0.254s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:34 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-1ae7072a-4ec9-49e4-9770-d68ecdb0887d tempest-ProjectReaderTests-1773540423 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:58:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-1ae7072a-4ec9-49e4-9770-d68ecdb0887d tempest-ProjectReaderTests-1773540423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-1ae7072a-4ec9-49e4-9770-d68ecdb0887d tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10dddd48-0dfa-4a99-9865-3950b65daba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc2478a5-b0aa-4c93-8382-84272c0967dc', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-1ae7072a-4ec9-49e4-9770-d68ecdb0887d tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afaa0a5d-dd05-498b-8763-615bd25fb199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:34 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-1ae7072a-4ec9-49e4-9770-d68ecdb0887d tempest-ProjectReaderTests-1773540423 None] Volume volume-fc2478a5-b0aa-4c93-8382-84272c0967dc (fc2478a5-b0aa-4c93-8382-84272c0967dc): created successfully Jul 31 10:58:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-1ae7072a-4ec9-49e4-9770-d68ecdb0887d tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afaa0a5d-dd05-498b-8763-615bd25fb199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-1ae7072a-4ec9-49e4-9770-d68ecdb0887d tempest-ProjectReaderTests-1773540423 None] Flow 'volume_create_manager' (7c2ff0e8-33bc-498b-b9da-329a97cf4119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:34 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-1ae7072a-4ec9-49e4-9770-d68ecdb0887d tempest-ProjectReaderTests-1773540423 None] Created volume successfully. Jul 31 10:58:36 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1887349c-346e-49ad-8885-cb182cba8269 tempest-ProjectReaderTests-1773540423 None] Acquiring lock "cinder-fc2478a5-b0aa-4c93-8382-84272c0967dc-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:36 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1887349c-346e-49ad-8885-cb182cba8269 tempest-ProjectReaderTests-1773540423 None] Lock "cinder-fc2478a5-b0aa-4c93-8382-84272c0967dc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:36 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1887349c-346e-49ad-8885-cb182cba8269 tempest-ProjectReaderTests-1773540423 None] Acquiring lock "cinder-quobyte-fc2478a5-b0aa-4c93-8382-84272c0967dc" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:36 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1887349c-346e-49ad-8885-cb182cba8269 tempest-ProjectReaderTests-1773540423 None] Lock "cinder-quobyte-fc2478a5-b0aa-4c93-8382-84272c0967dc" acquired by "delete_volume" :: waited 0.019s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:36 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[b827f961-4b17-4f54-b04c-912a10a0fd65]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1887349c-346e-49ad-8885-cb182cba8269 tempest-ProjectReaderTests-1773540423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fc2478a5-b0aa-4c93-8382-84272c0967dc {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:36 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fc2478a5-b0aa-4c93-8382-84272c0967dc Jul 31 10:58:36 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:36 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1887349c-346e-49ad-8885-cb182cba8269 tempest-ProjectReaderTests-1773540423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fc2478a5-b0aa-4c93-8382-84272c0967dc" returned: 0 in 0.380s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1887349c-346e-49ad-8885-cb182cba8269 tempest-ProjectReaderTests-1773540423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fc2478a5-b0aa-4c93-8382-84272c0967dc {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:36 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fc2478a5-b0aa-4c93-8382-84272c0967dc Jul 31 10:58:36 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:36 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1887349c-346e-49ad-8885-cb182cba8269 tempest-ProjectReaderTests-1773540423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fc2478a5-b0aa-4c93-8382-84272c0967dc" returned: 0 in 0.250s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:36 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1887349c-346e-49ad-8885-cb182cba8269 tempest-ProjectReaderTests-1773540423 None] Lock "cinder-quobyte-fc2478a5-b0aa-4c93-8382-84272c0967dc" released by "delete_volume" :: held 0.676s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:36 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-1887349c-346e-49ad-8885-cb182cba8269 tempest-ProjectReaderTests-1773540423 None] Created reservations ['accfc002-b998-4fbc-a1cd-f9533b20c6fd', 'b20d46b6-8ab0-4b7e-83ec-dd5ecd53f624', 'c3c0cc08-4b19-4f22-b4e4-978e919102d3', '40850e9e-7045-43a2-878b-2ada076a84ef'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:58:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-1887349c-346e-49ad-8885-cb182cba8269 tempest-ProjectReaderTests-1773540423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-1887349c-346e-49ad-8885-cb182cba8269 tempest-ProjectReaderTests-1773540423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:36 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-1887349c-346e-49ad-8885-cb182cba8269 tempest-ProjectReaderTests-1773540423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:58:36 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-1887349c-346e-49ad-8885-cb182cba8269 tempest-ProjectReaderTests-1773540423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:58:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-1887349c-346e-49ad-8885-cb182cba8269 tempest-ProjectReaderTests-1773540423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1887349c-346e-49ad-8885-cb182cba8269 tempest-ProjectReaderTests-1773540423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:36 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:58:36 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:37 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1887349c-346e-49ad-8885-cb182cba8269 tempest-ProjectReaderTests-1773540423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.272s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:37 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-1887349c-346e-49ad-8885-cb182cba8269 tempest-ProjectReaderTests-1773540423 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:58:37 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-1887349c-346e-49ad-8885-cb182cba8269 tempest-ProjectReaderTests-1773540423 None] Deleted volume successfully. Jul 31 10:58:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1887349c-346e-49ad-8885-cb182cba8269 tempest-ProjectReaderTests-1773540423 None] Lock "cinder-fc2478a5-b0aa-4c93-8382-84272c0967dc-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:37 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-047cb1af-5954-41c6-9c51-d7021cbfc02a tempest-ProjectReaderTests-1773540423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:58:37 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-047cb1af-5954-41c6-9c51-d7021cbfc02a tempest-ProjectReaderTests-1773540423 None] Flow 'volume_create_manager' (3e53c055-29cd-4a06-916e-7c8f5b1893d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:37 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-047cb1af-5954-41c6-9c51-d7021cbfc02a tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18eb5536-40de-49a6-b0e5-f05ad9c5b9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:37 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-047cb1af-5954-41c6-9c51-d7021cbfc02a tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18eb5536-40de-49a6-b0e5-f05ad9c5b9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-404919410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3470a32-1f2a-47cb-ad61-6ed61a878239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf62cf2d7454688b5cf5bdc21447408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:38Z,use_quota=True,user_id='2e9b5b6f102e42f7b84aa722df428d85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:37 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-047cb1af-5954-41c6-9c51-d7021cbfc02a tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5f844a1-95e8-471c-aee5-8489d56e1552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:37 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-047cb1af-5954-41c6-9c51-d7021cbfc02a tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5f844a1-95e8-471c-aee5-8489d56e1552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:37 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-047cb1af-5954-41c6-9c51-d7021cbfc02a tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9653f49-e877-4450-895e-bcdf7042d48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:37 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-047cb1af-5954-41c6-9c51-d7021cbfc02a tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9653f49-e877-4450-895e-bcdf7042d48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3470a32-1f2a-47cb-ad61-6ed61a878239', 'volume_name': 'volume-a3470a32-1f2a-47cb-ad61-6ed61a878239', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:37 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-047cb1af-5954-41c6-9c51-d7021cbfc02a tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d75f90ea-e5ae-4221-9239-9f8820306bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:37 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-047cb1af-5954-41c6-9c51-d7021cbfc02a tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d75f90ea-e5ae-4221-9239-9f8820306bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:37 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-047cb1af-5954-41c6-9c51-d7021cbfc02a tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39bdc369-1fee-497c-9105-f41a89481468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:37 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-047cb1af-5954-41c6-9c51-d7021cbfc02a tempest-ProjectReaderTests-1773540423 None] Volume a3470a32-1f2a-47cb-ad61-6ed61a878239: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3470a32-1f2a-47cb-ad61-6ed61a878239', 'volume_size': 1} Jul 31 10:58:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-047cb1af-5954-41c6-9c51-d7021cbfc02a tempest-ProjectReaderTests-1773540423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-047cb1af-5954-41c6-9c51-d7021cbfc02a tempest-ProjectReaderTests-1773540423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:37 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-047cb1af-5954-41c6-9c51-d7021cbfc02a tempest-ProjectReaderTests-1773540423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-404919410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3470a32-1f2a-47cb-ad61-6ed61a878239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf62cf2d7454688b5cf5bdc21447408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:38Z,use_quota=True,user_id='2e9b5b6f102e42f7b84aa722df428d85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:58:37 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-047cb1af-5954-41c6-9c51-d7021cbfc02a tempest-ProjectReaderTests-1773540423 None] Creating volume a3470a32-1f2a-47cb-ad61-6ed61a878239 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:58:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-047cb1af-5954-41c6-9c51-d7021cbfc02a tempest-ProjectReaderTests-1773540423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-047cb1af-5954-41c6-9c51-d7021cbfc02a tempest-ProjectReaderTests-1773540423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:37 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-047cb1af-5954-41c6-9c51-d7021cbfc02a tempest-ProjectReaderTests-1773540423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:58:37 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-047cb1af-5954-41c6-9c51-d7021cbfc02a tempest-ProjectReaderTests-1773540423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:58:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-047cb1af-5954-41c6-9c51-d7021cbfc02a tempest-ProjectReaderTests-1773540423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:37 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-047cb1af-5954-41c6-9c51-d7021cbfc02a tempest-ProjectReaderTests-1773540423 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:58:37 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-047cb1af-5954-41c6-9c51-d7021cbfc02a tempest-ProjectReaderTests-1773540423 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:58:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-047cb1af-5954-41c6-9c51-d7021cbfc02a tempest-ProjectReaderTests-1773540423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a3470a32-1f2a-47cb-ad61-6ed61a878239 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:37 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a3470a32-1f2a-47cb-ad61-6ed61a878239 1073741824 Jul 31 10:58:37 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:38 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-047cb1af-5954-41c6-9c51-d7021cbfc02a tempest-ProjectReaderTests-1773540423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a3470a32-1f2a-47cb-ad61-6ed61a878239 1073741824" returned: 0 in 0.480s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-047cb1af-5954-41c6-9c51-d7021cbfc02a tempest-ProjectReaderTests-1773540423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a3470a32-1f2a-47cb-ad61-6ed61a878239 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:38 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a3470a32-1f2a-47cb-ad61-6ed61a878239 Jul 31 10:58:38 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:38 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-047cb1af-5954-41c6-9c51-d7021cbfc02a tempest-ProjectReaderTests-1773540423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a3470a32-1f2a-47cb-ad61-6ed61a878239" returned: 0 in 0.248s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:38 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-047cb1af-5954-41c6-9c51-d7021cbfc02a tempest-ProjectReaderTests-1773540423 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:58:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-047cb1af-5954-41c6-9c51-d7021cbfc02a tempest-ProjectReaderTests-1773540423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:38 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-047cb1af-5954-41c6-9c51-d7021cbfc02a tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39bdc369-1fee-497c-9105-f41a89481468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3470a32-1f2a-47cb-ad61-6ed61a878239', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:38 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-047cb1af-5954-41c6-9c51-d7021cbfc02a tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a51cad25-7b82-4653-8e09-456c52f3779f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:38 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-047cb1af-5954-41c6-9c51-d7021cbfc02a tempest-ProjectReaderTests-1773540423 None] Volume volume-a3470a32-1f2a-47cb-ad61-6ed61a878239 (a3470a32-1f2a-47cb-ad61-6ed61a878239): created successfully Jul 31 10:58:38 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-047cb1af-5954-41c6-9c51-d7021cbfc02a tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a51cad25-7b82-4653-8e09-456c52f3779f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:38 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-047cb1af-5954-41c6-9c51-d7021cbfc02a tempest-ProjectReaderTests-1773540423 None] Flow 'volume_create_manager' (3e53c055-29cd-4a06-916e-7c8f5b1893d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:38 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-047cb1af-5954-41c6-9c51-d7021cbfc02a tempest-ProjectReaderTests-1773540423 None] Created volume successfully. Jul 31 10:58:39 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-bae640f4-a03e-4ef0-b13d-1bb338f9c326 tempest-ProjectReaderTests-1773540423 None] Acquiring lock "cinder-a3470a32-1f2a-47cb-ad61-6ed61a878239-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:39 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-bae640f4-a03e-4ef0-b13d-1bb338f9c326 tempest-ProjectReaderTests-1773540423 None] Lock "cinder-a3470a32-1f2a-47cb-ad61-6ed61a878239-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:39 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-bae640f4-a03e-4ef0-b13d-1bb338f9c326 tempest-ProjectReaderTests-1773540423 None] Acquiring lock "cinder-quobyte-a3470a32-1f2a-47cb-ad61-6ed61a878239" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:39 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-bae640f4-a03e-4ef0-b13d-1bb338f9c326 tempest-ProjectReaderTests-1773540423 None] Lock "cinder-quobyte-a3470a32-1f2a-47cb-ad61-6ed61a878239" acquired by "delete_volume" :: waited 0.020s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:39 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b19c99-96cd-4bb0-ac2c-bca6cf6e0b6e]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bae640f4-a03e-4ef0-b13d-1bb338f9c326 tempest-ProjectReaderTests-1773540423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a3470a32-1f2a-47cb-ad61-6ed61a878239 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:40 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a3470a32-1f2a-47cb-ad61-6ed61a878239 Jul 31 10:58:40 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:40 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bae640f4-a03e-4ef0-b13d-1bb338f9c326 tempest-ProjectReaderTests-1773540423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a3470a32-1f2a-47cb-ad61-6ed61a878239" returned: 0 in 0.381s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bae640f4-a03e-4ef0-b13d-1bb338f9c326 tempest-ProjectReaderTests-1773540423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a3470a32-1f2a-47cb-ad61-6ed61a878239 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:40 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a3470a32-1f2a-47cb-ad61-6ed61a878239 Jul 31 10:58:40 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:40 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bae640f4-a03e-4ef0-b13d-1bb338f9c326 tempest-ProjectReaderTests-1773540423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a3470a32-1f2a-47cb-ad61-6ed61a878239" returned: 0 in 0.296s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:40 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-bae640f4-a03e-4ef0-b13d-1bb338f9c326 tempest-ProjectReaderTests-1773540423 None] Lock "cinder-quobyte-a3470a32-1f2a-47cb-ad61-6ed61a878239" released by "delete_volume" :: held 0.721s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:40 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-bae640f4-a03e-4ef0-b13d-1bb338f9c326 tempest-ProjectReaderTests-1773540423 None] Created reservations ['3e4303cd-4c9b-4f71-ab94-8ef36232a662', '29f63e04-06c5-43bc-9a9d-b54b849de1e1', '8f8b9121-e2ee-463a-a574-34ffc8c1c51f', '0f732ea0-f67e-44a0-bcab-a9d22ca59095'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:58:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-bae640f4-a03e-4ef0-b13d-1bb338f9c326 tempest-ProjectReaderTests-1773540423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-bae640f4-a03e-4ef0-b13d-1bb338f9c326 tempest-ProjectReaderTests-1773540423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:40 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-bae640f4-a03e-4ef0-b13d-1bb338f9c326 tempest-ProjectReaderTests-1773540423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:58:40 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-bae640f4-a03e-4ef0-b13d-1bb338f9c326 tempest-ProjectReaderTests-1773540423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:58:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-bae640f4-a03e-4ef0-b13d-1bb338f9c326 tempest-ProjectReaderTests-1773540423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bae640f4-a03e-4ef0-b13d-1bb338f9c326 tempest-ProjectReaderTests-1773540423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:40 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:58:40 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:41 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bae640f4-a03e-4ef0-b13d-1bb338f9c326 tempest-ProjectReaderTests-1773540423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.273s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:41 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-bae640f4-a03e-4ef0-b13d-1bb338f9c326 tempest-ProjectReaderTests-1773540423 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:58:41 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-bae640f4-a03e-4ef0-b13d-1bb338f9c326 tempest-ProjectReaderTests-1773540423 None] Deleted volume successfully. Jul 31 10:58:41 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-bae640f4-a03e-4ef0-b13d-1bb338f9c326 tempest-ProjectReaderTests-1773540423 None] Lock "cinder-a3470a32-1f2a-47cb-ad61-6ed61a878239-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:41 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-78860c30-09bb-44f2-8eab-d932508fff21 tempest-ProjectReaderTests-1773540423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:58:41 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-78860c30-09bb-44f2-8eab-d932508fff21 tempest-ProjectReaderTests-1773540423 None] Flow 'volume_create_manager' (83fbdc1b-8f5f-4aec-b0fb-657b4069378e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:41 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-78860c30-09bb-44f2-8eab-d932508fff21 tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07b5a56c-b92e-4161-a29c-3babd194fae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:41 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-78860c30-09bb-44f2-8eab-d932508fff21 tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07b5a56c-b92e-4161-a29c-3babd194fae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-655335610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a6b69e-ca6f-483a-b277-508cc2c59e77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf62cf2d7454688b5cf5bdc21447408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:41Z,use_quota=True,user_id='2e9b5b6f102e42f7b84aa722df428d85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:41 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-78860c30-09bb-44f2-8eab-d932508fff21 tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1597a0a6-824a-4acc-b049-ddd72fc6a468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:41 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-78860c30-09bb-44f2-8eab-d932508fff21 tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1597a0a6-824a-4acc-b049-ddd72fc6a468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:41 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-78860c30-09bb-44f2-8eab-d932508fff21 tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d02fd2ad-b5b7-4dbe-b0e3-4001aa906e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:41 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-78860c30-09bb-44f2-8eab-d932508fff21 tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d02fd2ad-b5b7-4dbe-b0e3-4001aa906e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84a6b69e-ca6f-483a-b277-508cc2c59e77', 'volume_name': 'volume-84a6b69e-ca6f-483a-b277-508cc2c59e77', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:41 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-78860c30-09bb-44f2-8eab-d932508fff21 tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14cc467-df3a-4554-95c3-9cb6d5ec52f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:41 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-78860c30-09bb-44f2-8eab-d932508fff21 tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14cc467-df3a-4554-95c3-9cb6d5ec52f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:41 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-78860c30-09bb-44f2-8eab-d932508fff21 tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2558262-21ad-40d4-b2c4-82fd96798c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:41 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-78860c30-09bb-44f2-8eab-d932508fff21 tempest-ProjectReaderTests-1773540423 None] Volume 84a6b69e-ca6f-483a-b277-508cc2c59e77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84a6b69e-ca6f-483a-b277-508cc2c59e77', 'volume_size': 1} Jul 31 10:58:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-78860c30-09bb-44f2-8eab-d932508fff21 tempest-ProjectReaderTests-1773540423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-78860c30-09bb-44f2-8eab-d932508fff21 tempest-ProjectReaderTests-1773540423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:41 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-78860c30-09bb-44f2-8eab-d932508fff21 tempest-ProjectReaderTests-1773540423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-655335610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a6b69e-ca6f-483a-b277-508cc2c59e77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf62cf2d7454688b5cf5bdc21447408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:41Z,use_quota=True,user_id='2e9b5b6f102e42f7b84aa722df428d85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:58:41 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-78860c30-09bb-44f2-8eab-d932508fff21 tempest-ProjectReaderTests-1773540423 None] Creating volume 84a6b69e-ca6f-483a-b277-508cc2c59e77 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:58:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-78860c30-09bb-44f2-8eab-d932508fff21 tempest-ProjectReaderTests-1773540423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-78860c30-09bb-44f2-8eab-d932508fff21 tempest-ProjectReaderTests-1773540423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:41 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-78860c30-09bb-44f2-8eab-d932508fff21 tempest-ProjectReaderTests-1773540423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:58:41 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-78860c30-09bb-44f2-8eab-d932508fff21 tempest-ProjectReaderTests-1773540423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:58:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-78860c30-09bb-44f2-8eab-d932508fff21 tempest-ProjectReaderTests-1773540423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:41 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-78860c30-09bb-44f2-8eab-d932508fff21 tempest-ProjectReaderTests-1773540423 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:58:41 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-78860c30-09bb-44f2-8eab-d932508fff21 tempest-ProjectReaderTests-1773540423 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:58:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-78860c30-09bb-44f2-8eab-d932508fff21 tempest-ProjectReaderTests-1773540423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-84a6b69e-ca6f-483a-b277-508cc2c59e77 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:41 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-84a6b69e-ca6f-483a-b277-508cc2c59e77 1073741824 Jul 31 10:58:41 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:42 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-78860c30-09bb-44f2-8eab-d932508fff21 tempest-ProjectReaderTests-1773540423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-84a6b69e-ca6f-483a-b277-508cc2c59e77 1073741824" returned: 0 in 0.492s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-78860c30-09bb-44f2-8eab-d932508fff21 tempest-ProjectReaderTests-1773540423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-84a6b69e-ca6f-483a-b277-508cc2c59e77 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:42 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-84a6b69e-ca6f-483a-b277-508cc2c59e77 Jul 31 10:58:42 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:42 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-78860c30-09bb-44f2-8eab-d932508fff21 tempest-ProjectReaderTests-1773540423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-84a6b69e-ca6f-483a-b277-508cc2c59e77" returned: 0 in 0.311s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:42 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-78860c30-09bb-44f2-8eab-d932508fff21 tempest-ProjectReaderTests-1773540423 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:58:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-78860c30-09bb-44f2-8eab-d932508fff21 tempest-ProjectReaderTests-1773540423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:42 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-78860c30-09bb-44f2-8eab-d932508fff21 tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2558262-21ad-40d4-b2c4-82fd96798c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84a6b69e-ca6f-483a-b277-508cc2c59e77', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:42 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-78860c30-09bb-44f2-8eab-d932508fff21 tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b809281-f319-4be2-bb0c-bff107c58e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:42 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-78860c30-09bb-44f2-8eab-d932508fff21 tempest-ProjectReaderTests-1773540423 None] Volume volume-84a6b69e-ca6f-483a-b277-508cc2c59e77 (84a6b69e-ca6f-483a-b277-508cc2c59e77): created successfully Jul 31 10:58:42 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-78860c30-09bb-44f2-8eab-d932508fff21 tempest-ProjectReaderTests-1773540423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b809281-f319-4be2-bb0c-bff107c58e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:42 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-78860c30-09bb-44f2-8eab-d932508fff21 tempest-ProjectReaderTests-1773540423 None] Flow 'volume_create_manager' (83fbdc1b-8f5f-4aec-b0fb-657b4069378e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:42 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-78860c30-09bb-44f2-8eab-d932508fff21 tempest-ProjectReaderTests-1773540423 None] Created volume successfully. Jul 31 10:58:43 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-fe0e50b6-8f28-499a-88ad-c6ecabe51635 tempest-ProjectReaderTests-1773540423 None] Acquiring lock "cinder-84a6b69e-ca6f-483a-b277-508cc2c59e77-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:43 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-fe0e50b6-8f28-499a-88ad-c6ecabe51635 tempest-ProjectReaderTests-1773540423 None] Lock "cinder-84a6b69e-ca6f-483a-b277-508cc2c59e77-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:43 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-fe0e50b6-8f28-499a-88ad-c6ecabe51635 tempest-ProjectReaderTests-1773540423 None] Acquiring lock "cinder-quobyte-84a6b69e-ca6f-483a-b277-508cc2c59e77" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:43 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-fe0e50b6-8f28-499a-88ad-c6ecabe51635 tempest-ProjectReaderTests-1773540423 None] Lock "cinder-quobyte-84a6b69e-ca6f-483a-b277-508cc2c59e77" acquired by "delete_volume" :: waited 0.016s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:43 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e5b175-0539-4bd0-a925-129ff538a4bc]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fe0e50b6-8f28-499a-88ad-c6ecabe51635 tempest-ProjectReaderTests-1773540423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-84a6b69e-ca6f-483a-b277-508cc2c59e77 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:43 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-84a6b69e-ca6f-483a-b277-508cc2c59e77 Jul 31 10:58:43 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:44 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fe0e50b6-8f28-499a-88ad-c6ecabe51635 tempest-ProjectReaderTests-1773540423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-84a6b69e-ca6f-483a-b277-508cc2c59e77" returned: 0 in 0.390s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fe0e50b6-8f28-499a-88ad-c6ecabe51635 tempest-ProjectReaderTests-1773540423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-84a6b69e-ca6f-483a-b277-508cc2c59e77 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:44 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-84a6b69e-ca6f-483a-b277-508cc2c59e77 Jul 31 10:58:44 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:44 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fe0e50b6-8f28-499a-88ad-c6ecabe51635 tempest-ProjectReaderTests-1773540423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-84a6b69e-ca6f-483a-b277-508cc2c59e77" returned: 0 in 0.263s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:44 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-fe0e50b6-8f28-499a-88ad-c6ecabe51635 tempest-ProjectReaderTests-1773540423 None] Lock "cinder-quobyte-84a6b69e-ca6f-483a-b277-508cc2c59e77" released by "delete_volume" :: held 0.698s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:44 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-fe0e50b6-8f28-499a-88ad-c6ecabe51635 tempest-ProjectReaderTests-1773540423 None] Created reservations ['c03ac74c-2418-4796-b8f5-68e444388f0e', 'e69c1227-6ec1-4c7b-8192-c03bf02b5017', '97f1fabc-cfe8-4f87-9fbf-f335f80bc3eb', 'd9d6dd4f-d366-4bf7-b2fd-f19a44938129'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:58:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-fe0e50b6-8f28-499a-88ad-c6ecabe51635 tempest-ProjectReaderTests-1773540423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-fe0e50b6-8f28-499a-88ad-c6ecabe51635 tempest-ProjectReaderTests-1773540423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:44 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-fe0e50b6-8f28-499a-88ad-c6ecabe51635 tempest-ProjectReaderTests-1773540423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:58:44 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-fe0e50b6-8f28-499a-88ad-c6ecabe51635 tempest-ProjectReaderTests-1773540423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:58:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-fe0e50b6-8f28-499a-88ad-c6ecabe51635 tempest-ProjectReaderTests-1773540423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fe0e50b6-8f28-499a-88ad-c6ecabe51635 tempest-ProjectReaderTests-1773540423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:44 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:58:44 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:44 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fe0e50b6-8f28-499a-88ad-c6ecabe51635 tempest-ProjectReaderTests-1773540423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.262s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:44 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-fe0e50b6-8f28-499a-88ad-c6ecabe51635 tempest-ProjectReaderTests-1773540423 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:58:44 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-fe0e50b6-8f28-499a-88ad-c6ecabe51635 tempest-ProjectReaderTests-1773540423 None] Deleted volume successfully. Jul 31 10:58:44 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-fe0e50b6-8f28-499a-88ad-c6ecabe51635 tempest-ProjectReaderTests-1773540423 None] Lock "cinder-84a6b69e-ca6f-483a-b277-508cc2c59e77-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:45 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:58:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:58:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:58:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:46 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:58:46 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:46 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.300s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:46 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:58:46 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager._thread_info {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:58:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread count: 28 {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:58:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread info: [<_MainThread(MainThread, started 134005426110592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:58:54 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:INSERT=9,cinder:UPDATE=43,cinder:SELECT=28,cinder:DELETE=3 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:58:54 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=20,cinder:INSERT=10,cinder:UPDATE=38,cinder:DELETE=4 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bbd3f26-8cd0-43ba-b109-bf242e09415e tempest-CinderUnicodeTest-1615543778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0bbd3f26-8cd0-43ba-b109-bf242e09415e tempest-CinderUnicodeTest-1615543778 None] Flow 'volume_create_manager' (33cb040a-0913-4913-adb9-c56e859aa3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0bbd3f26-8cd0-43ba-b109-bf242e09415e tempest-CinderUnicodeTest-1615543778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a54d07f3-a6d9-4d51-8084-e4874c6daa68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee6b0872-9d2a-4789-add9-de72da2be8b6 tempest-VolumeDependencyTests-1531137417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ee6b0872-9d2a-4789-add9-de72da2be8b6 tempest-VolumeDependencyTests-1531137417 None] Flow 'volume_create_manager' (2a733469-ea1c-44be-b977-0b078830076c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ee6b0872-9d2a-4789-add9-de72da2be8b6 tempest-VolumeDependencyTests-1531137417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5daa4e48-2d1b-4758-858a-e6a88d2addc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0bbd3f26-8cd0-43ba-b109-bf242e09415e tempest-CinderUnicodeTest-1615543778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a54d07f3-a6d9-4d51-8084-e4874c6daa68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b43b3150-921d-4275-a798-c9571ab7c961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='799340be2e7140bea915845bad356de3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:58Z,use_quota=True,user_id='03d8b1b9141349d1a52207f282ebf13f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0bbd3f26-8cd0-43ba-b109-bf242e09415e tempest-CinderUnicodeTest-1615543778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f6d1959-6635-4672-8c3a-ae30446ea4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0bbd3f26-8cd0-43ba-b109-bf242e09415e tempest-CinderUnicodeTest-1615543778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f6d1959-6635-4672-8c3a-ae30446ea4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0bbd3f26-8cd0-43ba-b109-bf242e09415e tempest-CinderUnicodeTest-1615543778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee3ef241-baf2-4fd2-a062-a8afe4b24187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0bbd3f26-8cd0-43ba-b109-bf242e09415e tempest-CinderUnicodeTest-1615543778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee3ef241-baf2-4fd2-a062-a8afe4b24187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b43b3150-921d-4275-a798-c9571ab7c961', 'volume_name': 'volume-b43b3150-921d-4275-a798-c9571ab7c961', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0bbd3f26-8cd0-43ba-b109-bf242e09415e tempest-CinderUnicodeTest-1615543778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b71243ed-cef7-4eb4-b64c-c453be8a09a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0bbd3f26-8cd0-43ba-b109-bf242e09415e tempest-CinderUnicodeTest-1615543778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b71243ed-cef7-4eb4-b64c-c453be8a09a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0bbd3f26-8cd0-43ba-b109-bf242e09415e tempest-CinderUnicodeTest-1615543778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (918d60be-3413-47e5-b45b-cf6d931c43bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:58 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-0bbd3f26-8cd0-43ba-b109-bf242e09415e tempest-CinderUnicodeTest-1615543778 None] Volume b43b3150-921d-4275-a798-c9571ab7c961: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b43b3150-921d-4275-a798-c9571ab7c961', 'volume_size': 1} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0bbd3f26-8cd0-43ba-b109-bf242e09415e tempest-CinderUnicodeTest-1615543778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0bbd3f26-8cd0-43ba-b109-bf242e09415e tempest-CinderUnicodeTest-1615543778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0bbd3f26-8cd0-43ba-b109-bf242e09415e tempest-CinderUnicodeTest-1615543778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b43b3150-921d-4275-a798-c9571ab7c961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='799340be2e7140bea915845bad356de3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:58Z,use_quota=True,user_id='03d8b1b9141349d1a52207f282ebf13f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-0bbd3f26-8cd0-43ba-b109-bf242e09415e tempest-CinderUnicodeTest-1615543778 None] Creating volume b43b3150-921d-4275-a798-c9571ab7c961 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0bbd3f26-8cd0-43ba-b109-bf242e09415e tempest-CinderUnicodeTest-1615543778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0bbd3f26-8cd0-43ba-b109-bf242e09415e tempest-CinderUnicodeTest-1615543778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0bbd3f26-8cd0-43ba-b109-bf242e09415e tempest-CinderUnicodeTest-1615543778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0bbd3f26-8cd0-43ba-b109-bf242e09415e tempest-CinderUnicodeTest-1615543778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0bbd3f26-8cd0-43ba-b109-bf242e09415e tempest-CinderUnicodeTest-1615543778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0bbd3f26-8cd0-43ba-b109-bf242e09415e tempest-CinderUnicodeTest-1615543778 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:58:58 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-0bbd3f26-8cd0-43ba-b109-bf242e09415e tempest-CinderUnicodeTest-1615543778 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0bbd3f26-8cd0-43ba-b109-bf242e09415e tempest-CinderUnicodeTest-1615543778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b43b3150-921d-4275-a798-c9571ab7c961 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:58 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b43b3150-921d-4275-a798-c9571ab7c961 1073741824 Jul 31 10:58:58 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ee6b0872-9d2a-4789-add9-de72da2be8b6 tempest-VolumeDependencyTests-1531137417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5daa4e48-2d1b-4758-858a-e6a88d2addc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-828042228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b735d01-5740-4d5d-a242-4c1b861117ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1453d39d755f48259ca04835f01de0e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:58Z,use_quota=True,user_id='5cc4c4f6904a4118864d9fa55578332b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ee6b0872-9d2a-4789-add9-de72da2be8b6 tempest-VolumeDependencyTests-1531137417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c38d11c-95d8-49e8-849b-03886b261531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ee6b0872-9d2a-4789-add9-de72da2be8b6 tempest-VolumeDependencyTests-1531137417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c38d11c-95d8-49e8-849b-03886b261531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ee6b0872-9d2a-4789-add9-de72da2be8b6 tempest-VolumeDependencyTests-1531137417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cddb4ad-04c8-4093-b335-fdedb429635f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ee6b0872-9d2a-4789-add9-de72da2be8b6 tempest-VolumeDependencyTests-1531137417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cddb4ad-04c8-4093-b335-fdedb429635f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b735d01-5740-4d5d-a242-4c1b861117ed', 'volume_name': 'volume-5b735d01-5740-4d5d-a242-4c1b861117ed', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ee6b0872-9d2a-4789-add9-de72da2be8b6 tempest-VolumeDependencyTests-1531137417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72593c0e-bfb6-4b1b-ab51-900d0ffe9e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ee6b0872-9d2a-4789-add9-de72da2be8b6 tempest-VolumeDependencyTests-1531137417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72593c0e-bfb6-4b1b-ab51-900d0ffe9e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ee6b0872-9d2a-4789-add9-de72da2be8b6 tempest-VolumeDependencyTests-1531137417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d3a6e63-7f0b-4eca-bc4a-04211617e290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:58 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-ee6b0872-9d2a-4789-add9-de72da2be8b6 tempest-VolumeDependencyTests-1531137417 None] Volume 5b735d01-5740-4d5d-a242-4c1b861117ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b735d01-5740-4d5d-a242-4c1b861117ed', 'volume_size': 1} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ee6b0872-9d2a-4789-add9-de72da2be8b6 tempest-VolumeDependencyTests-1531137417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-390a0300-6a57-42f6-a72a-63afa338af84 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-390a0300-6a57-42f6-a72a-63afa338af84 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Flow 'volume_create_manager' (d13b7809-b6c4-4f7d-a281-84de0b24291d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-390a0300-6a57-42f6-a72a-63afa338af84 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89cbcb7f-5c98-4cfc-9188-460d6253fb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-390a0300-6a57-42f6-a72a-63afa338af84 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89cbcb7f-5c98-4cfc-9188-460d6253fb48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1415002753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af7576d8-a63c-41aa-a0af-3adbaa961296,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a9a3b6d04894d22961e068f6c11eed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:59Z,use_quota=True,user_id='adf38e0705a04186a1c094f28d618fc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-390a0300-6a57-42f6-a72a-63afa338af84 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7bb05aa-bf98-4bec-8a40-904735dcab57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-390a0300-6a57-42f6-a72a-63afa338af84 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7bb05aa-bf98-4bec-8a40-904735dcab57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-390a0300-6a57-42f6-a72a-63afa338af84 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27a4c667-9646-40d3-b830-0bc870c56185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-390a0300-6a57-42f6-a72a-63afa338af84 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27a4c667-9646-40d3-b830-0bc870c56185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af7576d8-a63c-41aa-a0af-3adbaa961296', 'volume_name': 'volume-af7576d8-a63c-41aa-a0af-3adbaa961296', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-390a0300-6a57-42f6-a72a-63afa338af84 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46ecc4ce-ee6b-45dd-9c10-aa4cd0c85c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-390a0300-6a57-42f6-a72a-63afa338af84 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46ecc4ce-ee6b-45dd-9c10-aa4cd0c85c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-390a0300-6a57-42f6-a72a-63afa338af84 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68a6c809-bdd5-47cd-890d-6b86c2f623cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:58 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-390a0300-6a57-42f6-a72a-63afa338af84 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Volume af7576d8-a63c-41aa-a0af-3adbaa961296: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af7576d8-a63c-41aa-a0af-3adbaa961296', 'volume_size': 1} Jul 31 10:58:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-390a0300-6a57-42f6-a72a-63afa338af84 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:59 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0bbd3f26-8cd0-43ba-b109-bf242e09415e tempest-CinderUnicodeTest-1615543778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b43b3150-921d-4275-a798-c9571ab7c961 1073741824" returned: 0 in 0.616s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0bbd3f26-8cd0-43ba-b109-bf242e09415e tempest-CinderUnicodeTest-1615543778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b43b3150-921d-4275-a798-c9571ab7c961 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:59 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b43b3150-921d-4275-a798-c9571ab7c961 Jul 31 10:58:59 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:59 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0bbd3f26-8cd0-43ba-b109-bf242e09415e tempest-CinderUnicodeTest-1615543778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b43b3150-921d-4275-a798-c9571ab7c961" returned: 0 in 0.288s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:59 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0bbd3f26-8cd0-43ba-b109-bf242e09415e tempest-CinderUnicodeTest-1615543778 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:58:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0bbd3f26-8cd0-43ba-b109-bf242e09415e tempest-CinderUnicodeTest-1615543778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ee6b0872-9d2a-4789-add9-de72da2be8b6 tempest-VolumeDependencyTests-1531137417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.842s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:59 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ee6b0872-9d2a-4789-add9-de72da2be8b6 tempest-VolumeDependencyTests-1531137417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-828042228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b735d01-5740-4d5d-a242-4c1b861117ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1453d39d755f48259ca04835f01de0e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:58Z,use_quota=True,user_id='5cc4c4f6904a4118864d9fa55578332b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:58:59 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-ee6b0872-9d2a-4789-add9-de72da2be8b6 tempest-VolumeDependencyTests-1531137417 None] Creating volume 5b735d01-5740-4d5d-a242-4c1b861117ed {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:58:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ee6b0872-9d2a-4789-add9-de72da2be8b6 tempest-VolumeDependencyTests-1531137417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ee6b0872-9d2a-4789-add9-de72da2be8b6 tempest-VolumeDependencyTests-1531137417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:59 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ee6b0872-9d2a-4789-add9-de72da2be8b6 tempest-VolumeDependencyTests-1531137417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:58:59 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ee6b0872-9d2a-4789-add9-de72da2be8b6 tempest-VolumeDependencyTests-1531137417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:58:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ee6b0872-9d2a-4789-add9-de72da2be8b6 tempest-VolumeDependencyTests-1531137417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:59 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ee6b0872-9d2a-4789-add9-de72da2be8b6 tempest-VolumeDependencyTests-1531137417 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:58:59 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-ee6b0872-9d2a-4789-add9-de72da2be8b6 tempest-VolumeDependencyTests-1531137417 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:58:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ee6b0872-9d2a-4789-add9-de72da2be8b6 tempest-VolumeDependencyTests-1531137417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:59 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0bbd3f26-8cd0-43ba-b109-bf242e09415e tempest-CinderUnicodeTest-1615543778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (918d60be-3413-47e5-b45b-cf6d931c43bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b43b3150-921d-4275-a798-c9571ab7c961', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:59 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed 1073741824 Jul 31 10:58:59 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:59 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0bbd3f26-8cd0-43ba-b109-bf242e09415e tempest-CinderUnicodeTest-1615543778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d405747-ea30-4dc2-bfec-efe850ea3a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:59 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-0bbd3f26-8cd0-43ba-b109-bf242e09415e tempest-CinderUnicodeTest-1615543778 None] Volume volume-b43b3150-921d-4275-a798-c9571ab7c961 (b43b3150-921d-4275-a798-c9571ab7c961): created successfully Jul 31 10:58:59 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0bbd3f26-8cd0-43ba-b109-bf242e09415e tempest-CinderUnicodeTest-1615543778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d405747-ea30-4dc2-bfec-efe850ea3a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:59 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0bbd3f26-8cd0-43ba-b109-bf242e09415e tempest-CinderUnicodeTest-1615543778 None] Flow 'volume_create_manager' (33cb040a-0913-4913-adb9-c56e859aa3c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:59 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-0bbd3f26-8cd0-43ba-b109-bf242e09415e tempest-CinderUnicodeTest-1615543778 None] Created volume successfully. Jul 31 10:59:00 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ee6b0872-9d2a-4789-add9-de72da2be8b6 tempest-VolumeDependencyTests-1531137417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed 1073741824" returned: 0 in 0.545s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ee6b0872-9d2a-4789-add9-de72da2be8b6 tempest-VolumeDependencyTests-1531137417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:00 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed Jul 31 10:59:00 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:00 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ee6b0872-9d2a-4789-add9-de72da2be8b6 tempest-VolumeDependencyTests-1531137417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed" returned: 0 in 0.317s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:00 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ee6b0872-9d2a-4789-add9-de72da2be8b6 tempest-VolumeDependencyTests-1531137417 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ee6b0872-9d2a-4789-add9-de72da2be8b6 tempest-VolumeDependencyTests-1531137417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-390a0300-6a57-42f6-a72a-63afa338af84 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.597s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:00 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-390a0300-6a57-42f6-a72a-63afa338af84 tempest-CreateVolumesFromSnapshotTest-1817441323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1415002753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af7576d8-a63c-41aa-a0af-3adbaa961296,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a9a3b6d04894d22961e068f6c11eed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:59Z,use_quota=True,user_id='adf38e0705a04186a1c094f28d618fc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:00 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-390a0300-6a57-42f6-a72a-63afa338af84 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Creating volume af7576d8-a63c-41aa-a0af-3adbaa961296 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-390a0300-6a57-42f6-a72a-63afa338af84 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-390a0300-6a57-42f6-a72a-63afa338af84 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:00 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-390a0300-6a57-42f6-a72a-63afa338af84 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:00 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-390a0300-6a57-42f6-a72a-63afa338af84 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-390a0300-6a57-42f6-a72a-63afa338af84 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:00 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-390a0300-6a57-42f6-a72a-63afa338af84 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:59:00 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-390a0300-6a57-42f6-a72a-63afa338af84 tempest-CreateVolumesFromSnapshotTest-1817441323 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:59:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-390a0300-6a57-42f6-a72a-63afa338af84 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:00 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ee6b0872-9d2a-4789-add9-de72da2be8b6 tempest-VolumeDependencyTests-1531137417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d3a6e63-7f0b-4eca-bc4a-04211617e290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b735d01-5740-4d5d-a242-4c1b861117ed', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:00 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296 1073741824 Jul 31 10:59:00 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ee6b0872-9d2a-4789-add9-de72da2be8b6 tempest-VolumeDependencyTests-1531137417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74531c7-fdcb-4e74-9f7b-b19172ae180d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:00 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:00 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-ee6b0872-9d2a-4789-add9-de72da2be8b6 tempest-VolumeDependencyTests-1531137417 None] Volume volume-5b735d01-5740-4d5d-a242-4c1b861117ed (5b735d01-5740-4d5d-a242-4c1b861117ed): created successfully Jul 31 10:59:00 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ee6b0872-9d2a-4789-add9-de72da2be8b6 tempest-VolumeDependencyTests-1531137417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74531c7-fdcb-4e74-9f7b-b19172ae180d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:00 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ee6b0872-9d2a-4789-add9-de72da2be8b6 tempest-VolumeDependencyTests-1531137417 None] Flow 'volume_create_manager' (2a733469-ea1c-44be-b977-0b078830076c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:00 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-ee6b0872-9d2a-4789-add9-de72da2be8b6 tempest-VolumeDependencyTests-1531137417 None] Created volume successfully. Jul 31 10:59:01 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-e82d3818-454e-46d4-95d2-b377d886c488 tempest-CinderUnicodeTest-1615543778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:01 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e82d3818-454e-46d4-95d2-b377d886c488 tempest-CinderUnicodeTest-1615543778 None] Flow 'volume_create_manager' (604cc5b9-8148-418d-b3b3-2a9c3d62a917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:01 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e82d3818-454e-46d4-95d2-b377d886c488 tempest-CinderUnicodeTest-1615543778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ebf33cf-82d7-403f-9dd8-81844cf0d9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:01 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e82d3818-454e-46d4-95d2-b377d886c488 tempest-CinderUnicodeTest-1615543778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ebf33cf-82d7-403f-9dd8-81844cf0d9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1326092194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceaefb71-e739-40f4-8c57-56cf0a6c5158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='799340be2e7140bea915845bad356de3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:01Z,use_quota=True,user_id='03d8b1b9141349d1a52207f282ebf13f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:01 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e82d3818-454e-46d4-95d2-b377d886c488 tempest-CinderUnicodeTest-1615543778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fba14a3d-18ea-42aa-84da-178dddb7d31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:01 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:01 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e82d3818-454e-46d4-95d2-b377d886c488 tempest-CinderUnicodeTest-1615543778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fba14a3d-18ea-42aa-84da-178dddb7d31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:01 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e82d3818-454e-46d4-95d2-b377d886c488 tempest-CinderUnicodeTest-1615543778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5b0cba0-59cd-488a-bc76-003faade565a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:01 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e82d3818-454e-46d4-95d2-b377d886c488 tempest-CinderUnicodeTest-1615543778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5b0cba0-59cd-488a-bc76-003faade565a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ceaefb71-e739-40f4-8c57-56cf0a6c5158', 'volume_name': 'volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:01 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e82d3818-454e-46d4-95d2-b377d886c488 tempest-CinderUnicodeTest-1615543778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (297302cd-fcbb-4d9c-8905-159693f5e361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:01 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e82d3818-454e-46d4-95d2-b377d886c488 tempest-CinderUnicodeTest-1615543778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (297302cd-fcbb-4d9c-8905-159693f5e361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:01 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e82d3818-454e-46d4-95d2-b377d886c488 tempest-CinderUnicodeTest-1615543778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcb76bd3-4130-4f8c-84cf-92ec5cc21970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:01 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-e82d3818-454e-46d4-95d2-b377d886c488 tempest-CinderUnicodeTest-1615543778 None] Volume ceaefb71-e739-40f4-8c57-56cf0a6c5158: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158', 'volume_size': 1} Jul 31 10:59:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e82d3818-454e-46d4-95d2-b377d886c488 tempest-CinderUnicodeTest-1615543778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-390a0300-6a57-42f6-a72a-63afa338af84 tempest-CreateVolumesFromSnapshotTest-1817441323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296 1073741824" returned: 0 in 0.662s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-390a0300-6a57-42f6-a72a-63afa338af84 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:01 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296 Jul 31 10:59:01 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:01 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-390a0300-6a57-42f6-a72a-63afa338af84 tempest-CreateVolumesFromSnapshotTest-1817441323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296" returned: 0 in 0.292s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:01 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-390a0300-6a57-42f6-a72a-63afa338af84 tempest-CreateVolumesFromSnapshotTest-1817441323 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-390a0300-6a57-42f6-a72a-63afa338af84 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e82d3818-454e-46d4-95d2-b377d886c488 tempest-CinderUnicodeTest-1615543778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.342s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:01 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-e82d3818-454e-46d4-95d2-b377d886c488 tempest-CinderUnicodeTest-1615543778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1326092194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceaefb71-e739-40f4-8c57-56cf0a6c5158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='799340be2e7140bea915845bad356de3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:01Z,use_quota=True,user_id='03d8b1b9141349d1a52207f282ebf13f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:01 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-e82d3818-454e-46d4-95d2-b377d886c488 tempest-CinderUnicodeTest-1615543778 None] Creating volume ceaefb71-e739-40f4-8c57-56cf0a6c5158 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e82d3818-454e-46d4-95d2-b377d886c488 tempest-CinderUnicodeTest-1615543778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e82d3818-454e-46d4-95d2-b377d886c488 tempest-CinderUnicodeTest-1615543778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:01 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-e82d3818-454e-46d4-95d2-b377d886c488 tempest-CinderUnicodeTest-1615543778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:01 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-e82d3818-454e-46d4-95d2-b377d886c488 tempest-CinderUnicodeTest-1615543778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e82d3818-454e-46d4-95d2-b377d886c488 tempest-CinderUnicodeTest-1615543778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:01 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-e82d3818-454e-46d4-95d2-b377d886c488 tempest-CinderUnicodeTest-1615543778 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:59:01 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-e82d3818-454e-46d4-95d2-b377d886c488 tempest-CinderUnicodeTest-1615543778 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:59:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e82d3818-454e-46d4-95d2-b377d886c488 tempest-CinderUnicodeTest-1615543778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:01 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158 1073741824 Jul 31 10:59:01 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-390a0300-6a57-42f6-a72a-63afa338af84 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68a6c809-bdd5-47cd-890d-6b86c2f623cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af7576d8-a63c-41aa-a0af-3adbaa961296', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:01 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:01 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-390a0300-6a57-42f6-a72a-63afa338af84 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd2447fc-96e8-4401-b1a7-79472ed6b9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:01 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-390a0300-6a57-42f6-a72a-63afa338af84 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Volume volume-af7576d8-a63c-41aa-a0af-3adbaa961296 (af7576d8-a63c-41aa-a0af-3adbaa961296): created successfully Jul 31 10:59:01 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-390a0300-6a57-42f6-a72a-63afa338af84 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd2447fc-96e8-4401-b1a7-79472ed6b9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:01 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-390a0300-6a57-42f6-a72a-63afa338af84 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Flow 'volume_create_manager' (d13b7809-b6c4-4f7d-a281-84de0b24291d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:01 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-390a0300-6a57-42f6-a72a-63afa338af84 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Created volume successfully. Jul 31 10:59:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-eaae620a-3d96-4981-b46b-3c20749cb832 tempest-VolumeDependencyTests-1531137417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:02 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e82d3818-454e-46d4-95d2-b377d886c488 tempest-CinderUnicodeTest-1615543778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158 1073741824" returned: 0 in 0.565s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e82d3818-454e-46d4-95d2-b377d886c488 tempest-CinderUnicodeTest-1615543778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:02 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158 Jul 31 10:59:02 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ef4ddfe2-ec75-4532-8f28-c383481489e0 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:02 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e82d3818-454e-46d4-95d2-b377d886c488 tempest-CinderUnicodeTest-1615543778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158" returned: 0 in 0.321s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:02 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-e82d3818-454e-46d4-95d2-b377d886c488 tempest-CinderUnicodeTest-1615543778 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e82d3818-454e-46d4-95d2-b377d886c488 tempest-CinderUnicodeTest-1615543778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-eaae620a-3d96-4981-b46b-3c20749cb832 tempest-VolumeDependencyTests-1531137417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.669s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e82d3818-454e-46d4-95d2-b377d886c488 tempest-CinderUnicodeTest-1615543778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcb76bd3-4130-4f8c-84cf-92ec5cc21970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e82d3818-454e-46d4-95d2-b377d886c488 tempest-CinderUnicodeTest-1615543778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fafb62d-77e2-45fa-adca-0d3bb6f2d170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:02 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-eaae620a-3d96-4981-b46b-3c20749cb832 tempest-VolumeDependencyTests-1531137417 None] Creating offline snapshot 217d23c2-136c-4da8-9ee0-5c6ddf94138b of volume 5b735d01-5740-4d5d-a242-4c1b861117ed {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:59:02 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-e82d3818-454e-46d4-95d2-b377d886c488 tempest-CinderUnicodeTest-1615543778 None] Volume volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158 (ceaefb71-e739-40f4-8c57-56cf0a6c5158): created successfully Jul 31 10:59:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e82d3818-454e-46d4-95d2-b377d886c488 tempest-CinderUnicodeTest-1615543778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fafb62d-77e2-45fa-adca-0d3bb6f2d170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e82d3818-454e-46d4-95d2-b377d886c488 tempest-CinderUnicodeTest-1615543778 None] Flow 'volume_create_manager' (604cc5b9-8148-418d-b3b3-2a9c3d62a917) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:02 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b871d4-3357-4ecf-9b51-11a60a8dfbc7]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-eaae620a-3d96-4981-b46b-3c20749cb832 tempest-VolumeDependencyTests-1531137417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:02 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-e82d3818-454e-46d4-95d2-b377d886c488 tempest-CinderUnicodeTest-1615543778 None] Created volume successfully. Jul 31 10:59:02 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed Jul 31 10:59:02 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:02 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-eaae620a-3d96-4981-b46b-3c20749cb832 tempest-VolumeDependencyTests-1531137417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed" returned: 0 in 0.465s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-eaae620a-3d96-4981-b46b-3c20749cb832 tempest-VolumeDependencyTests-1531137417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed.217d23c2-136c-4da8-9ee0-5c6ddf94138b 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:03 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed.217d23c2-136c-4da8-9ee0-5c6ddf94138b 1G Jul 31 10:59:03 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:03 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Flow 'volume_create_manager' (099e5fa4-4460-4bd5-ba0d-e1d042ae13d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bed49f9d-4748-4db5-93fd-9538781b58c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bed49f9d-4748-4db5-93fd-9538781b58c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc0cfb684f4a4bdca4c5b0e46c531139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:03Z,use_quota=True,user_id='444b1244d44e4adbb642e35707c8dcce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2fb6709b-3bff-4cc9-a857-85bd47978db8),volume_type_id=2fb6709b-3bff-4cc9-a857-85bd47978db8)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4294111-1fb1-420e-a14d-074ab883e622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4294111-1fb1-420e-a14d-074ab883e622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ece3c19-4f8b-4aff-85c1-c674fdeefb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:03 devstack cinder-volume[89090]: DEBUG cinder.image.glance [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Creating Keystone auth plugin from conf {{(pid=89090) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 10:59:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-5b59600e-3d4b-4318-90ab-18ebcccbc54e tempest-CinderUnicodeTest-1615543778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:03 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-eaae620a-3d96-4981-b46b-3c20749cb832 tempest-VolumeDependencyTests-1531137417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed.217d23c2-136c-4da8-9ee0-5c6ddf94138b 1G" returned: 0 in 0.601s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-eaae620a-3d96-4981-b46b-3c20749cb832 tempest-VolumeDependencyTests-1531137417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b735d01-5740-4d5d-a242-4c1b861117ed -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed.217d23c2-136c-4da8-9ee0-5c6ddf94138b {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:03 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b735d01-5740-4d5d-a242-4c1b861117ed -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed.217d23c2-136c-4da8-9ee0-5c6ddf94138b Jul 31 10:59:03 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ece3c19-4f8b-4aff-85c1-c674fdeefb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85', 'volume_name': 'volume-f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85', 'volume_size': 1, 'image_id': '1693b487-a822-442c-b414-989491e71568', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1693b487-a822-442c-b414-989491e71568', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd8bfacba73236574adb38c7c39e77b1e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fc0cfb684f4a4bdca4c5b0e46c531139', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '293f03728134a15c720abbbf866a002615568fdf6739e20dd482c4db00c4e2dabcc98e888525d054e2278422dc2d343099b923f6d74b3223ab106562b3458c61', 'id': '1693b487-a822-442c-b414-989491e71568', 'created_at': datetime.datetime(2026, 7, 31, 8, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 59, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1693b487-a822-442c-b414-989491e71568/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb556e10-1c48-4cf2-81b9-6fdad7bc41ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb556e10-1c48-4cf2-81b9-6fdad7bc41ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256603b2-10fe-46f8-beef-1c75b479221f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:03 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Volume f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85', 'volume_size': 1, 'image_id': '1693b487-a822-442c-b414-989491e71568', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1693b487-a822-442c-b414-989491e71568', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd8bfacba73236574adb38c7c39e77b1e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fc0cfb684f4a4bdca4c5b0e46c531139', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '293f03728134a15c720abbbf866a002615568fdf6739e20dd482c4db00c4e2dabcc98e888525d054e2278422dc2d343099b923f6d74b3223ab106562b3458c61', 'id': '1693b487-a822-442c-b414-989491e71568', 'created_at': datetime.datetime(2026, 7, 31, 8, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 59, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1693b487-a822-442c-b414-989491e71568/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 31 10:59:03 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Trying to clone f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85 from image 1693b487-a822-442c-b414-989491e71568 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1693b487-a822-442c-b414-989491e71568', 'metadata': {}}]). {{(pid=89090) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 10:59:03 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1693b487-a822-442c-b414-989491e71568_5l7fe5kqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89090) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 10:59:03 devstack cinder-volume[89090]: INFO cinder.image.image_utils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Image download 0.00 MB at 0.00 MB/s Jul 31 10:59:03 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf31220-9050-451d-9007-0470a3025d0b]: (4, 'raw') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1693b487-a822-442c-b414-989491e71568_5l7fe5kqdevstack@QuobyteHD {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:03 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-eaae620a-3d96-4981-b46b-3c20749cb832 tempest-VolumeDependencyTests-1531137417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b735d01-5740-4d5d-a242-4c1b861117ed -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed.217d23c2-136c-4da8-9ee0-5c6ddf94138b" returned: 0 in 0.365s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:03 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-eaae620a-3d96-4981-b46b-3c20749cb832 tempest-VolumeDependencyTests-1531137417 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed.217d23c2-136c-4da8-9ee0-5c6ddf94138b is being set with open permissions: ugo+rw Jul 31 10:59:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-eaae620a-3d96-4981-b46b-3c20749cb832 tempest-VolumeDependencyTests-1531137417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed.217d23c2-136c-4da8-9ee0-5c6ddf94138b {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:03 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed.217d23c2-136c-4da8-9ee0-5c6ddf94138b Jul 31 10:59:03 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1693b487-a822-442c-b414-989491e71568_5l7fe5kqdevstack@QuobyteHD Jul 31 10:59:03 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:03 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:04 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1693b487-a822-442c-b414-989491e71568_5l7fe5kqdevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1693b487-a822-442c-b414-989491e71568_5l7fe5kqdevstack@QuobyteHD {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:04 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-eaae620a-3d96-4981-b46b-3c20749cb832 tempest-VolumeDependencyTests-1531137417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed.217d23c2-136c-4da8-9ee0-5c6ddf94138b" returned: 0 in 0.301s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-eaae620a-3d96-4981-b46b-3c20749cb832 tempest-VolumeDependencyTests-1531137417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:04 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed.info Jul 31 10:59:04 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:04 devstack sudo[107123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1693b487-a822-442c-b414-989491e71568_5l7fe5kqdevstack@QuobyteHD Jul 31 10:59:04 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:04 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1693b487-a822-442c-b414-989491e71568_5l7fe5kqdevstack@QuobyteHD" returned: 1 in 0.366s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1693b487-a822-442c-b414-989491e71568_5l7fe5kqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 10:59:04 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Temporary image 1693b487-a822-442c-b414-989491e71568 is fetched for user 444b1244d44e4adbb642e35707c8dcce. {{(pid=89090) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 10:59:04 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-eaae620a-3d96-4981-b46b-3c20749cb832 tempest-VolumeDependencyTests-1531137417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed.info" returned: 0 in 0.322s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:04 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-eaae620a-3d96-4981-b46b-3c20749cb832 tempest-VolumeDependencyTests-1531137417 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed.info is being set with open permissions: ugo+rw Jul 31 10:59:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-eaae620a-3d96-4981-b46b-3c20749cb832 tempest-VolumeDependencyTests-1531137417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:04 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed.info Jul 31 10:59:04 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:04 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[192d34d3-6561-48fe-bde3-870b0718b3b0]: (4, 'raw') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1693b487-a822-442c-b414-989491e71568_5l7fe5kqdevstack@QuobyteHD {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:04 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1693b487-a822-442c-b414-989491e71568_5l7fe5kqdevstack@QuobyteHD Jul 31 10:59:04 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:04 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-eaae620a-3d96-4981-b46b-3c20749cb832 tempest-VolumeDependencyTests-1531137417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed.info" returned: 0 in 0.294s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-eaae620a-3d96-4981-b46b-3c20749cb832 tempest-VolumeDependencyTests-1531137417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.488s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ef4ddfe2-ec75-4532-8f28-c383481489e0 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.631s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-ef4ddfe2-ec75-4532-8f28-c383481489e0 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Creating offline snapshot 43dbc69c-27c3-41ba-b3dd-28441bd2a603 of volume af7576d8-a63c-41aa-a0af-3adbaa961296 {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:59:04 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-eaae620a-3d96-4981-b46b-3c20749cb832 tempest-VolumeDependencyTests-1531137417 None] Create snapshot completed successfully Jul 31 10:59:04 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[460c9d15-f4ff-40b7-b6bf-16d1dc4c8061]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ef4ddfe2-ec75-4532-8f28-c383481489e0 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:05 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1693b487-a822-442c-b414-989491e71568_5l7fe5kqdevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1693b487-a822-442c-b414-989491e71568_5l7fe5kqdevstack@QuobyteHD {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:05 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296 Jul 31 10:59:05 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:05 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1693b487-a822-442c-b414-989491e71568_5l7fe5kqdevstack@QuobyteHD Jul 31 10:59:05 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:05 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1693b487-a822-442c-b414-989491e71568_5l7fe5kqdevstack@QuobyteHD" returned: 1 in 0.360s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1693b487-a822-442c-b414-989491e71568_5l7fe5kqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 10:59:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:05 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ef4ddfe2-ec75-4532-8f28-c383481489e0 tempest-CreateVolumesFromSnapshotTest-1817441323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296" returned: 0 in 0.446s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ef4ddfe2-ec75-4532-8f28-c383481489e0 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296.43dbc69c-27c3-41ba-b3dd-28441bd2a603 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:05 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296.43dbc69c-27c3-41ba-b3dd-28441bd2a603 1G Jul 31 10:59:05 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:05 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ef4ddfe2-ec75-4532-8f28-c383481489e0 tempest-CreateVolumesFromSnapshotTest-1817441323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296.43dbc69c-27c3-41ba-b3dd-28441bd2a603 1G" returned: 0 in 0.430s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ef4ddfe2-ec75-4532-8f28-c383481489e0 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af7576d8-a63c-41aa-a0af-3adbaa961296 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296.43dbc69c-27c3-41ba-b3dd-28441bd2a603 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:05 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af7576d8-a63c-41aa-a0af-3adbaa961296 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296.43dbc69c-27c3-41ba-b3dd-28441bd2a603 Jul 31 10:59:05 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:06 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ef4ddfe2-ec75-4532-8f28-c383481489e0 tempest-CreateVolumesFromSnapshotTest-1817441323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af7576d8-a63c-41aa-a0af-3adbaa961296 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296.43dbc69c-27c3-41ba-b3dd-28441bd2a603" returned: 0 in 0.350s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:06 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-ef4ddfe2-ec75-4532-8f28-c383481489e0 tempest-CreateVolumesFromSnapshotTest-1817441323 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296.43dbc69c-27c3-41ba-b3dd-28441bd2a603 is being set with open permissions: ugo+rw Jul 31 10:59:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ef4ddfe2-ec75-4532-8f28-c383481489e0 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296.43dbc69c-27c3-41ba-b3dd-28441bd2a603 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:06 devstack sudo[107159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296.43dbc69c-27c3-41ba-b3dd-28441bd2a603 Jul 31 10:59:06 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:06 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ef4ddfe2-ec75-4532-8f28-c383481489e0 tempest-CreateVolumesFromSnapshotTest-1817441323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296.43dbc69c-27c3-41ba-b3dd-28441bd2a603" returned: 0 in 0.268s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ef4ddfe2-ec75-4532-8f28-c383481489e0 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:06 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296.info Jul 31 10:59:06 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:06 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:06 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Flow 'volume_create_manager' (4ceb7a9b-cd50-4fb4-bdf8-e0eafa6dc027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:06 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93669da2-7225-4cf2-884e-0845337f387a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:06 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93669da2-7225-4cf2-884e-0845337f387a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1151336596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96a1e970-13d5-4c72-b458-51c1b6d69e90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1453d39d755f48259ca04835f01de0e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=217d23c2-136c-4da8-9ee0-5c6ddf94138b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:07Z,use_quota=True,user_id='5cc4c4f6904a4118864d9fa55578332b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:06 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76040d81-c4a6-4c1e-baac-edc58c9d4730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:06 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76040d81-c4a6-4c1e-baac-edc58c9d4730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:06 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96b22f64-3555-4982-b6d2-f4980ef24587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:06 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96b22f64-3555-4982-b6d2-f4980ef24587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '96a1e970-13d5-4c72-b458-51c1b6d69e90', 'volume_name': 'volume-96a1e970-13d5-4c72-b458-51c1b6d69e90', 'volume_size': 1, 'snapshot_id': '217d23c2-136c-4da8-9ee0-5c6ddf94138b'}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:06 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9aaf940-8aff-47ae-9e98-f2baf00ca1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:06 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9aaf940-8aff-47ae-9e98-f2baf00ca1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:06 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e77dea7b-dffa-42d9-9d09-90ff8c9e96ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:06 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Volume 96a1e970-13d5-4c72-b458-51c1b6d69e90: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-96a1e970-13d5-4c72-b458-51c1b6d69e90', 'volume_size': 1, 'snapshot_id': '217d23c2-136c-4da8-9ee0-5c6ddf94138b'} Jul 31 10:59:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:06 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ef4ddfe2-ec75-4532-8f28-c383481489e0 tempest-CreateVolumesFromSnapshotTest-1817441323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296.info" returned: 0 in 0.281s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:06 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-ef4ddfe2-ec75-4532-8f28-c383481489e0 tempest-CreateVolumesFromSnapshotTest-1817441323 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296.info is being set with open permissions: ugo+rw Jul 31 10:59:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ef4ddfe2-ec75-4532-8f28-c383481489e0 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:06 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296.info Jul 31 10:59:06 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:07 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ef4ddfe2-ec75-4532-8f28-c383481489e0 tempest-CreateVolumesFromSnapshotTest-1817441323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296.info" returned: 0 in 0.245s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ef4ddfe2-ec75-4532-8f28-c383481489e0 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.129s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-5b59600e-3d4b-4318-90ab-18ebcccbc54e tempest-CinderUnicodeTest-1615543778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.583s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:07 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-5b59600e-3d4b-4318-90ab-18ebcccbc54e tempest-CinderUnicodeTest-1615543778 None] Creating offline snapshot e393c461-6963-4258-a458-8309975f5e96 of volume ceaefb71-e739-40f4-8c57-56cf0a6c5158 {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:59:07 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-ef4ddfe2-ec75-4532-8f28-c383481489e0 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Create snapshot completed successfully Jul 31 10:59:07 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe79b1f-66dc-4035-8a80-51dd3fc75a7e]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5b59600e-3d4b-4318-90ab-18ebcccbc54e tempest-CinderUnicodeTest-1615543778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:07 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158 Jul 31 10:59:07 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:07 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5b59600e-3d4b-4318-90ab-18ebcccbc54e tempest-CinderUnicodeTest-1615543778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158" returned: 0 in 0.413s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5b59600e-3d4b-4318-90ab-18ebcccbc54e tempest-CinderUnicodeTest-1615543778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158.e393c461-6963-4258-a458-8309975f5e96 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:07 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158.e393c461-6963-4258-a458-8309975f5e96 1G Jul 31 10:59:07 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:08 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5b59600e-3d4b-4318-90ab-18ebcccbc54e tempest-CinderUnicodeTest-1615543778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158.e393c461-6963-4258-a458-8309975f5e96 1G" returned: 0 in 0.526s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5b59600e-3d4b-4318-90ab-18ebcccbc54e tempest-CinderUnicodeTest-1615543778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158.e393c461-6963-4258-a458-8309975f5e96 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:08 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158.e393c461-6963-4258-a458-8309975f5e96 Jul 31 10:59:08 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:08 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-22b76e2a-d39a-4c55-85b8-bd09752d4dd7 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-22b76e2a-d39a-4c55-85b8-bd09752d4dd7 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Flow 'volume_create_manager' (3b9e3909-5927-4f6c-999f-33af60712acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-22b76e2a-d39a-4c55-85b8-bd09752d4dd7 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d63f89e-9e74-4c4e-9b4c-38f32cf98b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-22b76e2a-d39a-4c55-85b8-bd09752d4dd7 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d63f89e-9e74-4c4e-9b4c-38f32cf98b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2018545610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75b25500-4229-4607-bc86-4c0994ea71c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a9a3b6d04894d22961e068f6c11eed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:08Z,use_quota=True,user_id='adf38e0705a04186a1c094f28d618fc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-22b76e2a-d39a-4c55-85b8-bd09752d4dd7 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c95b1106-1d8d-404e-93bf-dbd27c9ade86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-22b76e2a-d39a-4c55-85b8-bd09752d4dd7 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c95b1106-1d8d-404e-93bf-dbd27c9ade86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-22b76e2a-d39a-4c55-85b8-bd09752d4dd7 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0e9614d-4882-4069-b2e8-97046158328b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-22b76e2a-d39a-4c55-85b8-bd09752d4dd7 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0e9614d-4882-4069-b2e8-97046158328b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75b25500-4229-4607-bc86-4c0994ea71c7', 'volume_name': 'volume-75b25500-4229-4607-bc86-4c0994ea71c7', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-22b76e2a-d39a-4c55-85b8-bd09752d4dd7 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff07d2e-832c-4d08-ab98-4c17876b1608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-22b76e2a-d39a-4c55-85b8-bd09752d4dd7 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff07d2e-832c-4d08-ab98-4c17876b1608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-22b76e2a-d39a-4c55-85b8-bd09752d4dd7 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f908f2-0dfd-4994-a2c0-cc421f21a568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:08 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-22b76e2a-d39a-4c55-85b8-bd09752d4dd7 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Volume 75b25500-4229-4607-bc86-4c0994ea71c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75b25500-4229-4607-bc86-4c0994ea71c7', 'volume_size': 1} Jul 31 10:59:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-22b76e2a-d39a-4c55-85b8-bd09752d4dd7 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:08 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5b59600e-3d4b-4318-90ab-18ebcccbc54e tempest-CinderUnicodeTest-1615543778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158.e393c461-6963-4258-a458-8309975f5e96" returned: 0 in 0.399s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:08 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-5b59600e-3d4b-4318-90ab-18ebcccbc54e tempest-CinderUnicodeTest-1615543778 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158.e393c461-6963-4258-a458-8309975f5e96 is being set with open permissions: ugo+rw Jul 31 10:59:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5b59600e-3d4b-4318-90ab-18ebcccbc54e tempest-CinderUnicodeTest-1615543778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158.e393c461-6963-4258-a458-8309975f5e96 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:08 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158.e393c461-6963-4258-a458-8309975f5e96 Jul 31 10:59:08 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:08 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d40e33a-f234-40c9-a012-eb6179f7d6b4 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9d40e33a-f234-40c9-a012-eb6179f7d6b4 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Flow 'volume_create_manager' (dc9e814b-b93b-452c-9119-86eff19d31e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9d40e33a-f234-40c9-a012-eb6179f7d6b4 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db9d5695-fe5a-4cf4-9312-d4ab1335dcd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9d40e33a-f234-40c9-a012-eb6179f7d6b4 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db9d5695-fe5a-4cf4-9312-d4ab1335dcd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-172192949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2f19dcc-8503-4f55-ae7c-f44869c03ec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a9a3b6d04894d22961e068f6c11eed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:09Z,use_quota=True,user_id='adf38e0705a04186a1c094f28d618fc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9d40e33a-f234-40c9-a012-eb6179f7d6b4 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (163b8a78-a721-443b-a9a7-9363f1240a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9d40e33a-f234-40c9-a012-eb6179f7d6b4 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (163b8a78-a721-443b-a9a7-9363f1240a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9d40e33a-f234-40c9-a012-eb6179f7d6b4 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22985edd-e60d-40b7-83c7-d77e3c884046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9d40e33a-f234-40c9-a012-eb6179f7d6b4 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22985edd-e60d-40b7-83c7-d77e3c884046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2f19dcc-8503-4f55-ae7c-f44869c03ec5', 'volume_name': 'volume-d2f19dcc-8503-4f55-ae7c-f44869c03ec5', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9d40e33a-f234-40c9-a012-eb6179f7d6b4 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57457d77-931d-4caa-8e97-bf01b4bc3461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9d40e33a-f234-40c9-a012-eb6179f7d6b4 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57457d77-931d-4caa-8e97-bf01b4bc3461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9d40e33a-f234-40c9-a012-eb6179f7d6b4 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95802a51-5bfd-4fde-86cc-5279fc401ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:08 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-9d40e33a-f234-40c9-a012-eb6179f7d6b4 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Volume d2f19dcc-8503-4f55-ae7c-f44869c03ec5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2f19dcc-8503-4f55-ae7c-f44869c03ec5', 'volume_size': 1} Jul 31 10:59:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9d40e33a-f234-40c9-a012-eb6179f7d6b4 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:08 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5b59600e-3d4b-4318-90ab-18ebcccbc54e tempest-CinderUnicodeTest-1615543778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158.e393c461-6963-4258-a458-8309975f5e96" returned: 0 in 0.331s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5b59600e-3d4b-4318-90ab-18ebcccbc54e tempest-CinderUnicodeTest-1615543778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:08 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158.info Jul 31 10:59:08 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ce0211a-eb6d-4c5d-b16f-3e3e2873c3b8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3ce0211a-eb6d-4c5d-b16f-3e3e2873c3b8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Flow 'volume_create_manager' (7752764d-d727-4c85-b227-4b89a7ec0e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3ce0211a-eb6d-4c5d-b16f-3e3e2873c3b8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b22b412-329e-43e1-bee8-fe93ef1dcaad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3ce0211a-eb6d-4c5d-b16f-3e3e2873c3b8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b22b412-329e-43e1-bee8-fe93ef1dcaad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1153569207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5621e381-9640-4bc6-b701-f8d98e794ba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a9a3b6d04894d22961e068f6c11eed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:09Z,use_quota=True,user_id='adf38e0705a04186a1c094f28d618fc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3ce0211a-eb6d-4c5d-b16f-3e3e2873c3b8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fa16567-13ce-4427-9b60-db219cbac93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3ce0211a-eb6d-4c5d-b16f-3e3e2873c3b8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fa16567-13ce-4427-9b60-db219cbac93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3ce0211a-eb6d-4c5d-b16f-3e3e2873c3b8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c19a8e3-07b8-493b-bde8-570ef384ef92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3ce0211a-eb6d-4c5d-b16f-3e3e2873c3b8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c19a8e3-07b8-493b-bde8-570ef384ef92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5621e381-9640-4bc6-b701-f8d98e794ba7', 'volume_name': 'volume-5621e381-9640-4bc6-b701-f8d98e794ba7', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3ce0211a-eb6d-4c5d-b16f-3e3e2873c3b8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1a49531-d06b-4f8e-9799-f39661ac14a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3ce0211a-eb6d-4c5d-b16f-3e3e2873c3b8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1a49531-d06b-4f8e-9799-f39661ac14a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:09 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3ce0211a-eb6d-4c5d-b16f-3e3e2873c3b8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18b8f0bd-4912-49a6-a733-7cd8525bad33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:09 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-3ce0211a-eb6d-4c5d-b16f-3e3e2873c3b8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Volume 5621e381-9640-4bc6-b701-f8d98e794ba7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5621e381-9640-4bc6-b701-f8d98e794ba7', 'volume_size': 1} Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3ce0211a-eb6d-4c5d-b16f-3e3e2873c3b8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5b59600e-3d4b-4318-90ab-18ebcccbc54e tempest-CinderUnicodeTest-1615543778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158.info" returned: 0 in 0.343s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:09 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-5b59600e-3d4b-4318-90ab-18ebcccbc54e tempest-CinderUnicodeTest-1615543778 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158.info is being set with open permissions: ugo+rw Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5b59600e-3d4b-4318-90ab-18ebcccbc54e tempest-CinderUnicodeTest-1615543778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:09 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158.info Jul 31 10:59:09 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:09 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5b59600e-3d4b-4318-90ab-18ebcccbc54e tempest-CinderUnicodeTest-1615543778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158.info" returned: 0 in 0.318s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-5b59600e-3d4b-4318-90ab-18ebcccbc54e tempest-CinderUnicodeTest-1615543778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.451s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.101s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc0cfb684f4a4bdca4c5b0e46c531139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:03Z,use_quota=True,user_id='444b1244d44e4adbb642e35707c8dcce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2fb6709b-3bff-4cc9-a857-85bd47978db8),volume_type_id=2fb6709b-3bff-4cc9-a857-85bd47978db8)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Creating volume f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:59:09 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:09 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85 1073741824 Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c9bc3bf-6c50-4ea0-bcab-e72e0a6e63e8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:09 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4c9bc3bf-6c50-4ea0-bcab-e72e0a6e63e8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Flow 'volume_create_manager' (abf5562b-6ad6-4dcb-9413-377ce15f1946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4c9bc3bf-6c50-4ea0-bcab-e72e0a6e63e8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f7205f-939b-4406-8744-53f7c18d580f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4c9bc3bf-6c50-4ea0-bcab-e72e0a6e63e8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f7205f-939b-4406-8744-53f7c18d580f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-571639549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd166c4d-6dee-4405-9072-178beef05425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a9a3b6d04894d22961e068f6c11eed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:09Z,use_quota=True,user_id='adf38e0705a04186a1c094f28d618fc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4c9bc3bf-6c50-4ea0-bcab-e72e0a6e63e8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72323c21-5767-4708-b27f-9dcf683fefeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4c9bc3bf-6c50-4ea0-bcab-e72e0a6e63e8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72323c21-5767-4708-b27f-9dcf683fefeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4c9bc3bf-6c50-4ea0-bcab-e72e0a6e63e8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5dc8a85-f06a-461d-99b5-5685f3ce25c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4c9bc3bf-6c50-4ea0-bcab-e72e0a6e63e8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5dc8a85-f06a-461d-99b5-5685f3ce25c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd166c4d-6dee-4405-9072-178beef05425', 'volume_name': 'volume-cd166c4d-6dee-4405-9072-178beef05425', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4c9bc3bf-6c50-4ea0-bcab-e72e0a6e63e8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d13db00d-cb8c-4f82-86af-807646251429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4c9bc3bf-6c50-4ea0-bcab-e72e0a6e63e8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d13db00d-cb8c-4f82-86af-807646251429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4c9bc3bf-6c50-4ea0-bcab-e72e0a6e63e8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b75c1d9b-8ad7-4e56-9cf5-3ab75ce961e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:09 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-4c9bc3bf-6c50-4ea0-bcab-e72e0a6e63e8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Volume cd166c4d-6dee-4405-9072-178beef05425: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd166c4d-6dee-4405-9072-178beef05425', 'volume_size': 1} Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4c9bc3bf-6c50-4ea0-bcab-e72e0a6e63e8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:09 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-5b59600e-3d4b-4318-90ab-18ebcccbc54e tempest-CinderUnicodeTest-1615543778 None] Create snapshot completed successfully Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-19691e8d-815d-439e-ac06-79817be148a2 tempest-CinderUnicodeTest-1615543778 None] Acquiring lock "cinder-e393c461-6963-4258-a458-8309975f5e96-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-19691e8d-815d-439e-ac06-79817be148a2 tempest-CinderUnicodeTest-1615543778 None] Lock "cinder-e393c461-6963-4258-a458-8309975f5e96-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:09 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-19691e8d-815d-439e-ac06-79817be148a2 tempest-CinderUnicodeTest-1615543778 None] Acquiring lock "cinder-quobyte-ceaefb71-e739-40f4-8c57-56cf0a6c5158" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-57cb7617-ce41-449d-baba-2c5923d9c01e tempest-CreateVolumesFromSnapshotTest-1817441323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-57cb7617-ce41-449d-baba-2c5923d9c01e tempest-CreateVolumesFromSnapshotTest-1817441323 None] Flow 'volume_create_manager' (a1e09d81-c301-4379-be14-dd422fc82e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-57cb7617-ce41-449d-baba-2c5923d9c01e tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02e7f473-199e-42fe-a4d4-3b2eb1a68b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-19691e8d-815d-439e-ac06-79817be148a2 tempest-CinderUnicodeTest-1615543778 None] Lock "cinder-quobyte-ceaefb71-e739-40f4-8c57-56cf0a6c5158" acquired by "delete_snapshot" :: waited 0.060s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-19691e8d-815d-439e-ac06-79817be148a2 tempest-CinderUnicodeTest-1615543778 None] Acquiring lock "cinder-quobyte-e393c461-6963-4258-a458-8309975f5e96" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-57cb7617-ce41-449d-baba-2c5923d9c01e tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02e7f473-199e-42fe-a4d4-3b2eb1a68b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-323618713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66757784-ecdd-4d8a-9a14-deb526176a17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a9a3b6d04894d22961e068f6c11eed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:10Z,use_quota=True,user_id='adf38e0705a04186a1c094f28d618fc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-57cb7617-ce41-449d-baba-2c5923d9c01e tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34163835-3fdf-4b01-bbde-b297f2de5c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-57cb7617-ce41-449d-baba-2c5923d9c01e tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34163835-3fdf-4b01-bbde-b297f2de5c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-57cb7617-ce41-449d-baba-2c5923d9c01e tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c7bf5e5-a174-4c3b-b4f6-894044035895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-57cb7617-ce41-449d-baba-2c5923d9c01e tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c7bf5e5-a174-4c3b-b4f6-894044035895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66757784-ecdd-4d8a-9a14-deb526176a17', 'volume_name': 'volume-66757784-ecdd-4d8a-9a14-deb526176a17', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-57cb7617-ce41-449d-baba-2c5923d9c01e tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf553235-fbb2-4f87-aa21-187a7fe725f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-57cb7617-ce41-449d-baba-2c5923d9c01e tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf553235-fbb2-4f87-aa21-187a7fe725f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:10 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-57cb7617-ce41-449d-baba-2c5923d9c01e tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0060e3b8-de86-48ee-b6eb-59d02b2688c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:10 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-57cb7617-ce41-449d-baba-2c5923d9c01e tempest-CreateVolumesFromSnapshotTest-1817441323 None] Volume 66757784-ecdd-4d8a-9a14-deb526176a17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66757784-ecdd-4d8a-9a14-deb526176a17', 'volume_size': 1} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-57cb7617-ce41-449d-baba-2c5923d9c01e tempest-CreateVolumesFromSnapshotTest-1817441323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-19691e8d-815d-439e-ac06-79817be148a2 tempest-CinderUnicodeTest-1615543778 None] Lock "cinder-quobyte-e393c461-6963-4258-a458-8309975f5e96" acquired by "_delete_snapshot" :: waited 0.087s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-19691e8d-815d-439e-ac06-79817be148a2 tempest-CinderUnicodeTest-1615543778 None] Deleting offline snapshot e393c461-6963-4258-a458-8309975f5e96 of volume ceaefb71-e739-40f4-8c57-56cf0a6c5158 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-19691e8d-815d-439e-ac06-79817be148a2 tempest-CinderUnicodeTest-1615543778 None] snapshot_file for this snap is: volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158.e393c461-6963-4258-a458-8309975f5e96 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85 1073741824" returned: 0 in 0.595s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a720a1b-488f-432d-8607-09c444285086]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-19691e8d-815d-439e-ac06-79817be148a2 tempest-CinderUnicodeTest-1615543778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158.e393c461-6963-4258-a458-8309975f5e96 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:10 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85 Jul 31 10:59:10 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:10 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158.e393c461-6963-4258-a458-8309975f5e96 Jul 31 10:59:10 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:10 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85" returned: 0 in 0.296s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.791s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Acquiring lock "cinder-quobyte-217d23c2-136c-4da8-9ee0-5c6ddf94138b-96a1e970-13d5-4c72-b458-51c1b6d69e90" by "_create_volume_from_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Lock "cinder-quobyte-217d23c2-136c-4da8-9ee0-5c6ddf94138b-96a1e970-13d5-4c72-b458-51c1b6d69e90" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Creating volume 96a1e970-13d5-4c72-b458-51c1b6d69e90 from snapshot 217d23c2-136c-4da8-9ee0-5c6ddf94138b {{(pid=89090) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Acquiring lock "cinder-quobyte-96a1e970-13d5-4c72-b458-51c1b6d69e90" by "_copy_volume_from_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG cinder.volume.volume_utils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Attempting download of 1693b487-a822-442c-b414-989491e71568 ((None, [{'url': 'file:///opt/stack/data/glance/images/1693b487-a822-442c-b414-989491e71568', 'metadata': {}}])) to volume f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85. {{(pid=89090) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Lock "cinder-quobyte-96a1e970-13d5-4c72-b458-51c1b6d69e90" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] snapshot: 217d23c2-136c-4da8-9ee0-5c6ddf94138b, volume: 96a1e970-13d5-4c72-b458-51c1b6d69e90, {{(pid=89090) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 10:59:10 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-19691e8d-815d-439e-ac06-79817be148a2 tempest-CinderUnicodeTest-1615543778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158.e393c461-6963-4258-a458-8309975f5e96" returned: 0 in 0.442s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-19691e8d-815d-439e-ac06-79817be148a2 tempest-CinderUnicodeTest-1615543778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e344eb4-fcbb-4966-b5b0-efeca6079f41]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-19691e8d-815d-439e-ac06-79817be148a2 tempest-CinderUnicodeTest-1615543778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1f70e8-f31d-42cf-b8e1-8f95bb0e0168]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[47cf94ce-3d27-48af-8532-445aa7f276a6]: (4, 'raw') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed.217d23c2-136c-4da8-9ee0-5c6ddf94138b {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1693b487-a822-442c-b414-989491e71568_5rqzxsfu {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:10 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158 Jul 31 10:59:10 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:10 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1693b487-a822-442c-b414-989491e71568_5rqzxsfu Jul 31 10:59:10 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed.217d23c2-136c-4da8-9ee0-5c6ddf94138b Jul 31 10:59:10 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:10 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:11 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1693b487-a822-442c-b414-989491e71568_5rqzxsfu" returned: 0 in 0.400s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1693b487-a822-442c-b414-989491e71568_5rqzxsfu {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:11 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-19691e8d-815d-439e-ac06-79817be148a2 tempest-CinderUnicodeTest-1615543778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158" returned: 0 in 0.461s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-19691e8d-815d-439e-ac06-79817be148a2 tempest-CinderUnicodeTest-1615543778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158.e393c461-6963-4258-a458-8309975f5e96 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:11 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158.e393c461-6963-4258-a458-8309975f5e96 Jul 31 10:59:11 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:11 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed.217d23c2-136c-4da8-9ee0-5c6ddf94138b" returned: 0 in 0.523s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:11 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b735d01-5740-4d5d-a242-4c1b861117ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:59:11 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[25233c09-7a73-4c46-b199-f57dd8be4b97]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:11 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1693b487-a822-442c-b414-989491e71568_5rqzxsfu Jul 31 10:59:11 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:11 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed Jul 31 10:59:11 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:11 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1693b487-a822-442c-b414-989491e71568_5rqzxsfu" returned: 1 in 0.425s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1693b487-a822-442c-b414-989491e71568_5rqzxsfu' failed. Not Retrying. {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 10:59:11 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8ffd96-7974-4c54-9c8a-af8a91c42030]: (4, 'raw') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1693b487-a822-442c-b414-989491e71568_5l7fe5kqdevstack@QuobyteHD {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:11 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-19691e8d-815d-439e-ac06-79817be148a2 tempest-CinderUnicodeTest-1615543778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158.e393c461-6963-4258-a458-8309975f5e96" returned: 0 in 0.478s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-19691e8d-815d-439e-ac06-79817be148a2 tempest-CinderUnicodeTest-1615543778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158.e393c461-6963-4258-a458-8309975f5e96 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:11 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158.e393c461-6963-4258-a458-8309975f5e96 Jul 31 10:59:11 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:11 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1693b487-a822-442c-b414-989491e71568_5l7fe5kqdevstack@QuobyteHD Jul 31 10:59:11 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:11 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed" returned: 0 in 0.509s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:11 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed {{(pid=89090) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 10:59:11 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Creating direct copy from snapshot {{(pid=89090) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 10:59:11 devstack cinder-volume[89090]: DEBUG cinder.utils [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Path /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-96a1e970-13d5-4c72-b458-51c1b6d69e90 not found in is_blk_device check {{(pid=89090) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 10:59:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-96a1e970-13d5-4c72-b458-51c1b6d69e90 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:11 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-96a1e970-13d5-4c72-b458-51c1b6d69e90 Jul 31 10:59:11 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:11 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-19691e8d-815d-439e-ac06-79817be148a2 tempest-CinderUnicodeTest-1615543778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158.e393c461-6963-4258-a458-8309975f5e96" returned: 0 in 0.330s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:11 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1693b487-a822-442c-b414-989491e71568_5l7fe5kqdevstack@QuobyteHD" returned: 0 in 0.479s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1693b487-a822-442c-b414-989491e71568_5l7fe5kqdevstack@QuobyteHD {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:12 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-19691e8d-815d-439e-ac06-79817be148a2 tempest-CinderUnicodeTest-1615543778 None] Lock "cinder-quobyte-e393c461-6963-4258-a458-8309975f5e96" released by "_delete_snapshot" :: held 1.897s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:12 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-19691e8d-815d-439e-ac06-79817be148a2 tempest-CinderUnicodeTest-1615543778 None] Lock "cinder-quobyte-ceaefb71-e739-40f4-8c57-56cf0a6c5158" released by "delete_snapshot" :: held 1.997s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:12 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-19691e8d-815d-439e-ac06-79817be148a2 tempest-CinderUnicodeTest-1615543778 None] Created reservations ['bc898109-8d25-4ae8-8d79-6c03c7368c3a', '326aa496-f2a6-4243-9545-3f4dd50c4739', '8ce7101f-7f4e-48b4-be20-258f2286847f', '9988f560-4e1e-482b-8d88-ee7bdfd14fa8'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:12 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1693b487-a822-442c-b414-989491e71568_5l7fe5kqdevstack@QuobyteHD Jul 31 10:59:12 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:12 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-19691e8d-815d-439e-ac06-79817be148a2 tempest-CinderUnicodeTest-1615543778 None] Delete snapshot completed successfully. Jul 31 10:59:12 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-19691e8d-815d-439e-ac06-79817be148a2 tempest-CinderUnicodeTest-1615543778 None] Lock "cinder-e393c461-6963-4258-a458-8309975f5e96-delete_snapshot" released by "delete_snapshot" :: held 2.232s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:12 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1693b487-a822-442c-b414-989491e71568_5l7fe5kqdevstack@QuobyteHD" returned: 1 in 0.457s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1693b487-a822-442c-b414-989491e71568_5l7fe5kqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 10:59:12 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] 1693b487-a822-442c-b414-989491e71568 was raw, converting to qcow2 {{(pid=89090) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 10:59:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1693b487-a822-442c-b414-989491e71568_5l7fe5kqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:12 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1693b487-a822-442c-b414-989491e71568_5l7fe5kqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85 Jul 31 10:59:12 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:13 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7a2124a0-2aae-455a-8000-ffa916ee03e0 tempest-CinderUnicodeTest-1615543778 None] Acquiring lock "cinder-ceaefb71-e739-40f4-8c57-56cf0a6c5158-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:13 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7a2124a0-2aae-455a-8000-ffa916ee03e0 tempest-CinderUnicodeTest-1615543778 None] Lock "cinder-ceaefb71-e739-40f4-8c57-56cf0a6c5158-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:13 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7a2124a0-2aae-455a-8000-ffa916ee03e0 tempest-CinderUnicodeTest-1615543778 None] Acquiring lock "cinder-quobyte-ceaefb71-e739-40f4-8c57-56cf0a6c5158" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:13 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7a2124a0-2aae-455a-8000-ffa916ee03e0 tempest-CinderUnicodeTest-1615543778 None] Lock "cinder-quobyte-ceaefb71-e739-40f4-8c57-56cf0a6c5158" acquired by "delete_volume" :: waited 0.035s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:13 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[533af51d-9fd8-4dd0-9a50-d8ae89f93cc2]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7a2124a0-2aae-455a-8000-ffa916ee03e0 tempest-CinderUnicodeTest-1615543778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:13 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1693b487-a822-442c-b414-989491e71568_5l7fe5kqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85" returned: 0 in 1.419s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:13 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1693b487-a822-442c-b414-989491e71568_5l7fe5kqdevstack@QuobyteHD, size 0.00 MB, duration 1.42 sec, destination /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85 {{(pid=89090) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 10:59:13 devstack cinder-volume[89090]: INFO cinder.image.image_utils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Converted 0.00 MB image at 0.00 MB/s Jul 31 10:59:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:14 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85 1G Jul 31 10:59:14 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:14 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158 Jul 31 10:59:14 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:14 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7a2124a0-2aae-455a-8000-ffa916ee03e0 tempest-CinderUnicodeTest-1615543778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158" returned: 0 in 1.250s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7a2124a0-2aae-455a-8000-ffa916ee03e0 tempest-CinderUnicodeTest-1615543778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:15 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158 Jul 31 10:59:15 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:15 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85 1G" returned: 0 in 1.312s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:15 devstack cinder-volume[89090]: DEBUG cinder.volume.volume_utils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Downloaded image 1693b487-a822-442c-b414-989491e71568 ((None, [{'url': 'file:///opt/stack/data/glance/images/1693b487-a822-442c-b414-989491e71568', 'metadata': {}}])) to volume f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85 successfully. {{(pid=89090) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 10:59:15 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Temporary image 1693b487-a822-442c-b414-989491e71568 for user 444b1244d44e4adbb642e35707c8dcce is deleted. {{(pid=89090) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 10:59:15 devstack cinder-volume[89090]: DEBUG cinder.volume.volume_utils [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Marking volume f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85 as bootable. {{(pid=89090) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 10:59:15 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Copying metadata from image 1693b487-a822-442c-b414-989491e71568 to f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85. {{(pid=89090) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 10:59:15 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Creating volume glance metadata for volume f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85 backed by image 1693b487-a822-442c-b414-989491e71568 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1693b487-a822-442c-b414-989491e71568', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd8bfacba73236574adb38c7c39e77b1e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89090) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 10:59:15 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256603b2-10fe-46f8-beef-1c75b479221f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85', 'volume_size': 1, 'image_id': '1693b487-a822-442c-b414-989491e71568', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1693b487-a822-442c-b414-989491e71568', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd8bfacba73236574adb38c7c39e77b1e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fc0cfb684f4a4bdca4c5b0e46c531139', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '293f03728134a15c720abbbf866a002615568fdf6739e20dd482c4db00c4e2dabcc98e888525d054e2278422dc2d343099b923f6d74b3223ab106562b3458c61', 'id': '1693b487-a822-442c-b414-989491e71568', 'created_at': datetime.datetime(2026, 7, 31, 8, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 59, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1693b487-a822-442c-b414-989491e71568/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:15 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e6e9af4-7791-480d-a7b8-c5e656ac5b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:15 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Volume volume-f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85 (f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85): created successfully Jul 31 10:59:15 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e6e9af4-7791-480d-a7b8-c5e656ac5b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:15 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Flow 'volume_create_manager' (099e5fa4-4460-4bd5-ba0d-e1d042ae13d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:15 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-fb77e11e-e54b-4555-85ec-3e9b49451c31 tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Created volume successfully. Jul 31 10:59:15 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7a2124a0-2aae-455a-8000-ffa916ee03e0 tempest-CinderUnicodeTest-1615543778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-ceaefb71-e739-40f4-8c57-56cf0a6c5158" returned: 0 in 1.001s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:16 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7a2124a0-2aae-455a-8000-ffa916ee03e0 tempest-CinderUnicodeTest-1615543778 None] Lock "cinder-quobyte-ceaefb71-e739-40f4-8c57-56cf0a6c5158" released by "delete_volume" :: held 2.425s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:16 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-7a2124a0-2aae-455a-8000-ffa916ee03e0 tempest-CinderUnicodeTest-1615543778 None] Created reservations ['ac1a5c3b-2c0d-4450-8ac2-f656606ddfee', '16922657-ffdd-4b88-a3b8-cb89a003a9c7', 'd3c16d76-1ea0-4fe8-a418-f09fc76d0d39', '26c4b4fa-6ce7-4ad2-8b3d-735fe3ec4dd0'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7a2124a0-2aae-455a-8000-ffa916ee03e0 tempest-CinderUnicodeTest-1615543778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7a2124a0-2aae-455a-8000-ffa916ee03e0 tempest-CinderUnicodeTest-1615543778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:16 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-7a2124a0-2aae-455a-8000-ffa916ee03e0 tempest-CinderUnicodeTest-1615543778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:16 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-7a2124a0-2aae-455a-8000-ffa916ee03e0 tempest-CinderUnicodeTest-1615543778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7a2124a0-2aae-455a-8000-ffa916ee03e0 tempest-CinderUnicodeTest-1615543778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7a2124a0-2aae-455a-8000-ffa916ee03e0 tempest-CinderUnicodeTest-1615543778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:16 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:59:16 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:16 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-716daafc-4310-4212-a57e-931293a7690c tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Acquiring lock "cinder-f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:16 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-716daafc-4310-4212-a57e-931293a7690c tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Lock "cinder-f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:16 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-716daafc-4310-4212-a57e-931293a7690c tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Acquiring lock "cinder-quobyte-f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:16 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-716daafc-4310-4212-a57e-931293a7690c tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Lock "cinder-quobyte-f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85" acquired by "delete_volume" :: waited 0.032s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:16 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7a2124a0-2aae-455a-8000-ffa916ee03e0 tempest-CinderUnicodeTest-1615543778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.651s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:16 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-7a2124a0-2aae-455a-8000-ffa916ee03e0 tempest-CinderUnicodeTest-1615543778 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:16 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-7a2124a0-2aae-455a-8000-ffa916ee03e0 tempest-CinderUnicodeTest-1615543778 None] Deleted volume successfully. Jul 31 10:59:16 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fff738-4069-4244-85b6-31e690e3a84a]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-716daafc-4310-4212-a57e-931293a7690c tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:17 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7a2124a0-2aae-455a-8000-ffa916ee03e0 tempest-CinderUnicodeTest-1615543778 None] Lock "cinder-ceaefb71-e739-40f4-8c57-56cf0a6c5158-delete_volume" released by "delete_volume" :: held 3.659s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:17 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e01b6edd-aa75-4679-8706-258cbd259029 tempest-CinderUnicodeTest-1615543778 None] Acquiring lock "cinder-b43b3150-921d-4275-a798-c9571ab7c961-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:17 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e01b6edd-aa75-4679-8706-258cbd259029 tempest-CinderUnicodeTest-1615543778 None] Lock "cinder-b43b3150-921d-4275-a798-c9571ab7c961-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:17 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85 Jul 31 10:59:17 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:17 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e01b6edd-aa75-4679-8706-258cbd259029 tempest-CinderUnicodeTest-1615543778 None] Acquiring lock "cinder-quobyte-b43b3150-921d-4275-a798-c9571ab7c961" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:17 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e01b6edd-aa75-4679-8706-258cbd259029 tempest-CinderUnicodeTest-1615543778 None] Lock "cinder-quobyte-b43b3150-921d-4275-a798-c9571ab7c961" acquired by "delete_volume" :: waited 0.052s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:17 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d55710-581e-48fb-8576-288249b4c1e2]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e01b6edd-aa75-4679-8706-258cbd259029 tempest-CinderUnicodeTest-1615543778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b43b3150-921d-4275-a798-c9571ab7c961 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:17 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b43b3150-921d-4275-a798-c9571ab7c961 Jul 31 10:59:17 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:17 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-716daafc-4310-4212-a57e-931293a7690c tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85" returned: 0 in 0.796s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-716daafc-4310-4212-a57e-931293a7690c tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:17 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-96a1e970-13d5-4c72-b458-51c1b6d69e90" returned: 0 in 6.064s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:17 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Image conversion details: src /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed, size 1024.00 MB, duration 6.07 sec, destination /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-96a1e970-13d5-4c72-b458-51c1b6d69e90 {{(pid=89090) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 10:59:17 devstack cinder-volume[89090]: INFO cinder.image.image_utils [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Converted 1024.00 MB image at 168.83 MB/s Jul 31 10:59:17 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-96a1e970-13d5-4c72-b458-51c1b6d69e90 is being set with open permissions: ugo+rw Jul 31 10:59:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-96a1e970-13d5-4c72-b458-51c1b6d69e90 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:17 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85 Jul 31 10:59:17 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:17 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-96a1e970-13d5-4c72-b458-51c1b6d69e90 Jul 31 10:59:17 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:18 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e01b6edd-aa75-4679-8706-258cbd259029 tempest-CinderUnicodeTest-1615543778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b43b3150-921d-4275-a798-c9571ab7c961" returned: 0 in 0.632s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e01b6edd-aa75-4679-8706-258cbd259029 tempest-CinderUnicodeTest-1615543778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b43b3150-921d-4275-a798-c9571ab7c961 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:18 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b43b3150-921d-4275-a798-c9571ab7c961 Jul 31 10:59:18 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:18 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-716daafc-4310-4212-a57e-931293a7690c tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85" returned: 0 in 0.309s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-716daafc-4310-4212-a57e-931293a7690c tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Lock "cinder-quobyte-f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85" released by "delete_volume" :: held 1.248s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:18 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-96a1e970-13d5-4c72-b458-51c1b6d69e90" returned: 0 in 0.317s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Lock "cinder-quobyte-96a1e970-13d5-4c72-b458-51c1b6d69e90" released by "_copy_volume_from_snapshot" :: held 7.554s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-716daafc-4310-4212-a57e-931293a7690c tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Created reservations ['ea00b55d-d380-4549-aea6-a1bba5ac2c2c', '007cf856-0652-404f-8abb-a3fed0a28a4e', '2db551b3-f4e7-4b70-a3fb-8cbacd2696cc', 'a9bfde3c-f92b-46ba-a70e-015518a8b193'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Lock "cinder-quobyte-217d23c2-136c-4da8-9ee0-5c6ddf94138b-96a1e970-13d5-4c72-b458-51c1b6d69e90" released by "_create_volume_from_snapshot" :: held 7.673s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.703s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-22b76e2a-d39a-4c55-85b8-bd09752d4dd7 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.937s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-22b76e2a-d39a-4c55-85b8-bd09752d4dd7 tempest-CreateVolumesFromSnapshotTest-1817441323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2018545610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75b25500-4229-4607-bc86-4c0994ea71c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a9a3b6d04894d22961e068f6c11eed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:08Z,use_quota=True,user_id='adf38e0705a04186a1c094f28d618fc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-22b76e2a-d39a-4c55-85b8-bd09752d4dd7 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Creating volume 75b25500-4229-4607-bc86-4c0994ea71c7 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-22b76e2a-d39a-4c55-85b8-bd09752d4dd7 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-22b76e2a-d39a-4c55-85b8-bd09752d4dd7 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-22b76e2a-d39a-4c55-85b8-bd09752d4dd7 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-22b76e2a-d39a-4c55-85b8-bd09752d4dd7 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-22b76e2a-d39a-4c55-85b8-bd09752d4dd7 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-22b76e2a-d39a-4c55-85b8-bd09752d4dd7 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:59:18 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-22b76e2a-d39a-4c55-85b8-bd09752d4dd7 tempest-CreateVolumesFromSnapshotTest-1817441323 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-22b76e2a-d39a-4c55-85b8-bd09752d4dd7 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-75b25500-4229-4607-bc86-4c0994ea71c7 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:18 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-75b25500-4229-4607-bc86-4c0994ea71c7 1073741824 Jul 31 10:59:18 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e77dea7b-dffa-42d9-9d09-90ff8c9e96ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96a1e970-13d5-4c72-b458-51c1b6d69e90', 'volume_size': 1, 'snapshot_id': '217d23c2-136c-4da8-9ee0-5c6ddf94138b'}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d60883ca-d4d2-4b03-a374-e7c2ca2b092f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:18 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Volume volume-96a1e970-13d5-4c72-b458-51c1b6d69e90 (96a1e970-13d5-4c72-b458-51c1b6d69e90): created successfully Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d60883ca-d4d2-4b03-a374-e7c2ca2b092f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Flow 'volume_create_manager' (4ceb7a9b-cd50-4fb4-bdf8-e0eafa6dc027) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-716daafc-4310-4212-a57e-931293a7690c tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-716daafc-4310-4212-a57e-931293a7690c tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-716daafc-4310-4212-a57e-931293a7690c tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-716daafc-4310-4212-a57e-931293a7690c tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-716daafc-4310-4212-a57e-931293a7690c tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-716daafc-4310-4212-a57e-931293a7690c tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:18 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-4ddf504b-0263-4d05-8c8b-18a3baf59f5b tempest-VolumeDependencyTests-1531137417 None] Created volume successfully. Jul 31 10:59:18 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e01b6edd-aa75-4679-8706-258cbd259029 tempest-CinderUnicodeTest-1615543778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b43b3150-921d-4275-a798-c9571ab7c961" returned: 0 in 0.379s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:18 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:59:18 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e01b6edd-aa75-4679-8706-258cbd259029 tempest-CinderUnicodeTest-1615543778 None] Lock "cinder-quobyte-b43b3150-921d-4275-a798-c9571ab7c961" released by "delete_volume" :: held 1.092s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-e01b6edd-aa75-4679-8706-258cbd259029 tempest-CinderUnicodeTest-1615543778 None] Created reservations ['d7a167b0-bc1a-4632-988f-3c17a33bd307', 'f510b79c-89f2-4771-a399-e10925370894', '01342b28-6dcc-4841-b6ee-19e7337712fc', '3c84f662-db12-4c24-96f1-55845d79d881'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e01b6edd-aa75-4679-8706-258cbd259029 tempest-CinderUnicodeTest-1615543778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e01b6edd-aa75-4679-8706-258cbd259029 tempest-CinderUnicodeTest-1615543778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-e01b6edd-aa75-4679-8706-258cbd259029 tempest-CinderUnicodeTest-1615543778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-e01b6edd-aa75-4679-8706-258cbd259029 tempest-CinderUnicodeTest-1615543778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e01b6edd-aa75-4679-8706-258cbd259029 tempest-CinderUnicodeTest-1615543778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e01b6edd-aa75-4679-8706-258cbd259029 tempest-CinderUnicodeTest-1615543778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:18 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:59:18 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:18 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-716daafc-4310-4212-a57e-931293a7690c tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.325s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-716daafc-4310-4212-a57e-931293a7690c tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:18 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-716daafc-4310-4212-a57e-931293a7690c tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Deleted volume successfully. Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-716daafc-4310-4212-a57e-931293a7690c tempest-VolumeAndVolumeTypeFromImageTest-607594076 None] Lock "cinder-f771eb4c-5ff2-4ce7-aeb1-cb481f32bf85-delete_volume" released by "delete_volume" :: held 1.990s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:18 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-22b76e2a-d39a-4c55-85b8-bd09752d4dd7 tempest-CreateVolumesFromSnapshotTest-1817441323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-75b25500-4229-4607-bc86-4c0994ea71c7 1073741824" returned: 0 in 0.596s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:18 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e01b6edd-aa75-4679-8706-258cbd259029 tempest-CinderUnicodeTest-1615543778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.296s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-e01b6edd-aa75-4679-8706-258cbd259029 tempest-CinderUnicodeTest-1615543778 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-22b76e2a-d39a-4c55-85b8-bd09752d4dd7 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-75b25500-4229-4607-bc86-4c0994ea71c7 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:18 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-e01b6edd-aa75-4679-8706-258cbd259029 tempest-CinderUnicodeTest-1615543778 None] Deleted volume successfully. Jul 31 10:59:18 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-75b25500-4229-4607-bc86-4c0994ea71c7 Jul 31 10:59:18 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:18 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e01b6edd-aa75-4679-8706-258cbd259029 tempest-CinderUnicodeTest-1615543778 None] Lock "cinder-b43b3150-921d-4275-a798-c9571ab7c961-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:19 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1fffbcea-ff60-4af7-8ea7-d7430db647d0 tempest-VolumeDependencyTests-1531137417 None] Acquiring lock "cinder-217d23c2-136c-4da8-9ee0-5c6ddf94138b-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:19 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1fffbcea-ff60-4af7-8ea7-d7430db647d0 tempest-VolumeDependencyTests-1531137417 None] Lock "cinder-217d23c2-136c-4da8-9ee0-5c6ddf94138b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:19 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1fffbcea-ff60-4af7-8ea7-d7430db647d0 tempest-VolumeDependencyTests-1531137417 None] Acquiring lock "cinder-quobyte-5b735d01-5740-4d5d-a242-4c1b861117ed" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:19 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1fffbcea-ff60-4af7-8ea7-d7430db647d0 tempest-VolumeDependencyTests-1531137417 None] Lock "cinder-quobyte-5b735d01-5740-4d5d-a242-4c1b861117ed" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:19 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1fffbcea-ff60-4af7-8ea7-d7430db647d0 tempest-VolumeDependencyTests-1531137417 None] Acquiring lock "cinder-quobyte-217d23c2-136c-4da8-9ee0-5c6ddf94138b" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:19 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1fffbcea-ff60-4af7-8ea7-d7430db647d0 tempest-VolumeDependencyTests-1531137417 None] Lock "cinder-quobyte-217d23c2-136c-4da8-9ee0-5c6ddf94138b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:19 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-1fffbcea-ff60-4af7-8ea7-d7430db647d0 tempest-VolumeDependencyTests-1531137417 None] Deleting offline snapshot 217d23c2-136c-4da8-9ee0-5c6ddf94138b of volume 5b735d01-5740-4d5d-a242-4c1b861117ed {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:59:19 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-1fffbcea-ff60-4af7-8ea7-d7430db647d0 tempest-VolumeDependencyTests-1531137417 None] snapshot_file for this snap is: volume-5b735d01-5740-4d5d-a242-4c1b861117ed.217d23c2-136c-4da8-9ee0-5c6ddf94138b {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:59:19 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0b1bca-2660-4ee7-9323-0bd5a210be21]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1fffbcea-ff60-4af7-8ea7-d7430db647d0 tempest-VolumeDependencyTests-1531137417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed.217d23c2-136c-4da8-9ee0-5c6ddf94138b {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:19 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-22b76e2a-d39a-4c55-85b8-bd09752d4dd7 tempest-CreateVolumesFromSnapshotTest-1817441323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-75b25500-4229-4607-bc86-4c0994ea71c7" returned: 0 in 0.330s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:19 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-22b76e2a-d39a-4c55-85b8-bd09752d4dd7 tempest-CreateVolumesFromSnapshotTest-1817441323 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-22b76e2a-d39a-4c55-85b8-bd09752d4dd7 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9d40e33a-f234-40c9-a012-eb6179f7d6b4 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.489s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:19 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-9d40e33a-f234-40c9-a012-eb6179f7d6b4 tempest-CreateVolumesFromSnapshotTest-1817441323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-172192949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2f19dcc-8503-4f55-ae7c-f44869c03ec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a9a3b6d04894d22961e068f6c11eed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:09Z,use_quota=True,user_id='adf38e0705a04186a1c094f28d618fc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:19 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-9d40e33a-f234-40c9-a012-eb6179f7d6b4 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Creating volume d2f19dcc-8503-4f55-ae7c-f44869c03ec5 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9d40e33a-f234-40c9-a012-eb6179f7d6b4 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9d40e33a-f234-40c9-a012-eb6179f7d6b4 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:19 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-9d40e33a-f234-40c9-a012-eb6179f7d6b4 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:19 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-9d40e33a-f234-40c9-a012-eb6179f7d6b4 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9d40e33a-f234-40c9-a012-eb6179f7d6b4 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:19 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-9d40e33a-f234-40c9-a012-eb6179f7d6b4 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:59:19 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-9d40e33a-f234-40c9-a012-eb6179f7d6b4 tempest-CreateVolumesFromSnapshotTest-1817441323 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:59:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9d40e33a-f234-40c9-a012-eb6179f7d6b4 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d2f19dcc-8503-4f55-ae7c-f44869c03ec5 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:19 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-22b76e2a-d39a-4c55-85b8-bd09752d4dd7 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f908f2-0dfd-4994-a2c0-cc421f21a568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75b25500-4229-4607-bc86-4c0994ea71c7', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:19 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d2f19dcc-8503-4f55-ae7c-f44869c03ec5 1073741824 Jul 31 10:59:19 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:19 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-22b76e2a-d39a-4c55-85b8-bd09752d4dd7 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe05e52e-eef4-4070-b7d9-a6962308bfa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:19 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-22b76e2a-d39a-4c55-85b8-bd09752d4dd7 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Volume volume-75b25500-4229-4607-bc86-4c0994ea71c7 (75b25500-4229-4607-bc86-4c0994ea71c7): created successfully Jul 31 10:59:19 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-22b76e2a-d39a-4c55-85b8-bd09752d4dd7 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe05e52e-eef4-4070-b7d9-a6962308bfa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:19 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-22b76e2a-d39a-4c55-85b8-bd09752d4dd7 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Flow 'volume_create_manager' (3b9e3909-5927-4f6c-999f-33af60712acb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:19 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed.217d23c2-136c-4da8-9ee0-5c6ddf94138b Jul 31 10:59:19 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:19 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-22b76e2a-d39a-4c55-85b8-bd09752d4dd7 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Created volume successfully. Jul 31 10:59:19 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1fffbcea-ff60-4af7-8ea7-d7430db647d0 tempest-VolumeDependencyTests-1531137417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed.217d23c2-136c-4da8-9ee0-5c6ddf94138b" returned: 0 in 0.547s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:19 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-1fffbcea-ff60-4af7-8ea7-d7430db647d0 tempest-VolumeDependencyTests-1531137417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b735d01-5740-4d5d-a242-4c1b861117ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:59:19 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2909527-cf61-44ba-9b0a-03e71696f751]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1fffbcea-ff60-4af7-8ea7-d7430db647d0 tempest-VolumeDependencyTests-1531137417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:19 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9d40e33a-f234-40c9-a012-eb6179f7d6b4 tempest-CreateVolumesFromSnapshotTest-1817441323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d2f19dcc-8503-4f55-ae7c-f44869c03ec5 1073741824" returned: 0 in 0.639s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:19 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed Jul 31 10:59:19 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9d40e33a-f234-40c9-a012-eb6179f7d6b4 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d2f19dcc-8503-4f55-ae7c-f44869c03ec5 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:19 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d2f19dcc-8503-4f55-ae7c-f44869c03ec5 Jul 31 10:59:19 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:20 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9d40e33a-f234-40c9-a012-eb6179f7d6b4 tempest-CreateVolumesFromSnapshotTest-1817441323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d2f19dcc-8503-4f55-ae7c-f44869c03ec5" returned: 0 in 0.429s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:20 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-9d40e33a-f234-40c9-a012-eb6179f7d6b4 tempest-CreateVolumesFromSnapshotTest-1817441323 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9d40e33a-f234-40c9-a012-eb6179f7d6b4 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3ce0211a-eb6d-4c5d-b16f-3e3e2873c3b8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.201s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:20 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-3ce0211a-eb6d-4c5d-b16f-3e3e2873c3b8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1153569207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5621e381-9640-4bc6-b701-f8d98e794ba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a9a3b6d04894d22961e068f6c11eed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:09Z,use_quota=True,user_id='adf38e0705a04186a1c094f28d618fc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:20 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-3ce0211a-eb6d-4c5d-b16f-3e3e2873c3b8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Creating volume 5621e381-9640-4bc6-b701-f8d98e794ba7 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3ce0211a-eb6d-4c5d-b16f-3e3e2873c3b8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3ce0211a-eb6d-4c5d-b16f-3e3e2873c3b8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:20 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-3ce0211a-eb6d-4c5d-b16f-3e3e2873c3b8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:20 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-3ce0211a-eb6d-4c5d-b16f-3e3e2873c3b8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3ce0211a-eb6d-4c5d-b16f-3e3e2873c3b8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:20 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-3ce0211a-eb6d-4c5d-b16f-3e3e2873c3b8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:59:20 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-3ce0211a-eb6d-4c5d-b16f-3e3e2873c3b8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:59:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3ce0211a-eb6d-4c5d-b16f-3e3e2873c3b8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5621e381-9640-4bc6-b701-f8d98e794ba7 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:20 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9d40e33a-f234-40c9-a012-eb6179f7d6b4 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95802a51-5bfd-4fde-86cc-5279fc401ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2f19dcc-8503-4f55-ae7c-f44869c03ec5', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:20 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9d40e33a-f234-40c9-a012-eb6179f7d6b4 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8ee2464-ab94-4e75-9e21-866201c77e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:20 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5621e381-9640-4bc6-b701-f8d98e794ba7 1073741824 Jul 31 10:59:20 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:20 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-9d40e33a-f234-40c9-a012-eb6179f7d6b4 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Volume volume-d2f19dcc-8503-4f55-ae7c-f44869c03ec5 (d2f19dcc-8503-4f55-ae7c-f44869c03ec5): created successfully Jul 31 10:59:20 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9d40e33a-f234-40c9-a012-eb6179f7d6b4 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8ee2464-ab94-4e75-9e21-866201c77e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:20 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-9d40e33a-f234-40c9-a012-eb6179f7d6b4 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Flow 'volume_create_manager' (dc9e814b-b93b-452c-9119-86eff19d31e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:20 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-9d40e33a-f234-40c9-a012-eb6179f7d6b4 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Created volume successfully. Jul 31 10:59:20 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1fffbcea-ff60-4af7-8ea7-d7430db647d0 tempest-VolumeDependencyTests-1531137417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed" returned: 0 in 0.847s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1fffbcea-ff60-4af7-8ea7-d7430db647d0 tempest-VolumeDependencyTests-1531137417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed.217d23c2-136c-4da8-9ee0-5c6ddf94138b {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:20 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed.217d23c2-136c-4da8-9ee0-5c6ddf94138b Jul 31 10:59:20 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:21 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3ce0211a-eb6d-4c5d-b16f-3e3e2873c3b8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5621e381-9640-4bc6-b701-f8d98e794ba7 1073741824" returned: 0 in 0.686s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:21 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1fffbcea-ff60-4af7-8ea7-d7430db647d0 tempest-VolumeDependencyTests-1531137417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed.217d23c2-136c-4da8-9ee0-5c6ddf94138b" returned: 0 in 0.528s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1fffbcea-ff60-4af7-8ea7-d7430db647d0 tempest-VolumeDependencyTests-1531137417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed.217d23c2-136c-4da8-9ee0-5c6ddf94138b {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:21 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed.217d23c2-136c-4da8-9ee0-5c6ddf94138b Jul 31 10:59:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3ce0211a-eb6d-4c5d-b16f-3e3e2873c3b8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5621e381-9640-4bc6-b701-f8d98e794ba7 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:21 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:21 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5621e381-9640-4bc6-b701-f8d98e794ba7 Jul 31 10:59:21 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:21 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:21 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3ce0211a-eb6d-4c5d-b16f-3e3e2873c3b8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5621e381-9640-4bc6-b701-f8d98e794ba7" returned: 0 in 0.439s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:21 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-3ce0211a-eb6d-4c5d-b16f-3e3e2873c3b8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] <== create_volume: return (1266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3ce0211a-eb6d-4c5d-b16f-3e3e2873c3b8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4c9bc3bf-6c50-4ea0-bcab-e72e0a6e63e8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.969s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:21 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4c9bc3bf-6c50-4ea0-bcab-e72e0a6e63e8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-571639549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd166c4d-6dee-4405-9072-178beef05425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a9a3b6d04894d22961e068f6c11eed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:09Z,use_quota=True,user_id='adf38e0705a04186a1c094f28d618fc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:21 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-4c9bc3bf-6c50-4ea0-bcab-e72e0a6e63e8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Creating volume cd166c4d-6dee-4405-9072-178beef05425 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4c9bc3bf-6c50-4ea0-bcab-e72e0a6e63e8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4c9bc3bf-6c50-4ea0-bcab-e72e0a6e63e8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:21 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4c9bc3bf-6c50-4ea0-bcab-e72e0a6e63e8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:21 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4c9bc3bf-6c50-4ea0-bcab-e72e0a6e63e8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4c9bc3bf-6c50-4ea0-bcab-e72e0a6e63e8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:21 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4c9bc3bf-6c50-4ea0-bcab-e72e0a6e63e8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:59:21 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-4c9bc3bf-6c50-4ea0-bcab-e72e0a6e63e8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:59:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4c9bc3bf-6c50-4ea0-bcab-e72e0a6e63e8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cd166c4d-6dee-4405-9072-178beef05425 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1fffbcea-ff60-4af7-8ea7-d7430db647d0 tempest-VolumeDependencyTests-1531137417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed.217d23c2-136c-4da8-9ee0-5c6ddf94138b" returned: 0 in 0.536s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:21 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cd166c4d-6dee-4405-9072-178beef05425 1073741824 Jul 31 10:59:21 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:21 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3ce0211a-eb6d-4c5d-b16f-3e3e2873c3b8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18b8f0bd-4912-49a6-a733-7cd8525bad33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5621e381-9640-4bc6-b701-f8d98e794ba7', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:21 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3ce0211a-eb6d-4c5d-b16f-3e3e2873c3b8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a45f391c-947e-4f82-801b-1c478c6d230b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:21 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1fffbcea-ff60-4af7-8ea7-d7430db647d0 tempest-VolumeDependencyTests-1531137417 None] Lock "cinder-quobyte-217d23c2-136c-4da8-9ee0-5c6ddf94138b" released by "_delete_snapshot" :: held 2.686s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:21 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-3ce0211a-eb6d-4c5d-b16f-3e3e2873c3b8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Volume volume-5621e381-9640-4bc6-b701-f8d98e794ba7 (5621e381-9640-4bc6-b701-f8d98e794ba7): created successfully Jul 31 10:59:21 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3ce0211a-eb6d-4c5d-b16f-3e3e2873c3b8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a45f391c-947e-4f82-801b-1c478c6d230b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:21 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-3ce0211a-eb6d-4c5d-b16f-3e3e2873c3b8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Flow 'volume_create_manager' (7752764d-d727-4c85-b227-4b89a7ec0e40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:21 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1fffbcea-ff60-4af7-8ea7-d7430db647d0 tempest-VolumeDependencyTests-1531137417 None] Lock "cinder-quobyte-5b735d01-5740-4d5d-a242-4c1b861117ed" released by "delete_snapshot" :: held 2.736s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:21 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-3ce0211a-eb6d-4c5d-b16f-3e3e2873c3b8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Created volume successfully. Jul 31 10:59:21 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-1fffbcea-ff60-4af7-8ea7-d7430db647d0 tempest-VolumeDependencyTests-1531137417 None] Created reservations ['846da878-1b40-48b4-b2f3-a9d25e08db5c', '79f28cbb-55b3-4629-ab73-e3b54ab5c030', 'c218edab-9d6b-4a09-951e-e87a4b63ed72', '7d2ad773-ad21-47b4-b678-7d4bd434913c'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:22 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-1fffbcea-ff60-4af7-8ea7-d7430db647d0 tempest-VolumeDependencyTests-1531137417 None] Delete snapshot completed successfully. Jul 31 10:59:22 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1fffbcea-ff60-4af7-8ea7-d7430db647d0 tempest-VolumeDependencyTests-1531137417 None] Lock "cinder-217d23c2-136c-4da8-9ee0-5c6ddf94138b-delete_snapshot" released by "delete_snapshot" :: held 3.004s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:22 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-677fc643-4a32-4392-a412-51e9d2bab1f1 tempest-VolumeDependencyTests-1531137417 None] Acquiring lock "cinder-5b735d01-5740-4d5d-a242-4c1b861117ed-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:22 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-677fc643-4a32-4392-a412-51e9d2bab1f1 tempest-VolumeDependencyTests-1531137417 None] Lock "cinder-5b735d01-5740-4d5d-a242-4c1b861117ed-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:22 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4c9bc3bf-6c50-4ea0-bcab-e72e0a6e63e8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cd166c4d-6dee-4405-9072-178beef05425 1073741824" returned: 0 in 0.760s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:22 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-677fc643-4a32-4392-a412-51e9d2bab1f1 tempest-VolumeDependencyTests-1531137417 None] Acquiring lock "cinder-quobyte-5b735d01-5740-4d5d-a242-4c1b861117ed" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4c9bc3bf-6c50-4ea0-bcab-e72e0a6e63e8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cd166c4d-6dee-4405-9072-178beef05425 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:22 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-677fc643-4a32-4392-a412-51e9d2bab1f1 tempest-VolumeDependencyTests-1531137417 None] Lock "cinder-quobyte-5b735d01-5740-4d5d-a242-4c1b861117ed" acquired by "delete_volume" :: waited 0.043s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:22 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cd166c4d-6dee-4405-9072-178beef05425 Jul 31 10:59:22 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:22 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[f345a219-e853-4986-8ecd-a2980e732107]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-677fc643-4a32-4392-a412-51e9d2bab1f1 tempest-VolumeDependencyTests-1531137417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:22 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed Jul 31 10:59:22 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:22 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4c9bc3bf-6c50-4ea0-bcab-e72e0a6e63e8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cd166c4d-6dee-4405-9072-178beef05425" returned: 0 in 0.338s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:22 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4c9bc3bf-6c50-4ea0-bcab-e72e0a6e63e8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4c9bc3bf-6c50-4ea0-bcab-e72e0a6e63e8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-57cb7617-ce41-449d-baba-2c5923d9c01e tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.746s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:22 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-57cb7617-ce41-449d-baba-2c5923d9c01e tempest-CreateVolumesFromSnapshotTest-1817441323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-323618713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66757784-ecdd-4d8a-9a14-deb526176a17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a9a3b6d04894d22961e068f6c11eed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:10Z,use_quota=True,user_id='adf38e0705a04186a1c094f28d618fc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:22 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-57cb7617-ce41-449d-baba-2c5923d9c01e tempest-CreateVolumesFromSnapshotTest-1817441323 None] Creating volume 66757784-ecdd-4d8a-9a14-deb526176a17 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-57cb7617-ce41-449d-baba-2c5923d9c01e tempest-CreateVolumesFromSnapshotTest-1817441323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-57cb7617-ce41-449d-baba-2c5923d9c01e tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:22 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-57cb7617-ce41-449d-baba-2c5923d9c01e tempest-CreateVolumesFromSnapshotTest-1817441323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:22 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-57cb7617-ce41-449d-baba-2c5923d9c01e tempest-CreateVolumesFromSnapshotTest-1817441323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-57cb7617-ce41-449d-baba-2c5923d9c01e tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:22 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-57cb7617-ce41-449d-baba-2c5923d9c01e tempest-CreateVolumesFromSnapshotTest-1817441323 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:59:22 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-57cb7617-ce41-449d-baba-2c5923d9c01e tempest-CreateVolumesFromSnapshotTest-1817441323 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:59:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-57cb7617-ce41-449d-baba-2c5923d9c01e tempest-CreateVolumesFromSnapshotTest-1817441323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-66757784-ecdd-4d8a-9a14-deb526176a17 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4c9bc3bf-6c50-4ea0-bcab-e72e0a6e63e8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b75c1d9b-8ad7-4e56-9cf5-3ab75ce961e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd166c4d-6dee-4405-9072-178beef05425', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4c9bc3bf-6c50-4ea0-bcab-e72e0a6e63e8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f46e34-7474-4f49-bbc4-3247707791ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:22 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-66757784-ecdd-4d8a-9a14-deb526176a17 1073741824 Jul 31 10:59:22 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:22 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-4c9bc3bf-6c50-4ea0-bcab-e72e0a6e63e8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Volume volume-cd166c4d-6dee-4405-9072-178beef05425 (cd166c4d-6dee-4405-9072-178beef05425): created successfully Jul 31 10:59:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4c9bc3bf-6c50-4ea0-bcab-e72e0a6e63e8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f46e34-7474-4f49-bbc4-3247707791ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4c9bc3bf-6c50-4ea0-bcab-e72e0a6e63e8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Flow 'volume_create_manager' (abf5562b-6ad6-4dcb-9413-377ce15f1946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:22 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-4c9bc3bf-6c50-4ea0-bcab-e72e0a6e63e8 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Created volume successfully. Jul 31 10:59:23 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-677fc643-4a32-4392-a412-51e9d2bab1f1 tempest-VolumeDependencyTests-1531137417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed" returned: 0 in 0.646s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-677fc643-4a32-4392-a412-51e9d2bab1f1 tempest-VolumeDependencyTests-1531137417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:23 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed Jul 31 10:59:23 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:23 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-677fc643-4a32-4392-a412-51e9d2bab1f1 tempest-VolumeDependencyTests-1531137417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5b735d01-5740-4d5d-a242-4c1b861117ed" returned: 0 in 0.323s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:23 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-677fc643-4a32-4392-a412-51e9d2bab1f1 tempest-VolumeDependencyTests-1531137417 None] Lock "cinder-quobyte-5b735d01-5740-4d5d-a242-4c1b861117ed" released by "delete_volume" :: held 1.075s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:23 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-57cb7617-ce41-449d-baba-2c5923d9c01e tempest-CreateVolumesFromSnapshotTest-1817441323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-66757784-ecdd-4d8a-9a14-deb526176a17 1073741824" returned: 0 in 0.781s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-57cb7617-ce41-449d-baba-2c5923d9c01e tempest-CreateVolumesFromSnapshotTest-1817441323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-66757784-ecdd-4d8a-9a14-deb526176a17 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:23 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-677fc643-4a32-4392-a412-51e9d2bab1f1 tempest-VolumeDependencyTests-1531137417 None] Created reservations ['a41a6463-3b20-41ab-b031-7bc373438673', '85911da3-feaa-46fe-bc7f-ebdda96e803d', '7532bb50-88c2-4e0a-9690-9751b7d228bd', '13f741cd-40c5-4178-b3b1-c6fc5b263dda'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:23 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-66757784-ecdd-4d8a-9a14-deb526176a17 Jul 31 10:59:23 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-677fc643-4a32-4392-a412-51e9d2bab1f1 tempest-VolumeDependencyTests-1531137417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-677fc643-4a32-4392-a412-51e9d2bab1f1 tempest-VolumeDependencyTests-1531137417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:23 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-677fc643-4a32-4392-a412-51e9d2bab1f1 tempest-VolumeDependencyTests-1531137417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:23 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-677fc643-4a32-4392-a412-51e9d2bab1f1 tempest-VolumeDependencyTests-1531137417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-677fc643-4a32-4392-a412-51e9d2bab1f1 tempest-VolumeDependencyTests-1531137417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-677fc643-4a32-4392-a412-51e9d2bab1f1 tempest-VolumeDependencyTests-1531137417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:23 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:59:23 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:24 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-57cb7617-ce41-449d-baba-2c5923d9c01e tempest-CreateVolumesFromSnapshotTest-1817441323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-66757784-ecdd-4d8a-9a14-deb526176a17" returned: 0 in 0.431s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:24 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-57cb7617-ce41-449d-baba-2c5923d9c01e tempest-CreateVolumesFromSnapshotTest-1817441323 None] <== create_volume: return (1315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-57cb7617-ce41-449d-baba-2c5923d9c01e tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:24 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-57cb7617-ce41-449d-baba-2c5923d9c01e tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0060e3b8-de86-48ee-b6eb-59d02b2688c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66757784-ecdd-4d8a-9a14-deb526176a17', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:24 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-57cb7617-ce41-449d-baba-2c5923d9c01e tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53ed7839-4bc7-447d-acc7-9894ec25e9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:24 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-57cb7617-ce41-449d-baba-2c5923d9c01e tempest-CreateVolumesFromSnapshotTest-1817441323 None] Volume volume-66757784-ecdd-4d8a-9a14-deb526176a17 (66757784-ecdd-4d8a-9a14-deb526176a17): created successfully Jul 31 10:59:24 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-57cb7617-ce41-449d-baba-2c5923d9c01e tempest-CreateVolumesFromSnapshotTest-1817441323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53ed7839-4bc7-447d-acc7-9894ec25e9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:24 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-57cb7617-ce41-449d-baba-2c5923d9c01e tempest-CreateVolumesFromSnapshotTest-1817441323 None] Flow 'volume_create_manager' (a1e09d81-c301-4379-be14-dd422fc82e14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:24 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-677fc643-4a32-4392-a412-51e9d2bab1f1 tempest-VolumeDependencyTests-1531137417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.337s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:24 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-677fc643-4a32-4392-a412-51e9d2bab1f1 tempest-VolumeDependencyTests-1531137417 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:24 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-677fc643-4a32-4392-a412-51e9d2bab1f1 tempest-VolumeDependencyTests-1531137417 None] Deleted volume successfully. Jul 31 10:59:24 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-57cb7617-ce41-449d-baba-2c5923d9c01e tempest-CreateVolumesFromSnapshotTest-1817441323 None] Created volume successfully. Jul 31 10:59:24 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-677fc643-4a32-4392-a412-51e9d2bab1f1 tempest-VolumeDependencyTests-1531137417 None] Lock "cinder-5b735d01-5740-4d5d-a242-4c1b861117ed-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:24 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ba522288-d2fa-4e9a-a5dc-6549e0d71e21 tempest-VolumeDependencyTests-1531137417 None] Acquiring lock "cinder-96a1e970-13d5-4c72-b458-51c1b6d69e90-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:24 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ba522288-d2fa-4e9a-a5dc-6549e0d71e21 tempest-VolumeDependencyTests-1531137417 None] Lock "cinder-96a1e970-13d5-4c72-b458-51c1b6d69e90-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:24 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ba522288-d2fa-4e9a-a5dc-6549e0d71e21 tempest-VolumeDependencyTests-1531137417 None] Acquiring lock "cinder-quobyte-96a1e970-13d5-4c72-b458-51c1b6d69e90" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:24 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ba522288-d2fa-4e9a-a5dc-6549e0d71e21 tempest-VolumeDependencyTests-1531137417 None] Lock "cinder-quobyte-96a1e970-13d5-4c72-b458-51c1b6d69e90" acquired by "delete_volume" :: waited 0.022s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:24 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b16ea58-fa5e-4aa2-9f23-d54cf2577575]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ba522288-d2fa-4e9a-a5dc-6549e0d71e21 tempest-VolumeDependencyTests-1531137417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-96a1e970-13d5-4c72-b458-51c1b6d69e90 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:25 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-96a1e970-13d5-4c72-b458-51c1b6d69e90 Jul 31 10:59:25 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:25 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-69cf7bab-b7b8-4a53-a561-e051571bf80b tempest-CreateVolumesFromSnapshotTest-1817441323 None] Acquiring lock "cinder-66757784-ecdd-4d8a-9a14-deb526176a17-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:25 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-69cf7bab-b7b8-4a53-a561-e051571bf80b tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "cinder-66757784-ecdd-4d8a-9a14-deb526176a17-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:25 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-69cf7bab-b7b8-4a53-a561-e051571bf80b tempest-CreateVolumesFromSnapshotTest-1817441323 None] Acquiring lock "cinder-quobyte-66757784-ecdd-4d8a-9a14-deb526176a17" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:25 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-69cf7bab-b7b8-4a53-a561-e051571bf80b tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "cinder-quobyte-66757784-ecdd-4d8a-9a14-deb526176a17" acquired by "delete_volume" :: waited 0.022s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:25 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ac1f34-1f50-4c3e-b859-e7647e3301d6]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-69cf7bab-b7b8-4a53-a561-e051571bf80b tempest-CreateVolumesFromSnapshotTest-1817441323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-66757784-ecdd-4d8a-9a14-deb526176a17 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:25 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-66757784-ecdd-4d8a-9a14-deb526176a17 Jul 31 10:59:25 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:25 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ba522288-d2fa-4e9a-a5dc-6549e0d71e21 tempest-VolumeDependencyTests-1531137417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-96a1e970-13d5-4c72-b458-51c1b6d69e90" returned: 0 in 0.585s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ba522288-d2fa-4e9a-a5dc-6549e0d71e21 tempest-VolumeDependencyTests-1531137417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-96a1e970-13d5-4c72-b458-51c1b6d69e90 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:25 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-96a1e970-13d5-4c72-b458-51c1b6d69e90 Jul 31 10:59:25 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:25 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-50782f15-94d4-465f-902a-6d7aa41f6743 tempest-ProjectReaderTests-655005113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50782f15-94d4-465f-902a-6d7aa41f6743 tempest-ProjectReaderTests-655005113 None] Flow 'volume_create_manager' (1343ee58-cc4f-4f73-bd92-d7c82fd2f928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50782f15-94d4-465f-902a-6d7aa41f6743 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (436fb24e-f7bf-4230-b162-a6e74fb180c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50782f15-94d4-465f-902a-6d7aa41f6743 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (436fb24e-f7bf-4230-b162-a6e74fb180c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1367060134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8619968-6b79-4704-8e9c-5a2dce5e1201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b5d38698e144460b69508dad3b475d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:26Z,use_quota=True,user_id='32cefb6cda3e4a039c41146d966b5446',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50782f15-94d4-465f-902a-6d7aa41f6743 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (291ccc59-c49a-4a18-b4af-d3095f472819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50782f15-94d4-465f-902a-6d7aa41f6743 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (291ccc59-c49a-4a18-b4af-d3095f472819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50782f15-94d4-465f-902a-6d7aa41f6743 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead6fc45-6ae8-4e81-8664-b177878f0b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50782f15-94d4-465f-902a-6d7aa41f6743 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead6fc45-6ae8-4e81-8664-b177878f0b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8619968-6b79-4704-8e9c-5a2dce5e1201', 'volume_name': 'volume-f8619968-6b79-4704-8e9c-5a2dce5e1201', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50782f15-94d4-465f-902a-6d7aa41f6743 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c01f7117-7918-4033-8540-81ebee32037c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50782f15-94d4-465f-902a-6d7aa41f6743 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c01f7117-7918-4033-8540-81ebee32037c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50782f15-94d4-465f-902a-6d7aa41f6743 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acc77a23-4752-47d2-bf10-3330881ec07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:25 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-50782f15-94d4-465f-902a-6d7aa41f6743 tempest-ProjectReaderTests-655005113 None] Volume f8619968-6b79-4704-8e9c-5a2dce5e1201: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8619968-6b79-4704-8e9c-5a2dce5e1201', 'volume_size': 1} Jul 31 10:59:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-50782f15-94d4-465f-902a-6d7aa41f6743 tempest-ProjectReaderTests-655005113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-50782f15-94d4-465f-902a-6d7aa41f6743 tempest-ProjectReaderTests-655005113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:25 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-50782f15-94d4-465f-902a-6d7aa41f6743 tempest-ProjectReaderTests-655005113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1367060134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8619968-6b79-4704-8e9c-5a2dce5e1201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b5d38698e144460b69508dad3b475d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:26Z,use_quota=True,user_id='32cefb6cda3e4a039c41146d966b5446',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:25 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-50782f15-94d4-465f-902a-6d7aa41f6743 tempest-ProjectReaderTests-655005113 None] Creating volume f8619968-6b79-4704-8e9c-5a2dce5e1201 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-50782f15-94d4-465f-902a-6d7aa41f6743 tempest-ProjectReaderTests-655005113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-50782f15-94d4-465f-902a-6d7aa41f6743 tempest-ProjectReaderTests-655005113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:25 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-50782f15-94d4-465f-902a-6d7aa41f6743 tempest-ProjectReaderTests-655005113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:25 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-50782f15-94d4-465f-902a-6d7aa41f6743 tempest-ProjectReaderTests-655005113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-50782f15-94d4-465f-902a-6d7aa41f6743 tempest-ProjectReaderTests-655005113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:25 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-50782f15-94d4-465f-902a-6d7aa41f6743 tempest-ProjectReaderTests-655005113 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:59:25 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-50782f15-94d4-465f-902a-6d7aa41f6743 tempest-ProjectReaderTests-655005113 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:59:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-50782f15-94d4-465f-902a-6d7aa41f6743 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:25 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201 1073741824 Jul 31 10:59:25 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:25 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-69cf7bab-b7b8-4a53-a561-e051571bf80b tempest-CreateVolumesFromSnapshotTest-1817441323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-66757784-ecdd-4d8a-9a14-deb526176a17" returned: 0 in 0.569s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-69cf7bab-b7b8-4a53-a561-e051571bf80b tempest-CreateVolumesFromSnapshotTest-1817441323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-66757784-ecdd-4d8a-9a14-deb526176a17 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:25 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:25 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-66757784-ecdd-4d8a-9a14-deb526176a17 Jul 31 10:59:25 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ba522288-d2fa-4e9a-a5dc-6549e0d71e21 tempest-VolumeDependencyTests-1531137417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-96a1e970-13d5-4c72-b458-51c1b6d69e90" returned: 0 in 0.387s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:25 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ba522288-d2fa-4e9a-a5dc-6549e0d71e21 tempest-VolumeDependencyTests-1531137417 None] Lock "cinder-quobyte-96a1e970-13d5-4c72-b458-51c1b6d69e90" released by "delete_volume" :: held 1.040s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:25 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-ba522288-d2fa-4e9a-a5dc-6549e0d71e21 tempest-VolumeDependencyTests-1531137417 None] Created reservations ['1c03971e-8196-46e5-873c-18680220b748', '194e1aa8-bebb-490e-ae9f-762bbb751ae3', '398d9f9a-faba-4714-85a2-823cc8f49fa9', '18ac5cc2-29cf-48f1-aad5-d0483e40e693'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ba522288-d2fa-4e9a-a5dc-6549e0d71e21 tempest-VolumeDependencyTests-1531137417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ba522288-d2fa-4e9a-a5dc-6549e0d71e21 tempest-VolumeDependencyTests-1531137417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ba522288-d2fa-4e9a-a5dc-6549e0d71e21 tempest-VolumeDependencyTests-1531137417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ba522288-d2fa-4e9a-a5dc-6549e0d71e21 tempest-VolumeDependencyTests-1531137417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ba522288-d2fa-4e9a-a5dc-6549e0d71e21 tempest-VolumeDependencyTests-1531137417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ba522288-d2fa-4e9a-a5dc-6549e0d71e21 tempest-VolumeDependencyTests-1531137417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:26 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:59:26 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:26 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-69cf7bab-b7b8-4a53-a561-e051571bf80b tempest-CreateVolumesFromSnapshotTest-1817441323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-66757784-ecdd-4d8a-9a14-deb526176a17" returned: 0 in 0.405s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:26 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-69cf7bab-b7b8-4a53-a561-e051571bf80b tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "cinder-quobyte-66757784-ecdd-4d8a-9a14-deb526176a17" released by "delete_volume" :: held 1.054s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:26 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-69cf7bab-b7b8-4a53-a561-e051571bf80b tempest-CreateVolumesFromSnapshotTest-1817441323 None] Created reservations ['8a8520a9-ddcf-4c7c-9112-4cac5b9eae56', '8170941e-61a3-4186-8d84-6c20882d7d0a', 'c9d3f849-6a67-4ddb-9b69-c5893114429f', '67dce116-4df3-4776-9d5e-93d6329c9275'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:26 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-50782f15-94d4-465f-902a-6d7aa41f6743 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201 1073741824" returned: 0 in 0.646s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:26 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ba522288-d2fa-4e9a-a5dc-6549e0d71e21 tempest-VolumeDependencyTests-1531137417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.355s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:26 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-ba522288-d2fa-4e9a-a5dc-6549e0d71e21 tempest-VolumeDependencyTests-1531137417 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:26 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-ba522288-d2fa-4e9a-a5dc-6549e0d71e21 tempest-VolumeDependencyTests-1531137417 None] Deleted volume successfully. Jul 31 10:59:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-50782f15-94d4-465f-902a-6d7aa41f6743 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-69cf7bab-b7b8-4a53-a561-e051571bf80b tempest-CreateVolumesFromSnapshotTest-1817441323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-69cf7bab-b7b8-4a53-a561-e051571bf80b tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-69cf7bab-b7b8-4a53-a561-e051571bf80b tempest-CreateVolumesFromSnapshotTest-1817441323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:26 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201 Jul 31 10:59:26 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-69cf7bab-b7b8-4a53-a561-e051571bf80b tempest-CreateVolumesFromSnapshotTest-1817441323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-69cf7bab-b7b8-4a53-a561-e051571bf80b tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-69cf7bab-b7b8-4a53-a561-e051571bf80b tempest-CreateVolumesFromSnapshotTest-1817441323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:26 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ba522288-d2fa-4e9a-a5dc-6549e0d71e21 tempest-VolumeDependencyTests-1531137417 None] Lock "cinder-96a1e970-13d5-4c72-b458-51c1b6d69e90-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:26 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:59:26 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:26 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-50782f15-94d4-465f-902a-6d7aa41f6743 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201" returned: 0 in 0.298s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-50782f15-94d4-465f-902a-6d7aa41f6743 tempest-ProjectReaderTests-655005113 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-50782f15-94d4-465f-902a-6d7aa41f6743 tempest-ProjectReaderTests-655005113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50782f15-94d4-465f-902a-6d7aa41f6743 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acc77a23-4752-47d2-bf10-3330881ec07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8619968-6b79-4704-8e9c-5a2dce5e1201', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50782f15-94d4-465f-902a-6d7aa41f6743 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a180d5-b28a-46c4-9e2a-db97c10544a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:26 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-50782f15-94d4-465f-902a-6d7aa41f6743 tempest-ProjectReaderTests-655005113 None] Volume volume-f8619968-6b79-4704-8e9c-5a2dce5e1201 (f8619968-6b79-4704-8e9c-5a2dce5e1201): created successfully Jul 31 10:59:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50782f15-94d4-465f-902a-6d7aa41f6743 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a180d5-b28a-46c4-9e2a-db97c10544a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-50782f15-94d4-465f-902a-6d7aa41f6743 tempest-ProjectReaderTests-655005113 None] Flow 'volume_create_manager' (1343ee58-cc4f-4f73-bd92-d7c82fd2f928) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:26 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-69cf7bab-b7b8-4a53-a561-e051571bf80b tempest-CreateVolumesFromSnapshotTest-1817441323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.322s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:26 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-69cf7bab-b7b8-4a53-a561-e051571bf80b tempest-CreateVolumesFromSnapshotTest-1817441323 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:26 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-69cf7bab-b7b8-4a53-a561-e051571bf80b tempest-CreateVolumesFromSnapshotTest-1817441323 None] Deleted volume successfully. Jul 31 10:59:26 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-50782f15-94d4-465f-902a-6d7aa41f6743 tempest-ProjectReaderTests-655005113 None] Created volume successfully. Jul 31 10:59:26 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-69cf7bab-b7b8-4a53-a561-e051571bf80b tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "cinder-66757784-ecdd-4d8a-9a14-deb526176a17-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:27 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-0a6b2945-a941-4414-b68e-df1431fbade3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Acquiring lock "cinder-cd166c4d-6dee-4405-9072-178beef05425-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:27 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5c8a345-c9e6-45d4-9b54-f75a2a89012e tempest-CreateVolumesFromImageTest-135662986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a5c8a345-c9e6-45d4-9b54-f75a2a89012e tempest-CreateVolumesFromImageTest-135662986 None] Flow 'volume_create_manager' (ef57a9fd-93bc-4dd8-a8f6-adfd1beb9e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a5c8a345-c9e6-45d4-9b54-f75a2a89012e tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d415c271-4e89-41e1-9a30-f3dfa60a4f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:27 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-0a6b2945-a941-4414-b68e-df1431fbade3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "cinder-cd166c4d-6dee-4405-9072-178beef05425-delete_volume" acquired by "delete_volume" :: waited 0.127s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a5c8a345-c9e6-45d4-9b54-f75a2a89012e tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d415c271-4e89-41e1-9a30-f3dfa60a4f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-199844935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c0d9a86-3cbc-4222-8b08-8ea9ae15e8ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd177cf38084d1dbac7911faf142e1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:27Z,use_quota=True,user_id='760217941c534aac9e09ab120a337b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a5c8a345-c9e6-45d4-9b54-f75a2a89012e tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d593a82-b368-480c-a18b-49de5560aa2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a5c8a345-c9e6-45d4-9b54-f75a2a89012e tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d593a82-b368-480c-a18b-49de5560aa2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a5c8a345-c9e6-45d4-9b54-f75a2a89012e tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76247359-1cdf-497c-a22e-372d060bb569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a5c8a345-c9e6-45d4-9b54-f75a2a89012e tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76247359-1cdf-497c-a22e-372d060bb569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c0d9a86-3cbc-4222-8b08-8ea9ae15e8ac', 'volume_name': 'volume-8c0d9a86-3cbc-4222-8b08-8ea9ae15e8ac', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a5c8a345-c9e6-45d4-9b54-f75a2a89012e tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (929dcfa8-a605-447f-beb6-b8a1012dd232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a5c8a345-c9e6-45d4-9b54-f75a2a89012e tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (929dcfa8-a605-447f-beb6-b8a1012dd232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a5c8a345-c9e6-45d4-9b54-f75a2a89012e tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6f5ec7-30a7-4327-898b-5c08d9754a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:27 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-a5c8a345-c9e6-45d4-9b54-f75a2a89012e tempest-CreateVolumesFromImageTest-135662986 None] Volume 8c0d9a86-3cbc-4222-8b08-8ea9ae15e8ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c0d9a86-3cbc-4222-8b08-8ea9ae15e8ac', 'volume_size': 1} Jul 31 10:59:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a5c8a345-c9e6-45d4-9b54-f75a2a89012e tempest-CreateVolumesFromImageTest-135662986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a5c8a345-c9e6-45d4-9b54-f75a2a89012e tempest-CreateVolumesFromImageTest-135662986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:27 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a5c8a345-c9e6-45d4-9b54-f75a2a89012e tempest-CreateVolumesFromImageTest-135662986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-199844935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c0d9a86-3cbc-4222-8b08-8ea9ae15e8ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd177cf38084d1dbac7911faf142e1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:27Z,use_quota=True,user_id='760217941c534aac9e09ab120a337b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:27 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-a5c8a345-c9e6-45d4-9b54-f75a2a89012e tempest-CreateVolumesFromImageTest-135662986 None] Creating volume 8c0d9a86-3cbc-4222-8b08-8ea9ae15e8ac {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a5c8a345-c9e6-45d4-9b54-f75a2a89012e tempest-CreateVolumesFromImageTest-135662986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a5c8a345-c9e6-45d4-9b54-f75a2a89012e tempest-CreateVolumesFromImageTest-135662986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:27 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a5c8a345-c9e6-45d4-9b54-f75a2a89012e tempest-CreateVolumesFromImageTest-135662986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:27 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a5c8a345-c9e6-45d4-9b54-f75a2a89012e tempest-CreateVolumesFromImageTest-135662986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a5c8a345-c9e6-45d4-9b54-f75a2a89012e tempest-CreateVolumesFromImageTest-135662986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:27 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a5c8a345-c9e6-45d4-9b54-f75a2a89012e tempest-CreateVolumesFromImageTest-135662986 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:59:27 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-a5c8a345-c9e6-45d4-9b54-f75a2a89012e tempest-CreateVolumesFromImageTest-135662986 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:59:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a5c8a345-c9e6-45d4-9b54-f75a2a89012e tempest-CreateVolumesFromImageTest-135662986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8c0d9a86-3cbc-4222-8b08-8ea9ae15e8ac 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:27 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8c0d9a86-3cbc-4222-8b08-8ea9ae15e8ac 1073741824 Jul 31 10:59:27 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:27 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-0a6b2945-a941-4414-b68e-df1431fbade3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Acquiring lock "cinder-quobyte-cd166c4d-6dee-4405-9072-178beef05425" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:27 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-0a6b2945-a941-4414-b68e-df1431fbade3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "cinder-quobyte-cd166c4d-6dee-4405-9072-178beef05425" acquired by "delete_volume" :: waited 0.025s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:27 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[1957b1ee-5e06-447f-95f1-cc75b401e79b]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0a6b2945-a941-4414-b68e-df1431fbade3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cd166c4d-6dee-4405-9072-178beef05425 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:28 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-a51eb548-9f7c-4b5e-83c7-cac3e6cdd779 tempest-CreateVolumesFromImageTest-135662986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:28 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cd166c4d-6dee-4405-9072-178beef05425 Jul 31 10:59:28 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a51eb548-9f7c-4b5e-83c7-cac3e6cdd779 tempest-CreateVolumesFromImageTest-135662986 None] Flow 'volume_create_manager' (e3268cd1-6d54-4bba-bfa2-c03b5c3ed9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a51eb548-9f7c-4b5e-83c7-cac3e6cdd779 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6294a5c0-8cc0-4e94-a10f-6e830d4ba4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a51eb548-9f7c-4b5e-83c7-cac3e6cdd779 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6294a5c0-8cc0-4e94-a10f-6e830d4ba4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2085810580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=448b424b-33f4-468d-9338-309da94e7a66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd177cf38084d1dbac7911faf142e1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:28Z,use_quota=True,user_id='760217941c534aac9e09ab120a337b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a51eb548-9f7c-4b5e-83c7-cac3e6cdd779 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3884e46-3e28-4e55-b35d-9435bdfaf427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a51eb548-9f7c-4b5e-83c7-cac3e6cdd779 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3884e46-3e28-4e55-b35d-9435bdfaf427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a51eb548-9f7c-4b5e-83c7-cac3e6cdd779 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57ea0074-67c5-487d-ae3d-0af0c7208b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a51eb548-9f7c-4b5e-83c7-cac3e6cdd779 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57ea0074-67c5-487d-ae3d-0af0c7208b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '448b424b-33f4-468d-9338-309da94e7a66', 'volume_name': 'volume-448b424b-33f4-468d-9338-309da94e7a66', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a51eb548-9f7c-4b5e-83c7-cac3e6cdd779 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df9799ac-1b42-49a6-a918-18be863b0f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a51eb548-9f7c-4b5e-83c7-cac3e6cdd779 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df9799ac-1b42-49a6-a918-18be863b0f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a51eb548-9f7c-4b5e-83c7-cac3e6cdd779 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b39647ef-3e27-4c8f-b409-be816b1d00af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:28 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-a51eb548-9f7c-4b5e-83c7-cac3e6cdd779 tempest-CreateVolumesFromImageTest-135662986 None] Volume 448b424b-33f4-468d-9338-309da94e7a66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-448b424b-33f4-468d-9338-309da94e7a66', 'volume_size': 1} Jul 31 10:59:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a51eb548-9f7c-4b5e-83c7-cac3e6cdd779 tempest-CreateVolumesFromImageTest-135662986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a07124dc-9c6b-4bfc-8976-c50095c0e050 tempest-ProjectReaderTests-655005113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:28 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a5c8a345-c9e6-45d4-9b54-f75a2a89012e tempest-CreateVolumesFromImageTest-135662986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8c0d9a86-3cbc-4222-8b08-8ea9ae15e8ac 1073741824" returned: 0 in 0.880s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a5c8a345-c9e6-45d4-9b54-f75a2a89012e tempest-CreateVolumesFromImageTest-135662986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8c0d9a86-3cbc-4222-8b08-8ea9ae15e8ac {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:28 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8c0d9a86-3cbc-4222-8b08-8ea9ae15e8ac Jul 31 10:59:28 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:28 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0a6b2945-a941-4414-b68e-df1431fbade3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cd166c4d-6dee-4405-9072-178beef05425" returned: 0 in 0.855s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0a6b2945-a941-4414-b68e-df1431fbade3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cd166c4d-6dee-4405-9072-178beef05425 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:28 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cd166c4d-6dee-4405-9072-178beef05425 Jul 31 10:59:28 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:28 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-d522f1db-abf3-457b-8df4-9c4f6f895b48 tempest-CreateVolumesFromImageTest-135662986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d522f1db-abf3-457b-8df4-9c4f6f895b48 tempest-CreateVolumesFromImageTest-135662986 None] Flow 'volume_create_manager' (9ff4e952-656b-46e1-a728-30db873cdcbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d522f1db-abf3-457b-8df4-9c4f6f895b48 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab80e4ed-ca3b-439a-97bf-8d1caa987d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d522f1db-abf3-457b-8df4-9c4f6f895b48 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab80e4ed-ca3b-439a-97bf-8d1caa987d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-501184749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00cd9021-a8f8-445f-a137-d2ae50b70e7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd177cf38084d1dbac7911faf142e1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:29Z,use_quota=True,user_id='760217941c534aac9e09ab120a337b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d522f1db-abf3-457b-8df4-9c4f6f895b48 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3939fd39-14a0-4fed-9936-419c6a8eb74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d522f1db-abf3-457b-8df4-9c4f6f895b48 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3939fd39-14a0-4fed-9936-419c6a8eb74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d522f1db-abf3-457b-8df4-9c4f6f895b48 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26aadf11-fc3a-4654-807d-27b32cd772c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d522f1db-abf3-457b-8df4-9c4f6f895b48 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26aadf11-fc3a-4654-807d-27b32cd772c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00cd9021-a8f8-445f-a137-d2ae50b70e7f', 'volume_name': 'volume-00cd9021-a8f8-445f-a137-d2ae50b70e7f', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d522f1db-abf3-457b-8df4-9c4f6f895b48 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5961641-f571-4d2b-8dc6-f5ab6d37026d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d522f1db-abf3-457b-8df4-9c4f6f895b48 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5961641-f571-4d2b-8dc6-f5ab6d37026d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:28 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d522f1db-abf3-457b-8df4-9c4f6f895b48 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9508e79-2c0e-4d7d-84b0-6d3b21e21190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:28 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-d522f1db-abf3-457b-8df4-9c4f6f895b48 tempest-CreateVolumesFromImageTest-135662986 None] Volume 00cd9021-a8f8-445f-a137-d2ae50b70e7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00cd9021-a8f8-445f-a137-d2ae50b70e7f', 'volume_size': 1} Jul 31 10:59:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d522f1db-abf3-457b-8df4-9c4f6f895b48 tempest-CreateVolumesFromImageTest-135662986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:29 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a5c8a345-c9e6-45d4-9b54-f75a2a89012e tempest-CreateVolumesFromImageTest-135662986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8c0d9a86-3cbc-4222-8b08-8ea9ae15e8ac" returned: 0 in 0.385s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a5c8a345-c9e6-45d4-9b54-f75a2a89012e tempest-CreateVolumesFromImageTest-135662986 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a5c8a345-c9e6-45d4-9b54-f75a2a89012e tempest-CreateVolumesFromImageTest-135662986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.363s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a51eb548-9f7c-4b5e-83c7-cac3e6cdd779 tempest-CreateVolumesFromImageTest-135662986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.756s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a51eb548-9f7c-4b5e-83c7-cac3e6cdd779 tempest-CreateVolumesFromImageTest-135662986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2085810580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=448b424b-33f4-468d-9338-309da94e7a66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd177cf38084d1dbac7911faf142e1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:28Z,use_quota=True,user_id='760217941c534aac9e09ab120a337b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-a51eb548-9f7c-4b5e-83c7-cac3e6cdd779 tempest-CreateVolumesFromImageTest-135662986 None] Creating volume 448b424b-33f4-468d-9338-309da94e7a66 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a51eb548-9f7c-4b5e-83c7-cac3e6cdd779 tempest-CreateVolumesFromImageTest-135662986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a51eb548-9f7c-4b5e-83c7-cac3e6cdd779 tempest-CreateVolumesFromImageTest-135662986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a51eb548-9f7c-4b5e-83c7-cac3e6cdd779 tempest-CreateVolumesFromImageTest-135662986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a51eb548-9f7c-4b5e-83c7-cac3e6cdd779 tempest-CreateVolumesFromImageTest-135662986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a51eb548-9f7c-4b5e-83c7-cac3e6cdd779 tempest-CreateVolumesFromImageTest-135662986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a51eb548-9f7c-4b5e-83c7-cac3e6cdd779 tempest-CreateVolumesFromImageTest-135662986 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:59:29 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-a51eb548-9f7c-4b5e-83c7-cac3e6cdd779 tempest-CreateVolumesFromImageTest-135662986 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a51eb548-9f7c-4b5e-83c7-cac3e6cdd779 tempest-CreateVolumesFromImageTest-135662986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-448b424b-33f4-468d-9338-309da94e7a66 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:29 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0a6b2945-a941-4414-b68e-df1431fbade3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cd166c4d-6dee-4405-9072-178beef05425" returned: 0 in 0.349s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:29 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-448b424b-33f4-468d-9338-309da94e7a66 1073741824 Jul 31 10:59:29 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a5c8a345-c9e6-45d4-9b54-f75a2a89012e tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6f5ec7-30a7-4327-898b-5c08d9754a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c0d9a86-3cbc-4222-8b08-8ea9ae15e8ac', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a5c8a345-c9e6-45d4-9b54-f75a2a89012e tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf84454a-30b4-4f42-a7b8-68baa36b80b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-0a6b2945-a941-4414-b68e-df1431fbade3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "cinder-quobyte-cd166c4d-6dee-4405-9072-178beef05425" released by "delete_volume" :: held 1.341s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:29 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-a5c8a345-c9e6-45d4-9b54-f75a2a89012e tempest-CreateVolumesFromImageTest-135662986 None] Volume volume-8c0d9a86-3cbc-4222-8b08-8ea9ae15e8ac (8c0d9a86-3cbc-4222-8b08-8ea9ae15e8ac): created successfully Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a5c8a345-c9e6-45d4-9b54-f75a2a89012e tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf84454a-30b4-4f42-a7b8-68baa36b80b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a5c8a345-c9e6-45d4-9b54-f75a2a89012e tempest-CreateVolumesFromImageTest-135662986 None] Flow 'volume_create_manager' (ef57a9fd-93bc-4dd8-a8f6-adfd1beb9e04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:29 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-a5c8a345-c9e6-45d4-9b54-f75a2a89012e tempest-CreateVolumesFromImageTest-135662986 None] Created volume successfully. Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-0a6b2945-a941-4414-b68e-df1431fbade3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Created reservations ['02807ef5-0183-4bfa-902a-926d667672a7', 'c9cca3be-683a-4937-8181-bc4de5a44e83', '44d25ab9-74a6-4fa9-9143-0696828b10e8', '685e7914-73c9-4dc9-81cd-97e1e050674c'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0a6b2945-a941-4414-b68e-df1431fbade3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0a6b2945-a941-4414-b68e-df1431fbade3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0a6b2945-a941-4414-b68e-df1431fbade3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0a6b2945-a941-4414-b68e-df1431fbade3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0a6b2945-a941-4414-b68e-df1431fbade3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0a6b2945-a941-4414-b68e-df1431fbade3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:29 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:59:29 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb609651-99da-4401-b729-5b485fd32bc2 tempest-CreateVolumesFromImageTest-135662986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-eb609651-99da-4401-b729-5b485fd32bc2 tempest-CreateVolumesFromImageTest-135662986 None] Flow 'volume_create_manager' (0d4a8c65-f117-4d47-b84a-ddcd913f6a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-eb609651-99da-4401-b729-5b485fd32bc2 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0603d1a6-c8f9-45d7-b68d-e495c46aeaae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-eb609651-99da-4401-b729-5b485fd32bc2 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0603d1a6-c8f9-45d7-b68d-e495c46aeaae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-243166165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aa3cd82-f419-4df8-a729-7bfd2de42ff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd177cf38084d1dbac7911faf142e1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:29Z,use_quota=True,user_id='760217941c534aac9e09ab120a337b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-eb609651-99da-4401-b729-5b485fd32bc2 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35840307-3075-4e45-b523-d6e668d6580a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-eb609651-99da-4401-b729-5b485fd32bc2 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35840307-3075-4e45-b523-d6e668d6580a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-eb609651-99da-4401-b729-5b485fd32bc2 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76e60c22-4db8-420f-81ac-68565bc7c2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-eb609651-99da-4401-b729-5b485fd32bc2 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76e60c22-4db8-420f-81ac-68565bc7c2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7aa3cd82-f419-4df8-a729-7bfd2de42ff6', 'volume_name': 'volume-7aa3cd82-f419-4df8-a729-7bfd2de42ff6', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-eb609651-99da-4401-b729-5b485fd32bc2 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63beb001-61d8-480e-9bdb-27fd27d5f62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-eb609651-99da-4401-b729-5b485fd32bc2 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63beb001-61d8-480e-9bdb-27fd27d5f62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-eb609651-99da-4401-b729-5b485fd32bc2 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f41db884-8f87-40e4-875a-445d6d722a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:29 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-eb609651-99da-4401-b729-5b485fd32bc2 tempest-CreateVolumesFromImageTest-135662986 None] Volume 7aa3cd82-f419-4df8-a729-7bfd2de42ff6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7aa3cd82-f419-4df8-a729-7bfd2de42ff6', 'volume_size': 1} Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-eb609651-99da-4401-b729-5b485fd32bc2 tempest-CreateVolumesFromImageTest-135662986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:29 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a51eb548-9f7c-4b5e-83c7-cac3e6cdd779 tempest-CreateVolumesFromImageTest-135662986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-448b424b-33f4-468d-9338-309da94e7a66 1073741824" returned: 0 in 0.868s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-333345d8-40b3-41b4-a416-101e6f22d95d tempest-CreateVolumesFromSnapshotTest-1817441323 None] Acquiring lock "cinder-5621e381-9640-4bc6-b701-f8d98e794ba7-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:29 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0a6b2945-a941-4414-b68e-df1431fbade3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.441s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-0a6b2945-a941-4414-b68e-df1431fbade3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:29 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-333345d8-40b3-41b4-a416-101e6f22d95d tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "cinder-5621e381-9640-4bc6-b701-f8d98e794ba7-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:29 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-0a6b2945-a941-4414-b68e-df1431fbade3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Deleted volume successfully. Jul 31 10:59:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a51eb548-9f7c-4b5e-83c7-cac3e6cdd779 tempest-CreateVolumesFromImageTest-135662986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-448b424b-33f4-468d-9338-309da94e7a66 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:30 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-0a6b2945-a941-4414-b68e-df1431fbade3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "cinder-cd166c4d-6dee-4405-9072-178beef05425-delete_volume" released by "delete_volume" :: held 2.530s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:30 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-333345d8-40b3-41b4-a416-101e6f22d95d tempest-CreateVolumesFromSnapshotTest-1817441323 None] Acquiring lock "cinder-quobyte-5621e381-9640-4bc6-b701-f8d98e794ba7" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:30 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-448b424b-33f4-468d-9338-309da94e7a66 Jul 31 10:59:30 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:30 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-333345d8-40b3-41b4-a416-101e6f22d95d tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "cinder-quobyte-5621e381-9640-4bc6-b701-f8d98e794ba7" acquired by "delete_volume" :: waited 0.026s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:30 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bd077c-a03c-4099-8841-1a4d34b29e05]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-333345d8-40b3-41b4-a416-101e6f22d95d tempest-CreateVolumesFromSnapshotTest-1817441323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5621e381-9640-4bc6-b701-f8d98e794ba7 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:30 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-04db4586-9049-4215-a3bb-c1db9515b962 tempest-CreateVolumesFromImageTest-135662986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-04db4586-9049-4215-a3bb-c1db9515b962 tempest-CreateVolumesFromImageTest-135662986 None] Flow 'volume_create_manager' (3bcd71cc-ce7c-4eb7-a8ec-f62584fdc4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-04db4586-9049-4215-a3bb-c1db9515b962 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c21a8d6-4b24-4031-ad98-bdd20ec04156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-04db4586-9049-4215-a3bb-c1db9515b962 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c21a8d6-4b24-4031-ad98-bdd20ec04156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-172647882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fa92b69-c7e0-413d-9f55-47728ee6cef6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd177cf38084d1dbac7911faf142e1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:30Z,use_quota=True,user_id='760217941c534aac9e09ab120a337b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-04db4586-9049-4215-a3bb-c1db9515b962 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (687cefc2-b75b-4a78-8209-263b2191d4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-04db4586-9049-4215-a3bb-c1db9515b962 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (687cefc2-b75b-4a78-8209-263b2191d4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-04db4586-9049-4215-a3bb-c1db9515b962 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (598b06bb-e5a6-4754-8537-7172d572c593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-04db4586-9049-4215-a3bb-c1db9515b962 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (598b06bb-e5a6-4754-8537-7172d572c593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fa92b69-c7e0-413d-9f55-47728ee6cef6', 'volume_name': 'volume-5fa92b69-c7e0-413d-9f55-47728ee6cef6', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-04db4586-9049-4215-a3bb-c1db9515b962 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf941fb7-6357-40fe-8d07-438141f4a8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-04db4586-9049-4215-a3bb-c1db9515b962 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf941fb7-6357-40fe-8d07-438141f4a8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-04db4586-9049-4215-a3bb-c1db9515b962 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (476681f8-8ebb-41ee-871c-3d5d8cf87656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:30 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-04db4586-9049-4215-a3bb-c1db9515b962 tempest-CreateVolumesFromImageTest-135662986 None] Volume 5fa92b69-c7e0-413d-9f55-47728ee6cef6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fa92b69-c7e0-413d-9f55-47728ee6cef6', 'volume_size': 1} Jul 31 10:59:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-04db4586-9049-4215-a3bb-c1db9515b962 tempest-CreateVolumesFromImageTest-135662986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:30 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5621e381-9640-4bc6-b701-f8d98e794ba7 Jul 31 10:59:30 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:30 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a51eb548-9f7c-4b5e-83c7-cac3e6cdd779 tempest-CreateVolumesFromImageTest-135662986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-448b424b-33f4-468d-9338-309da94e7a66" returned: 0 in 0.358s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:30 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a51eb548-9f7c-4b5e-83c7-cac3e6cdd779 tempest-CreateVolumesFromImageTest-135662986 None] <== create_volume: return (1392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a51eb548-9f7c-4b5e-83c7-cac3e6cdd779 tempest-CreateVolumesFromImageTest-135662986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a07124dc-9c6b-4bfc-8976-c50095c0e050 tempest-ProjectReaderTests-655005113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.064s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a51eb548-9f7c-4b5e-83c7-cac3e6cdd779 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b39647ef-3e27-4c8f-b409-be816b1d00af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-448b424b-33f4-468d-9338-309da94e7a66', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a51eb548-9f7c-4b5e-83c7-cac3e6cdd779 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1181c8e1-d363-4663-a6ca-0b2840544598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:30 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-a07124dc-9c6b-4bfc-8976-c50095c0e050 tempest-ProjectReaderTests-655005113 None] Creating offline snapshot ebb39f4e-5665-4bf9-b191-388e08e715d4 of volume f8619968-6b79-4704-8e9c-5a2dce5e1201 {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:59:30 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-a51eb548-9f7c-4b5e-83c7-cac3e6cdd779 tempest-CreateVolumesFromImageTest-135662986 None] Volume volume-448b424b-33f4-468d-9338-309da94e7a66 (448b424b-33f4-468d-9338-309da94e7a66): created successfully Jul 31 10:59:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a51eb548-9f7c-4b5e-83c7-cac3e6cdd779 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1181c8e1-d363-4663-a6ca-0b2840544598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:30 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a51eb548-9f7c-4b5e-83c7-cac3e6cdd779 tempest-CreateVolumesFromImageTest-135662986 None] Flow 'volume_create_manager' (e3268cd1-6d54-4bba-bfa2-c03b5c3ed9b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:30 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ac8da9-7cf1-4b60-bb40-df399be26757]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a07124dc-9c6b-4bfc-8976-c50095c0e050 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:30 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-a51eb548-9f7c-4b5e-83c7-cac3e6cdd779 tempest-CreateVolumesFromImageTest-135662986 None] Created volume successfully. Jul 31 10:59:30 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201 Jul 31 10:59:30 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:30 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-333345d8-40b3-41b4-a416-101e6f22d95d tempest-CreateVolumesFromSnapshotTest-1817441323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5621e381-9640-4bc6-b701-f8d98e794ba7" returned: 0 in 0.529s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-333345d8-40b3-41b4-a416-101e6f22d95d tempest-CreateVolumesFromSnapshotTest-1817441323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5621e381-9640-4bc6-b701-f8d98e794ba7 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:30 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5621e381-9640-4bc6-b701-f8d98e794ba7 Jul 31 10:59:30 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:30 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a07124dc-9c6b-4bfc-8976-c50095c0e050 tempest-ProjectReaderTests-655005113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201" returned: 0 in 0.447s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a07124dc-9c6b-4bfc-8976-c50095c0e050 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201.ebb39f4e-5665-4bf9-b191-388e08e715d4 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:30 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201.ebb39f4e-5665-4bf9-b191-388e08e715d4 1G Jul 31 10:59:30 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:31 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-333345d8-40b3-41b4-a416-101e6f22d95d tempest-CreateVolumesFromSnapshotTest-1817441323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5621e381-9640-4bc6-b701-f8d98e794ba7" returned: 0 in 0.355s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:31 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-333345d8-40b3-41b4-a416-101e6f22d95d tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "cinder-quobyte-5621e381-9640-4bc6-b701-f8d98e794ba7" released by "delete_volume" :: held 0.967s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:31 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-333345d8-40b3-41b4-a416-101e6f22d95d tempest-CreateVolumesFromSnapshotTest-1817441323 None] Created reservations ['d7d20a1b-af66-42e2-a02a-e9f6d3e23594', 'c259cd30-9056-45f0-8b5e-07d432003c00', '85544886-7466-4e45-af9e-888b9cd318e5', '923d07d9-c012-4413-85ff-fd093fa42e57'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-333345d8-40b3-41b4-a416-101e6f22d95d tempest-CreateVolumesFromSnapshotTest-1817441323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-333345d8-40b3-41b4-a416-101e6f22d95d tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:31 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-333345d8-40b3-41b4-a416-101e6f22d95d tempest-CreateVolumesFromSnapshotTest-1817441323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:31 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-333345d8-40b3-41b4-a416-101e6f22d95d tempest-CreateVolumesFromSnapshotTest-1817441323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-333345d8-40b3-41b4-a416-101e6f22d95d tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-333345d8-40b3-41b4-a416-101e6f22d95d tempest-CreateVolumesFromSnapshotTest-1817441323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:31 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:59:31 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:31 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a07124dc-9c6b-4bfc-8976-c50095c0e050 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201.ebb39f4e-5665-4bf9-b191-388e08e715d4 1G" returned: 0 in 0.653s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a07124dc-9c6b-4bfc-8976-c50095c0e050 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8619968-6b79-4704-8e9c-5a2dce5e1201 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201.ebb39f4e-5665-4bf9-b191-388e08e715d4 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:31 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-333345d8-40b3-41b4-a416-101e6f22d95d tempest-CreateVolumesFromSnapshotTest-1817441323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.344s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:31 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-333345d8-40b3-41b4-a416-101e6f22d95d tempest-CreateVolumesFromSnapshotTest-1817441323 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:31 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-333345d8-40b3-41b4-a416-101e6f22d95d tempest-CreateVolumesFromSnapshotTest-1817441323 None] Deleted volume successfully. Jul 31 10:59:31 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8619968-6b79-4704-8e9c-5a2dce5e1201 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201.ebb39f4e-5665-4bf9-b191-388e08e715d4 Jul 31 10:59:31 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:31 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-333345d8-40b3-41b4-a416-101e6f22d95d tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "cinder-5621e381-9640-4bc6-b701-f8d98e794ba7-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:31 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a07124dc-9c6b-4bfc-8976-c50095c0e050 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8619968-6b79-4704-8e9c-5a2dce5e1201 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201.ebb39f4e-5665-4bf9-b191-388e08e715d4" returned: 0 in 0.368s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:31 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-a07124dc-9c6b-4bfc-8976-c50095c0e050 tempest-ProjectReaderTests-655005113 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201.ebb39f4e-5665-4bf9-b191-388e08e715d4 is being set with open permissions: ugo+rw Jul 31 10:59:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a07124dc-9c6b-4bfc-8976-c50095c0e050 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201.ebb39f4e-5665-4bf9-b191-388e08e715d4 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:32 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201.ebb39f4e-5665-4bf9-b191-388e08e715d4 Jul 31 10:59:32 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:32 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a07124dc-9c6b-4bfc-8976-c50095c0e050 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201.ebb39f4e-5665-4bf9-b191-388e08e715d4" returned: 0 in 0.295s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:32 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-3e1c1ed5-9ca4-494a-afb6-d87cce3271ca tempest-CreateVolumesFromSnapshotTest-1817441323 None] Acquiring lock "cinder-d2f19dcc-8503-4f55-ae7c-f44869c03ec5-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a07124dc-9c6b-4bfc-8976-c50095c0e050 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:32 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-3e1c1ed5-9ca4-494a-afb6-d87cce3271ca tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "cinder-d2f19dcc-8503-4f55-ae7c-f44869c03ec5-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:32 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201.info Jul 31 10:59:32 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:32 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-3e1c1ed5-9ca4-494a-afb6-d87cce3271ca tempest-CreateVolumesFromSnapshotTest-1817441323 None] Acquiring lock "cinder-quobyte-d2f19dcc-8503-4f55-ae7c-f44869c03ec5" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:32 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-3e1c1ed5-9ca4-494a-afb6-d87cce3271ca tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "cinder-quobyte-d2f19dcc-8503-4f55-ae7c-f44869c03ec5" acquired by "delete_volume" :: waited 0.024s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:32 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[691c0332-df23-41f8-8246-0c3861a190a7]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3e1c1ed5-9ca4-494a-afb6-d87cce3271ca tempest-CreateVolumesFromSnapshotTest-1817441323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d2f19dcc-8503-4f55-ae7c-f44869c03ec5 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:32 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d2f19dcc-8503-4f55-ae7c-f44869c03ec5 Jul 31 10:59:32 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:32 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a07124dc-9c6b-4bfc-8976-c50095c0e050 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201.info" returned: 0 in 0.329s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:32 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-a07124dc-9c6b-4bfc-8976-c50095c0e050 tempest-ProjectReaderTests-655005113 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201.info is being set with open permissions: ugo+rw Jul 31 10:59:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a07124dc-9c6b-4bfc-8976-c50095c0e050 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:32 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201.info Jul 31 10:59:32 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:32 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3e1c1ed5-9ca4-494a-afb6-d87cce3271ca tempest-CreateVolumesFromSnapshotTest-1817441323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d2f19dcc-8503-4f55-ae7c-f44869c03ec5" returned: 0 in 0.430s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3e1c1ed5-9ca4-494a-afb6-d87cce3271ca tempest-CreateVolumesFromSnapshotTest-1817441323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d2f19dcc-8503-4f55-ae7c-f44869c03ec5 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:32 devstack sudo[107535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d2f19dcc-8503-4f55-ae7c-f44869c03ec5 Jul 31 10:59:32 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:32 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a07124dc-9c6b-4bfc-8976-c50095c0e050 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201.info" returned: 0 in 0.289s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a07124dc-9c6b-4bfc-8976-c50095c0e050 tempest-ProjectReaderTests-655005113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.565s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d522f1db-abf3-457b-8df4-9c4f6f895b48 tempest-CreateVolumesFromImageTest-135662986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.065s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:32 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d522f1db-abf3-457b-8df4-9c4f6f895b48 tempest-CreateVolumesFromImageTest-135662986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-501184749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00cd9021-a8f8-445f-a137-d2ae50b70e7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd177cf38084d1dbac7911faf142e1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:29Z,use_quota=True,user_id='760217941c534aac9e09ab120a337b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:32 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-d522f1db-abf3-457b-8df4-9c4f6f895b48 tempest-CreateVolumesFromImageTest-135662986 None] Creating volume 00cd9021-a8f8-445f-a137-d2ae50b70e7f {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d522f1db-abf3-457b-8df4-9c4f6f895b48 tempest-CreateVolumesFromImageTest-135662986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d522f1db-abf3-457b-8df4-9c4f6f895b48 tempest-CreateVolumesFromImageTest-135662986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:32 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d522f1db-abf3-457b-8df4-9c4f6f895b48 tempest-CreateVolumesFromImageTest-135662986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:32 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d522f1db-abf3-457b-8df4-9c4f6f895b48 tempest-CreateVolumesFromImageTest-135662986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d522f1db-abf3-457b-8df4-9c4f6f895b48 tempest-CreateVolumesFromImageTest-135662986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:32 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d522f1db-abf3-457b-8df4-9c4f6f895b48 tempest-CreateVolumesFromImageTest-135662986 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:59:32 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-d522f1db-abf3-457b-8df4-9c4f6f895b48 tempest-CreateVolumesFromImageTest-135662986 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:59:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d522f1db-abf3-457b-8df4-9c4f6f895b48 tempest-CreateVolumesFromImageTest-135662986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-00cd9021-a8f8-445f-a137-d2ae50b70e7f 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:33 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-00cd9021-a8f8-445f-a137-d2ae50b70e7f 1073741824 Jul 31 10:59:33 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:33 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-a07124dc-9c6b-4bfc-8976-c50095c0e050 tempest-ProjectReaderTests-655005113 None] Create snapshot completed successfully Jul 31 10:59:33 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3e1c1ed5-9ca4-494a-afb6-d87cce3271ca tempest-CreateVolumesFromSnapshotTest-1817441323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-d2f19dcc-8503-4f55-ae7c-f44869c03ec5" returned: 0 in 0.308s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:33 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-3e1c1ed5-9ca4-494a-afb6-d87cce3271ca tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "cinder-quobyte-d2f19dcc-8503-4f55-ae7c-f44869c03ec5" released by "delete_volume" :: held 0.809s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:33 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-3e1c1ed5-9ca4-494a-afb6-d87cce3271ca tempest-CreateVolumesFromSnapshotTest-1817441323 None] Created reservations ['1be7b854-44ff-438c-badf-c57b372e9691', '97309b0c-3a63-4614-a0fe-d4166d68624f', '71863eea-2678-4eec-83a0-75e572b407d1', 'c2e70501-f082-44af-a3da-c71a9e2a2bbc'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3e1c1ed5-9ca4-494a-afb6-d87cce3271ca tempest-CreateVolumesFromSnapshotTest-1817441323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3e1c1ed5-9ca4-494a-afb6-d87cce3271ca tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:33 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-3e1c1ed5-9ca4-494a-afb6-d87cce3271ca tempest-CreateVolumesFromSnapshotTest-1817441323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:33 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-3e1c1ed5-9ca4-494a-afb6-d87cce3271ca tempest-CreateVolumesFromSnapshotTest-1817441323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3e1c1ed5-9ca4-494a-afb6-d87cce3271ca tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3e1c1ed5-9ca4-494a-afb6-d87cce3271ca tempest-CreateVolumesFromSnapshotTest-1817441323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:33 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:59:33 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:33 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7df1f4f4-c44f-4478-9cab-7980fe2a6a35 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Acquiring lock "cinder-75b25500-4229-4607-bc86-4c0994ea71c7-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:33 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7df1f4f4-c44f-4478-9cab-7980fe2a6a35 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "cinder-75b25500-4229-4607-bc86-4c0994ea71c7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:33 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7df1f4f4-c44f-4478-9cab-7980fe2a6a35 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Acquiring lock "cinder-quobyte-75b25500-4229-4607-bc86-4c0994ea71c7" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:33 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7df1f4f4-c44f-4478-9cab-7980fe2a6a35 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "cinder-quobyte-75b25500-4229-4607-bc86-4c0994ea71c7" acquired by "delete_volume" :: waited 0.027s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:33 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d522f1db-abf3-457b-8df4-9c4f6f895b48 tempest-CreateVolumesFromImageTest-135662986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-00cd9021-a8f8-445f-a137-d2ae50b70e7f 1073741824" returned: 0 in 0.679s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:33 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14e9ea9-33d1-4b7d-8699-608c158e77b9]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7df1f4f4-c44f-4478-9cab-7980fe2a6a35 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-75b25500-4229-4607-bc86-4c0994ea71c7 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d522f1db-abf3-457b-8df4-9c4f6f895b48 tempest-CreateVolumesFromImageTest-135662986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-00cd9021-a8f8-445f-a137-d2ae50b70e7f {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:33 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-00cd9021-a8f8-445f-a137-d2ae50b70e7f Jul 31 10:59:33 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:33 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3e1c1ed5-9ca4-494a-afb6-d87cce3271ca tempest-CreateVolumesFromSnapshotTest-1817441323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.428s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:33 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-3e1c1ed5-9ca4-494a-afb6-d87cce3271ca tempest-CreateVolumesFromSnapshotTest-1817441323 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:33 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-3e1c1ed5-9ca4-494a-afb6-d87cce3271ca tempest-CreateVolumesFromSnapshotTest-1817441323 None] Deleted volume successfully. Jul 31 10:59:33 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-75b25500-4229-4607-bc86-4c0994ea71c7 Jul 31 10:59:33 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:33 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-3e1c1ed5-9ca4-494a-afb6-d87cce3271ca tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "cinder-d2f19dcc-8503-4f55-ae7c-f44869c03ec5-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:34 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d522f1db-abf3-457b-8df4-9c4f6f895b48 tempest-CreateVolumesFromImageTest-135662986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-00cd9021-a8f8-445f-a137-d2ae50b70e7f" returned: 0 in 0.372s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d522f1db-abf3-457b-8df4-9c4f6f895b48 tempest-CreateVolumesFromImageTest-135662986 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d522f1db-abf3-457b-8df4-9c4f6f895b48 tempest-CreateVolumesFromImageTest-135662986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-eb609651-99da-4401-b729-5b485fd32bc2 tempest-CreateVolumesFromImageTest-135662986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.348s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-eb609651-99da-4401-b729-5b485fd32bc2 tempest-CreateVolumesFromImageTest-135662986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-243166165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aa3cd82-f419-4df8-a729-7bfd2de42ff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd177cf38084d1dbac7911faf142e1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:29Z,use_quota=True,user_id='760217941c534aac9e09ab120a337b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-eb609651-99da-4401-b729-5b485fd32bc2 tempest-CreateVolumesFromImageTest-135662986 None] Creating volume 7aa3cd82-f419-4df8-a729-7bfd2de42ff6 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-eb609651-99da-4401-b729-5b485fd32bc2 tempest-CreateVolumesFromImageTest-135662986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-eb609651-99da-4401-b729-5b485fd32bc2 tempest-CreateVolumesFromImageTest-135662986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-eb609651-99da-4401-b729-5b485fd32bc2 tempest-CreateVolumesFromImageTest-135662986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-eb609651-99da-4401-b729-5b485fd32bc2 tempest-CreateVolumesFromImageTest-135662986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-eb609651-99da-4401-b729-5b485fd32bc2 tempest-CreateVolumesFromImageTest-135662986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-eb609651-99da-4401-b729-5b485fd32bc2 tempest-CreateVolumesFromImageTest-135662986 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:59:34 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-eb609651-99da-4401-b729-5b485fd32bc2 tempest-CreateVolumesFromImageTest-135662986 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-eb609651-99da-4401-b729-5b485fd32bc2 tempest-CreateVolumesFromImageTest-135662986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-7aa3cd82-f419-4df8-a729-7bfd2de42ff6 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-408a7785-8165-499f-b4bd-8553aa14fe30 tempest-ProjectReaderTests-655005113 None] Acquiring lock "cinder-ebb39f4e-5665-4bf9-b191-388e08e715d4-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:34 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-7aa3cd82-f419-4df8-a729-7bfd2de42ff6 1073741824 Jul 31 10:59:34 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d522f1db-abf3-457b-8df4-9c4f6f895b48 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9508e79-2c0e-4d7d-84b0-6d3b21e21190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00cd9021-a8f8-445f-a137-d2ae50b70e7f', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d522f1db-abf3-457b-8df4-9c4f6f895b48 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08cd92d1-e8c7-4eb3-9705-7ea69cf689de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:34 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7df1f4f4-c44f-4478-9cab-7980fe2a6a35 tempest-CreateVolumesFromSnapshotTest-1817441323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-75b25500-4229-4607-bc86-4c0994ea71c7" returned: 0 in 0.557s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7df1f4f4-c44f-4478-9cab-7980fe2a6a35 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-75b25500-4229-4607-bc86-4c0994ea71c7 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-408a7785-8165-499f-b4bd-8553aa14fe30 tempest-ProjectReaderTests-655005113 None] Lock "cinder-ebb39f4e-5665-4bf9-b191-388e08e715d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.075s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-408a7785-8165-499f-b4bd-8553aa14fe30 tempest-ProjectReaderTests-655005113 None] Acquiring lock "cinder-quobyte-f8619968-6b79-4704-8e9c-5a2dce5e1201" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:34 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-d522f1db-abf3-457b-8df4-9c4f6f895b48 tempest-CreateVolumesFromImageTest-135662986 None] Volume volume-00cd9021-a8f8-445f-a137-d2ae50b70e7f (00cd9021-a8f8-445f-a137-d2ae50b70e7f): created successfully Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d522f1db-abf3-457b-8df4-9c4f6f895b48 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08cd92d1-e8c7-4eb3-9705-7ea69cf689de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-d522f1db-abf3-457b-8df4-9c4f6f895b48 tempest-CreateVolumesFromImageTest-135662986 None] Flow 'volume_create_manager' (9ff4e952-656b-46e1-a728-30db873cdcbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:34 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-75b25500-4229-4607-bc86-4c0994ea71c7 Jul 31 10:59:34 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:34 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-d522f1db-abf3-457b-8df4-9c4f6f895b48 tempest-CreateVolumesFromImageTest-135662986 None] Created volume successfully. Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-408a7785-8165-499f-b4bd-8553aa14fe30 tempest-ProjectReaderTests-655005113 None] Lock "cinder-quobyte-f8619968-6b79-4704-8e9c-5a2dce5e1201" acquired by "delete_snapshot" :: waited 0.047s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-408a7785-8165-499f-b4bd-8553aa14fe30 tempest-ProjectReaderTests-655005113 None] Acquiring lock "cinder-quobyte-ebb39f4e-5665-4bf9-b191-388e08e715d4" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-408a7785-8165-499f-b4bd-8553aa14fe30 tempest-ProjectReaderTests-655005113 None] Lock "cinder-quobyte-ebb39f4e-5665-4bf9-b191-388e08e715d4" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-408a7785-8165-499f-b4bd-8553aa14fe30 tempest-ProjectReaderTests-655005113 None] Deleting offline snapshot ebb39f4e-5665-4bf9-b191-388e08e715d4 of volume f8619968-6b79-4704-8e9c-5a2dce5e1201 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-408a7785-8165-499f-b4bd-8553aa14fe30 tempest-ProjectReaderTests-655005113 None] snapshot_file for this snap is: volume-f8619968-6b79-4704-8e9c-5a2dce5e1201.ebb39f4e-5665-4bf9-b191-388e08e715d4 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0d43c2-31d5-48bb-9372-0571f58fb144]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-408a7785-8165-499f-b4bd-8553aa14fe30 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201.ebb39f4e-5665-4bf9-b191-388e08e715d4 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:34 devstack sudo[107560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201.ebb39f4e-5665-4bf9-b191-388e08e715d4 Jul 31 10:59:34 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:34 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7df1f4f4-c44f-4478-9cab-7980fe2a6a35 tempest-CreateVolumesFromSnapshotTest-1817441323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-75b25500-4229-4607-bc86-4c0994ea71c7" returned: 0 in 0.403s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7df1f4f4-c44f-4478-9cab-7980fe2a6a35 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "cinder-quobyte-75b25500-4229-4607-bc86-4c0994ea71c7" released by "delete_volume" :: held 1.034s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-7df1f4f4-c44f-4478-9cab-7980fe2a6a35 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Created reservations ['372c053b-ad01-4f48-b544-47372ede7ff8', 'e13ef97e-4b98-45d9-8eef-4de29c9ab400', '60f1dc43-91a2-4dab-83c5-df4f377f91c9', 'aa772d56-3b8b-4cd5-9572-0de1a3ea4c4e'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:34 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7df1f4f4-c44f-4478-9cab-7980fe2a6a35 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7df1f4f4-c44f-4478-9cab-7980fe2a6a35 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-7df1f4f4-c44f-4478-9cab-7980fe2a6a35 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-7df1f4f4-c44f-4478-9cab-7980fe2a6a35 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-7df1f4f4-c44f-4478-9cab-7980fe2a6a35 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7df1f4f4-c44f-4478-9cab-7980fe2a6a35 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-eb609651-99da-4401-b729-5b485fd32bc2 tempest-CreateVolumesFromImageTest-135662986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-7aa3cd82-f419-4df8-a729-7bfd2de42ff6 1073741824" returned: 0 in 0.701s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:34 devstack sudo[107570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:59:34 devstack sudo[107570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:34 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-408a7785-8165-499f-b4bd-8553aa14fe30 tempest-ProjectReaderTests-655005113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201.ebb39f4e-5665-4bf9-b191-388e08e715d4" returned: 0 in 0.493s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-408a7785-8165-499f-b4bd-8553aa14fe30 tempest-ProjectReaderTests-655005113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8619968-6b79-4704-8e9c-5a2dce5e1201(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-eb609651-99da-4401-b729-5b485fd32bc2 tempest-CreateVolumesFromImageTest-135662986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-7aa3cd82-f419-4df8-a729-7bfd2de42ff6 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77659ab-5581-4f4d-af5c-687a991deaeb]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-408a7785-8165-499f-b4bd-8553aa14fe30 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:34 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-7aa3cd82-f419-4df8-a729-7bfd2de42ff6 Jul 31 10:59:34 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:35 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201 Jul 31 10:59:35 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:35 devstack sudo[107570]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-7df1f4f4-c44f-4478-9cab-7980fe2a6a35 tempest-CreateVolumesFromSnapshotTest-1817441323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.314s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:35 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-7df1f4f4-c44f-4478-9cab-7980fe2a6a35 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:35 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-7df1f4f4-c44f-4478-9cab-7980fe2a6a35 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Deleted volume successfully. Jul 31 10:59:35 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-7df1f4f4-c44f-4478-9cab-7980fe2a6a35 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "cinder-75b25500-4229-4607-bc86-4c0994ea71c7-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:35 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-eb609651-99da-4401-b729-5b485fd32bc2 tempest-CreateVolumesFromImageTest-135662986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-7aa3cd82-f419-4df8-a729-7bfd2de42ff6" returned: 0 in 0.393s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:35 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-eb609651-99da-4401-b729-5b485fd32bc2 tempest-CreateVolumesFromImageTest-135662986 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-eb609651-99da-4401-b729-5b485fd32bc2 tempest-CreateVolumesFromImageTest-135662986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-04db4586-9049-4215-a3bb-c1db9515b962 tempest-CreateVolumesFromImageTest-135662986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.062s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:35 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-04db4586-9049-4215-a3bb-c1db9515b962 tempest-CreateVolumesFromImageTest-135662986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-172647882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fa92b69-c7e0-413d-9f55-47728ee6cef6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd177cf38084d1dbac7911faf142e1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:30Z,use_quota=True,user_id='760217941c534aac9e09ab120a337b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:35 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-04db4586-9049-4215-a3bb-c1db9515b962 tempest-CreateVolumesFromImageTest-135662986 None] Creating volume 5fa92b69-c7e0-413d-9f55-47728ee6cef6 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-04db4586-9049-4215-a3bb-c1db9515b962 tempest-CreateVolumesFromImageTest-135662986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-04db4586-9049-4215-a3bb-c1db9515b962 tempest-CreateVolumesFromImageTest-135662986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:35 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-04db4586-9049-4215-a3bb-c1db9515b962 tempest-CreateVolumesFromImageTest-135662986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:35 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-04db4586-9049-4215-a3bb-c1db9515b962 tempest-CreateVolumesFromImageTest-135662986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-04db4586-9049-4215-a3bb-c1db9515b962 tempest-CreateVolumesFromImageTest-135662986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:35 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-04db4586-9049-4215-a3bb-c1db9515b962 tempest-CreateVolumesFromImageTest-135662986 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:59:35 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-04db4586-9049-4215-a3bb-c1db9515b962 tempest-CreateVolumesFromImageTest-135662986 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:59:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-04db4586-9049-4215-a3bb-c1db9515b962 tempest-CreateVolumesFromImageTest-135662986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5fa92b69-c7e0-413d-9f55-47728ee6cef6 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-eb609651-99da-4401-b729-5b485fd32bc2 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f41db884-8f87-40e4-875a-445d6d722a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7aa3cd82-f419-4df8-a729-7bfd2de42ff6', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:35 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5fa92b69-c7e0-413d-9f55-47728ee6cef6 1073741824 Jul 31 10:59:35 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-eb609651-99da-4401-b729-5b485fd32bc2 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17d18304-739c-48b3-b72b-dcd399a8224c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:35 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-eb609651-99da-4401-b729-5b485fd32bc2 tempest-CreateVolumesFromImageTest-135662986 None] Volume volume-7aa3cd82-f419-4df8-a729-7bfd2de42ff6 (7aa3cd82-f419-4df8-a729-7bfd2de42ff6): created successfully Jul 31 10:59:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-eb609651-99da-4401-b729-5b485fd32bc2 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17d18304-739c-48b3-b72b-dcd399a8224c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-eb609651-99da-4401-b729-5b485fd32bc2 tempest-CreateVolumesFromImageTest-135662986 None] Flow 'volume_create_manager' (0d4a8c65-f117-4d47-b84a-ddcd913f6a6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:35 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-eb609651-99da-4401-b729-5b485fd32bc2 tempest-CreateVolumesFromImageTest-135662986 None] Created volume successfully. Jul 31 10:59:35 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-408a7785-8165-499f-b4bd-8553aa14fe30 tempest-ProjectReaderTests-655005113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201" returned: 0 in 0.543s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-408a7785-8165-499f-b4bd-8553aa14fe30 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201.ebb39f4e-5665-4bf9-b191-388e08e715d4 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:35 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201.ebb39f4e-5665-4bf9-b191-388e08e715d4 Jul 31 10:59:35 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:35 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9305ca34-e262-4a88-8d55-e36d70ed61a3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Acquiring lock "cinder-43dbc69c-27c3-41ba-b3dd-28441bd2a603-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:35 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9305ca34-e262-4a88-8d55-e36d70ed61a3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "cinder-43dbc69c-27c3-41ba-b3dd-28441bd2a603-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:35 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:35 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9305ca34-e262-4a88-8d55-e36d70ed61a3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Acquiring lock "cinder-quobyte-af7576d8-a63c-41aa-a0af-3adbaa961296" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-04db4586-9049-4215-a3bb-c1db9515b962 tempest-CreateVolumesFromImageTest-135662986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5fa92b69-c7e0-413d-9f55-47728ee6cef6 1073741824" returned: 0 in 0.592s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:35 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9305ca34-e262-4a88-8d55-e36d70ed61a3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "cinder-quobyte-af7576d8-a63c-41aa-a0af-3adbaa961296" acquired by "delete_snapshot" :: waited 0.023s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:35 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9305ca34-e262-4a88-8d55-e36d70ed61a3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Acquiring lock "cinder-quobyte-43dbc69c-27c3-41ba-b3dd-28441bd2a603" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:35 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9305ca34-e262-4a88-8d55-e36d70ed61a3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "cinder-quobyte-43dbc69c-27c3-41ba-b3dd-28441bd2a603" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:36 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-9305ca34-e262-4a88-8d55-e36d70ed61a3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Deleting offline snapshot 43dbc69c-27c3-41ba-b3dd-28441bd2a603 of volume af7576d8-a63c-41aa-a0af-3adbaa961296 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:59:36 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-9305ca34-e262-4a88-8d55-e36d70ed61a3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] snapshot_file for this snap is: volume-af7576d8-a63c-41aa-a0af-3adbaa961296.43dbc69c-27c3-41ba-b3dd-28441bd2a603 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:59:36 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-408a7785-8165-499f-b4bd-8553aa14fe30 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201.ebb39f4e-5665-4bf9-b191-388e08e715d4" returned: 0 in 0.531s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-408a7785-8165-499f-b4bd-8553aa14fe30 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201.ebb39f4e-5665-4bf9-b191-388e08e715d4 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:36 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[2215c4a5-4899-4f36-b498-1a9883de43d5]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9305ca34-e262-4a88-8d55-e36d70ed61a3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296.43dbc69c-27c3-41ba-b3dd-28441bd2a603 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:36 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201.ebb39f4e-5665-4bf9-b191-388e08e715d4 Jul 31 10:59:36 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-04db4586-9049-4215-a3bb-c1db9515b962 tempest-CreateVolumesFromImageTest-135662986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5fa92b69-c7e0-413d-9f55-47728ee6cef6 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:36 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5fa92b69-c7e0-413d-9f55-47728ee6cef6 Jul 31 10:59:36 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:36 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296.43dbc69c-27c3-41ba-b3dd-28441bd2a603 Jul 31 10:59:36 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:36 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-408a7785-8165-499f-b4bd-8553aa14fe30 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201.ebb39f4e-5665-4bf9-b191-388e08e715d4" returned: 0 in 0.317s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:36 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-408a7785-8165-499f-b4bd-8553aa14fe30 tempest-ProjectReaderTests-655005113 None] Lock "cinder-quobyte-ebb39f4e-5665-4bf9-b191-388e08e715d4" released by "_delete_snapshot" :: held 2.052s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:36 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-408a7785-8165-499f-b4bd-8553aa14fe30 tempest-ProjectReaderTests-655005113 None] Lock "cinder-quobyte-f8619968-6b79-4704-8e9c-5a2dce5e1201" released by "delete_snapshot" :: held 2.089s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:36 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-04db4586-9049-4215-a3bb-c1db9515b962 tempest-CreateVolumesFromImageTest-135662986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5fa92b69-c7e0-413d-9f55-47728ee6cef6" returned: 0 in 0.337s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:36 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-04db4586-9049-4215-a3bb-c1db9515b962 tempest-CreateVolumesFromImageTest-135662986 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-04db4586-9049-4215-a3bb-c1db9515b962 tempest-CreateVolumesFromImageTest-135662986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-04db4586-9049-4215-a3bb-c1db9515b962 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (476681f8-8ebb-41ee-871c-3d5d8cf87656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fa92b69-c7e0-413d-9f55-47728ee6cef6', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-04db4586-9049-4215-a3bb-c1db9515b962 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46852a3b-8cf6-4125-b1c3-bf7d8c584e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:36 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-04db4586-9049-4215-a3bb-c1db9515b962 tempest-CreateVolumesFromImageTest-135662986 None] Volume volume-5fa92b69-c7e0-413d-9f55-47728ee6cef6 (5fa92b69-c7e0-413d-9f55-47728ee6cef6): created successfully Jul 31 10:59:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-04db4586-9049-4215-a3bb-c1db9515b962 tempest-CreateVolumesFromImageTest-135662986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46852a3b-8cf6-4125-b1c3-bf7d8c584e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-04db4586-9049-4215-a3bb-c1db9515b962 tempest-CreateVolumesFromImageTest-135662986 None] Flow 'volume_create_manager' (3bcd71cc-ce7c-4eb7-a8ec-f62584fdc4b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:36 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-04db4586-9049-4215-a3bb-c1db9515b962 tempest-CreateVolumesFromImageTest-135662986 None] Created volume successfully. Jul 31 10:59:36 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-408a7785-8165-499f-b4bd-8553aa14fe30 tempest-ProjectReaderTests-655005113 None] Created reservations ['da41421a-1f08-416c-9e05-34f0138a97fe', '510230c5-64ec-48ab-99e5-8cf6c6adb22e', '2e1d385b-b490-48cf-9b46-ae47efc675fb', 'f9598a34-494c-4cbf-aac1-731160e743bf'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:36 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9305ca34-e262-4a88-8d55-e36d70ed61a3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296.43dbc69c-27c3-41ba-b3dd-28441bd2a603" returned: 0 in 0.507s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:36 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-9305ca34-e262-4a88-8d55-e36d70ed61a3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af7576d8-a63c-41aa-a0af-3adbaa961296(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:59:36 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59ad89a-1043-43eb-bb36-6e4fccd40fed]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9305ca34-e262-4a88-8d55-e36d70ed61a3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:36 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-408a7785-8165-499f-b4bd-8553aa14fe30 tempest-ProjectReaderTests-655005113 None] Delete snapshot completed successfully. Jul 31 10:59:36 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-408a7785-8165-499f-b4bd-8553aa14fe30 tempest-ProjectReaderTests-655005113 None] Lock "cinder-ebb39f4e-5665-4bf9-b191-388e08e715d4-delete_snapshot" released by "delete_snapshot" :: held 2.387s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:36 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296 Jul 31 10:59:36 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:36 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-373be7b8-8904-4c8f-9783-013e40001a50 tempest-CreateVolumesFromImageTest-135662986 None] Acquiring lock "cinder-5fa92b69-c7e0-413d-9f55-47728ee6cef6-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:36 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-373be7b8-8904-4c8f-9783-013e40001a50 tempest-CreateVolumesFromImageTest-135662986 None] Lock "cinder-5fa92b69-c7e0-413d-9f55-47728ee6cef6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:36 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-373be7b8-8904-4c8f-9783-013e40001a50 tempest-CreateVolumesFromImageTest-135662986 None] Acquiring lock "cinder-quobyte-5fa92b69-c7e0-413d-9f55-47728ee6cef6" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-373be7b8-8904-4c8f-9783-013e40001a50 tempest-CreateVolumesFromImageTest-135662986 None] Lock "cinder-quobyte-5fa92b69-c7e0-413d-9f55-47728ee6cef6" acquired by "delete_volume" :: waited 0.021s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:37 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[711d854e-55ca-4b22-8d0c-e97d69fb06f9]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-373be7b8-8904-4c8f-9783-013e40001a50 tempest-CreateVolumesFromImageTest-135662986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5fa92b69-c7e0-413d-9f55-47728ee6cef6 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:37 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9305ca34-e262-4a88-8d55-e36d70ed61a3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296" returned: 0 in 0.470s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9305ca34-e262-4a88-8d55-e36d70ed61a3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296.43dbc69c-27c3-41ba-b3dd-28441bd2a603 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:37 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296.43dbc69c-27c3-41ba-b3dd-28441bd2a603 Jul 31 10:59:37 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:37 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5fa92b69-c7e0-413d-9f55-47728ee6cef6 Jul 31 10:59:37 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-3b2cb480-db81-4cbd-9420-8098a4056c91 tempest-ProjectReaderTests-655005113 None] Acquiring lock "cinder-f8619968-6b79-4704-8e9c-5a2dce5e1201-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-3b2cb480-db81-4cbd-9420-8098a4056c91 tempest-ProjectReaderTests-655005113 None] Lock "cinder-f8619968-6b79-4704-8e9c-5a2dce5e1201-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-3b2cb480-db81-4cbd-9420-8098a4056c91 tempest-ProjectReaderTests-655005113 None] Acquiring lock "cinder-quobyte-f8619968-6b79-4704-8e9c-5a2dce5e1201" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:37 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9305ca34-e262-4a88-8d55-e36d70ed61a3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296.43dbc69c-27c3-41ba-b3dd-28441bd2a603" returned: 0 in 0.588s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9305ca34-e262-4a88-8d55-e36d70ed61a3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296.43dbc69c-27c3-41ba-b3dd-28441bd2a603 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:37 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-3b2cb480-db81-4cbd-9420-8098a4056c91 tempest-ProjectReaderTests-655005113 None] Lock "cinder-quobyte-f8619968-6b79-4704-8e9c-5a2dce5e1201" acquired by "delete_volume" :: waited 0.034s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:37 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:37 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296.43dbc69c-27c3-41ba-b3dd-28441bd2a603 Jul 31 10:59:37 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-373be7b8-8904-4c8f-9783-013e40001a50 tempest-CreateVolumesFromImageTest-135662986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5fa92b69-c7e0-413d-9f55-47728ee6cef6" returned: 0 in 0.694s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-373be7b8-8904-4c8f-9783-013e40001a50 tempest-CreateVolumesFromImageTest-135662986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5fa92b69-c7e0-413d-9f55-47728ee6cef6 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:37 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[b474f885-7719-4208-9e02-6522e30e986d]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3b2cb480-db81-4cbd-9420-8098a4056c91 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:37 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5fa92b69-c7e0-413d-9f55-47728ee6cef6 Jul 31 10:59:37 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:37 devstack sudo[107627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201 Jul 31 10:59:37 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:37 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9305ca34-e262-4a88-8d55-e36d70ed61a3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296.43dbc69c-27c3-41ba-b3dd-28441bd2a603" returned: 0 in 0.311s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:38 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9305ca34-e262-4a88-8d55-e36d70ed61a3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "cinder-quobyte-43dbc69c-27c3-41ba-b3dd-28441bd2a603" released by "_delete_snapshot" :: held 2.042s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:38 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9305ca34-e262-4a88-8d55-e36d70ed61a3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "cinder-quobyte-af7576d8-a63c-41aa-a0af-3adbaa961296" released by "delete_snapshot" :: held 2.090s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:38 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:38 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-9305ca34-e262-4a88-8d55-e36d70ed61a3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Created reservations ['e1ba84cf-ea6c-492e-b33a-c79f1c316d84', 'f7a04092-d5a8-4ff2-86a9-e07fc077625d', '67cbde21-300a-4821-b21b-981f1a32b546', 'aa0606a5-36eb-4440-b7b2-a214c1625352'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-373be7b8-8904-4c8f-9783-013e40001a50 tempest-CreateVolumesFromImageTest-135662986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5fa92b69-c7e0-413d-9f55-47728ee6cef6" returned: 0 in 0.440s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:38 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-373be7b8-8904-4c8f-9783-013e40001a50 tempest-CreateVolumesFromImageTest-135662986 None] Lock "cinder-quobyte-5fa92b69-c7e0-413d-9f55-47728ee6cef6" released by "delete_volume" :: held 1.189s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:38 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3b2cb480-db81-4cbd-9420-8098a4056c91 tempest-ProjectReaderTests-655005113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201" returned: 0 in 0.493s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3b2cb480-db81-4cbd-9420-8098a4056c91 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:38 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201 Jul 31 10:59:38 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:38 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-9305ca34-e262-4a88-8d55-e36d70ed61a3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Delete snapshot completed successfully. Jul 31 10:59:38 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9305ca34-e262-4a88-8d55-e36d70ed61a3 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "cinder-43dbc69c-27c3-41ba-b3dd-28441bd2a603-delete_snapshot" released by "delete_snapshot" :: held 2.365s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:38 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-373be7b8-8904-4c8f-9783-013e40001a50 tempest-CreateVolumesFromImageTest-135662986 None] Created reservations ['6082da36-9496-4917-900c-b69ee00cceb4', 'df15aa2c-8fc3-452e-b250-a187109fde20', 'e17e920f-c087-4429-b531-8b91a85a70fc', '90540fb5-5bdb-4e77-8633-67c2e7329131'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-373be7b8-8904-4c8f-9783-013e40001a50 tempest-CreateVolumesFromImageTest-135662986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-373be7b8-8904-4c8f-9783-013e40001a50 tempest-CreateVolumesFromImageTest-135662986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:38 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-373be7b8-8904-4c8f-9783-013e40001a50 tempest-CreateVolumesFromImageTest-135662986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:38 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-373be7b8-8904-4c8f-9783-013e40001a50 tempest-CreateVolumesFromImageTest-135662986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-373be7b8-8904-4c8f-9783-013e40001a50 tempest-CreateVolumesFromImageTest-135662986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-373be7b8-8904-4c8f-9783-013e40001a50 tempest-CreateVolumesFromImageTest-135662986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:38 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:59:38 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:38 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3b2cb480-db81-4cbd-9420-8098a4056c91 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f8619968-6b79-4704-8e9c-5a2dce5e1201" returned: 0 in 0.312s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:38 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-3b2cb480-db81-4cbd-9420-8098a4056c91 tempest-ProjectReaderTests-655005113 None] Lock "cinder-quobyte-f8619968-6b79-4704-8e9c-5a2dce5e1201" released by "delete_volume" :: held 0.915s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:38 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-3b2cb480-db81-4cbd-9420-8098a4056c91 tempest-ProjectReaderTests-655005113 None] Created reservations ['6b871a59-c4c3-4479-9d0e-8de50164e187', '28e00f24-0805-467d-8c37-4e971cce3e3d', '179c6470-f269-4801-b05d-0a84263de040', 'df217a16-e759-49f1-a1c6-44102f89de7a'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:38 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-373be7b8-8904-4c8f-9783-013e40001a50 tempest-CreateVolumesFromImageTest-135662986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.312s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:38 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-373be7b8-8904-4c8f-9783-013e40001a50 tempest-CreateVolumesFromImageTest-135662986 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:38 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-373be7b8-8904-4c8f-9783-013e40001a50 tempest-CreateVolumesFromImageTest-135662986 None] Deleted volume successfully. Jul 31 10:59:38 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-373be7b8-8904-4c8f-9783-013e40001a50 tempest-CreateVolumesFromImageTest-135662986 None] Lock "cinder-5fa92b69-c7e0-413d-9f55-47728ee6cef6-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3b2cb480-db81-4cbd-9420-8098a4056c91 tempest-ProjectReaderTests-655005113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3b2cb480-db81-4cbd-9420-8098a4056c91 tempest-ProjectReaderTests-655005113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:38 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-3b2cb480-db81-4cbd-9420-8098a4056c91 tempest-ProjectReaderTests-655005113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:38 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-3b2cb480-db81-4cbd-9420-8098a4056c91 tempest-ProjectReaderTests-655005113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3b2cb480-db81-4cbd-9420-8098a4056c91 tempest-ProjectReaderTests-655005113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3b2cb480-db81-4cbd-9420-8098a4056c91 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:38 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:59:38 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:39 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3b2cb480-db81-4cbd-9420-8098a4056c91 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.272s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:39 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-3b2cb480-db81-4cbd-9420-8098a4056c91 tempest-ProjectReaderTests-655005113 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:39 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-3b2cb480-db81-4cbd-9420-8098a4056c91 tempest-ProjectReaderTests-655005113 None] Deleted volume successfully. Jul 31 10:59:39 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-3b2cb480-db81-4cbd-9420-8098a4056c91 tempest-ProjectReaderTests-655005113 None] Lock "cinder-f8619968-6b79-4704-8e9c-5a2dce5e1201-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:39 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e95885da-2e35-4964-8cb8-f4e5997b32ba tempest-CreateVolumesFromImageTest-135662986 None] Acquiring lock "cinder-7aa3cd82-f419-4df8-a729-7bfd2de42ff6-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:39 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e95885da-2e35-4964-8cb8-f4e5997b32ba tempest-CreateVolumesFromImageTest-135662986 None] Lock "cinder-7aa3cd82-f419-4df8-a729-7bfd2de42ff6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:39 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e95885da-2e35-4964-8cb8-f4e5997b32ba tempest-CreateVolumesFromImageTest-135662986 None] Acquiring lock "cinder-quobyte-7aa3cd82-f419-4df8-a729-7bfd2de42ff6" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:39 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e95885da-2e35-4964-8cb8-f4e5997b32ba tempest-CreateVolumesFromImageTest-135662986 None] Lock "cinder-quobyte-7aa3cd82-f419-4df8-a729-7bfd2de42ff6" acquired by "delete_volume" :: waited 0.018s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:39 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad972a01-68a8-44b2-84b3-652664e8d157]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e95885da-2e35-4964-8cb8-f4e5997b32ba tempest-CreateVolumesFromImageTest-135662986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-7aa3cd82-f419-4df8-a729-7bfd2de42ff6 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:39 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8ef3c60a-3efe-4501-ba2a-8c493f773c93 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Acquiring lock "cinder-af7576d8-a63c-41aa-a0af-3adbaa961296-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:39 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8ef3c60a-3efe-4501-ba2a-8c493f773c93 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "cinder-af7576d8-a63c-41aa-a0af-3adbaa961296-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:39 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8ef3c60a-3efe-4501-ba2a-8c493f773c93 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Acquiring lock "cinder-quobyte-af7576d8-a63c-41aa-a0af-3adbaa961296" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:39 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8ef3c60a-3efe-4501-ba2a-8c493f773c93 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "cinder-quobyte-af7576d8-a63c-41aa-a0af-3adbaa961296" acquired by "delete_volume" :: waited 0.019s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:39 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-7aa3cd82-f419-4df8-a729-7bfd2de42ff6 Jul 31 10:59:39 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:39 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[6678e043-18a8-4bcd-b189-b9e0584977b8]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8ef3c60a-3efe-4501-ba2a-8c493f773c93 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:39 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296 Jul 31 10:59:39 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:39 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e95885da-2e35-4964-8cb8-f4e5997b32ba tempest-CreateVolumesFromImageTest-135662986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-7aa3cd82-f419-4df8-a729-7bfd2de42ff6" returned: 0 in 0.488s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e95885da-2e35-4964-8cb8-f4e5997b32ba tempest-CreateVolumesFromImageTest-135662986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-7aa3cd82-f419-4df8-a729-7bfd2de42ff6 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:39 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-7aa3cd82-f419-4df8-a729-7bfd2de42ff6 Jul 31 10:59:39 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:39 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8ef3c60a-3efe-4501-ba2a-8c493f773c93 tempest-CreateVolumesFromSnapshotTest-1817441323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296" returned: 0 in 0.454s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8ef3c60a-3efe-4501-ba2a-8c493f773c93 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:39 devstack sudo[107660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296 Jul 31 10:59:39 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:40 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e95885da-2e35-4964-8cb8-f4e5997b32ba tempest-CreateVolumesFromImageTest-135662986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-7aa3cd82-f419-4df8-a729-7bfd2de42ff6" returned: 0 in 0.366s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e95885da-2e35-4964-8cb8-f4e5997b32ba tempest-CreateVolumesFromImageTest-135662986 None] Lock "cinder-quobyte-7aa3cd82-f419-4df8-a729-7bfd2de42ff6" released by "delete_volume" :: held 0.913s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-e95885da-2e35-4964-8cb8-f4e5997b32ba tempest-CreateVolumesFromImageTest-135662986 None] Created reservations ['777c6a60-3a8a-4b8d-b5bd-09b968065720', '3a7a96ce-1159-4bfd-a336-22419085aca2', '03cbb45f-0101-49e5-a988-0027dda2911c', 'c910730c-0bfb-4f5b-a7a8-57e3557ed531'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:40 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8ef3c60a-3efe-4501-ba2a-8c493f773c93 tempest-CreateVolumesFromSnapshotTest-1817441323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-af7576d8-a63c-41aa-a0af-3adbaa961296" returned: 0 in 0.373s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8ef3c60a-3efe-4501-ba2a-8c493f773c93 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "cinder-quobyte-af7576d8-a63c-41aa-a0af-3adbaa961296" released by "delete_volume" :: held 0.936s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e95885da-2e35-4964-8cb8-f4e5997b32ba tempest-CreateVolumesFromImageTest-135662986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e95885da-2e35-4964-8cb8-f4e5997b32ba tempest-CreateVolumesFromImageTest-135662986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-e95885da-2e35-4964-8cb8-f4e5997b32ba tempest-CreateVolumesFromImageTest-135662986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-e95885da-2e35-4964-8cb8-f4e5997b32ba tempest-CreateVolumesFromImageTest-135662986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e95885da-2e35-4964-8cb8-f4e5997b32ba tempest-CreateVolumesFromImageTest-135662986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e95885da-2e35-4964-8cb8-f4e5997b32ba tempest-CreateVolumesFromImageTest-135662986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:40 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:59:40 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-8ef3c60a-3efe-4501-ba2a-8c493f773c93 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Created reservations ['906237c6-71dd-439d-9aaf-b332999618d3', '8fe8160a-d9b4-43e1-b3b1-1732614b21e9', '6ef37420-d188-448e-a06c-7e5acd87a6f3', 'cbdf44ce-f5a5-454a-a10a-c8a5fa7bb6f1'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-c57e98a8-0dca-4ba5-9e1d-4fa0d08e70b2 tempest-ProjectReaderTests-655005113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c57e98a8-0dca-4ba5-9e1d-4fa0d08e70b2 tempest-ProjectReaderTests-655005113 None] Flow 'volume_create_manager' (a1c5bf2e-7366-4f4a-90db-900f85acfa56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c57e98a8-0dca-4ba5-9e1d-4fa0d08e70b2 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab644e76-d252-4cfd-8f10-aa24a963184c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c57e98a8-0dca-4ba5-9e1d-4fa0d08e70b2 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab644e76-d252-4cfd-8f10-aa24a963184c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1045063297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9be8ce48-5f9d-4f03-a570-1173b47b9dd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b5d38698e144460b69508dad3b475d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:40Z,use_quota=True,user_id='32cefb6cda3e4a039c41146d966b5446',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c57e98a8-0dca-4ba5-9e1d-4fa0d08e70b2 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (469484c4-7b95-4f41-a560-24416cafa365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c57e98a8-0dca-4ba5-9e1d-4fa0d08e70b2 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (469484c4-7b95-4f41-a560-24416cafa365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c57e98a8-0dca-4ba5-9e1d-4fa0d08e70b2 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7471fcfc-c408-415e-b398-e3ab075ce296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c57e98a8-0dca-4ba5-9e1d-4fa0d08e70b2 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7471fcfc-c408-415e-b398-e3ab075ce296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9be8ce48-5f9d-4f03-a570-1173b47b9dd1', 'volume_name': 'volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c57e98a8-0dca-4ba5-9e1d-4fa0d08e70b2 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9dc9245-c272-44ca-89c9-8a9d1503762a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c57e98a8-0dca-4ba5-9e1d-4fa0d08e70b2 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9dc9245-c272-44ca-89c9-8a9d1503762a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c57e98a8-0dca-4ba5-9e1d-4fa0d08e70b2 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d47976c9-f185-4fce-af09-4c1043009972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:40 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-c57e98a8-0dca-4ba5-9e1d-4fa0d08e70b2 tempest-ProjectReaderTests-655005113 None] Volume 9be8ce48-5f9d-4f03-a570-1173b47b9dd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1', 'volume_size': 1} Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c57e98a8-0dca-4ba5-9e1d-4fa0d08e70b2 tempest-ProjectReaderTests-655005113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c57e98a8-0dca-4ba5-9e1d-4fa0d08e70b2 tempest-ProjectReaderTests-655005113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c57e98a8-0dca-4ba5-9e1d-4fa0d08e70b2 tempest-ProjectReaderTests-655005113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1045063297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9be8ce48-5f9d-4f03-a570-1173b47b9dd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b5d38698e144460b69508dad3b475d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:40Z,use_quota=True,user_id='32cefb6cda3e4a039c41146d966b5446',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-c57e98a8-0dca-4ba5-9e1d-4fa0d08e70b2 tempest-ProjectReaderTests-655005113 None] Creating volume 9be8ce48-5f9d-4f03-a570-1173b47b9dd1 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c57e98a8-0dca-4ba5-9e1d-4fa0d08e70b2 tempest-ProjectReaderTests-655005113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c57e98a8-0dca-4ba5-9e1d-4fa0d08e70b2 tempest-ProjectReaderTests-655005113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c57e98a8-0dca-4ba5-9e1d-4fa0d08e70b2 tempest-ProjectReaderTests-655005113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c57e98a8-0dca-4ba5-9e1d-4fa0d08e70b2 tempest-ProjectReaderTests-655005113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c57e98a8-0dca-4ba5-9e1d-4fa0d08e70b2 tempest-ProjectReaderTests-655005113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c57e98a8-0dca-4ba5-9e1d-4fa0d08e70b2 tempest-ProjectReaderTests-655005113 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:59:40 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-c57e98a8-0dca-4ba5-9e1d-4fa0d08e70b2 tempest-ProjectReaderTests-655005113 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c57e98a8-0dca-4ba5-9e1d-4fa0d08e70b2 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:40 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1 1073741824 Jul 31 10:59:40 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8ef3c60a-3efe-4501-ba2a-8c493f773c93 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8ef3c60a-3efe-4501-ba2a-8c493f773c93 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-8ef3c60a-3efe-4501-ba2a-8c493f773c93 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-8ef3c60a-3efe-4501-ba2a-8c493f773c93 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8ef3c60a-3efe-4501-ba2a-8c493f773c93 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8ef3c60a-3efe-4501-ba2a-8c493f773c93 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:40 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:59:40 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:40 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e95885da-2e35-4964-8cb8-f4e5997b32ba tempest-CreateVolumesFromImageTest-135662986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.308s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-e95885da-2e35-4964-8cb8-f4e5997b32ba tempest-CreateVolumesFromImageTest-135662986 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:40 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-e95885da-2e35-4964-8cb8-f4e5997b32ba tempest-CreateVolumesFromImageTest-135662986 None] Deleted volume successfully. Jul 31 10:59:40 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e95885da-2e35-4964-8cb8-f4e5997b32ba tempest-CreateVolumesFromImageTest-135662986 None] Lock "cinder-7aa3cd82-f419-4df8-a729-7bfd2de42ff6-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:41 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8ef3c60a-3efe-4501-ba2a-8c493f773c93 tempest-CreateVolumesFromSnapshotTest-1817441323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.325s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:41 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-8ef3c60a-3efe-4501-ba2a-8c493f773c93 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:41 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-8ef3c60a-3efe-4501-ba2a-8c493f773c93 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Deleted volume successfully. Jul 31 10:59:41 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8ef3c60a-3efe-4501-ba2a-8c493f773c93 tempest-CreateVolumesFromSnapshotTest-1817441323 None] Lock "cinder-af7576d8-a63c-41aa-a0af-3adbaa961296-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:41 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c57e98a8-0dca-4ba5-9e1d-4fa0d08e70b2 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1 1073741824" returned: 0 in 0.563s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c57e98a8-0dca-4ba5-9e1d-4fa0d08e70b2 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:41 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1 Jul 31 10:59:41 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:41 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c57e98a8-0dca-4ba5-9e1d-4fa0d08e70b2 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1" returned: 0 in 0.323s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:41 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c57e98a8-0dca-4ba5-9e1d-4fa0d08e70b2 tempest-ProjectReaderTests-655005113 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c57e98a8-0dca-4ba5-9e1d-4fa0d08e70b2 tempest-ProjectReaderTests-655005113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:41 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-dcb2f9fd-9da9-4ef8-aa6f-928071947da8 tempest-CreateVolumesFromImageTest-135662986 None] Acquiring lock "cinder-00cd9021-a8f8-445f-a137-d2ae50b70e7f-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:41 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c57e98a8-0dca-4ba5-9e1d-4fa0d08e70b2 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d47976c9-f185-4fce-af09-4c1043009972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:41 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c57e98a8-0dca-4ba5-9e1d-4fa0d08e70b2 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ae0f94a-f3bb-45e4-839f-620ebc23cefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:41 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-dcb2f9fd-9da9-4ef8-aa6f-928071947da8 tempest-CreateVolumesFromImageTest-135662986 None] Lock "cinder-00cd9021-a8f8-445f-a137-d2ae50b70e7f-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:41 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-c57e98a8-0dca-4ba5-9e1d-4fa0d08e70b2 tempest-ProjectReaderTests-655005113 None] Volume volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1 (9be8ce48-5f9d-4f03-a570-1173b47b9dd1): created successfully Jul 31 10:59:41 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c57e98a8-0dca-4ba5-9e1d-4fa0d08e70b2 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ae0f94a-f3bb-45e4-839f-620ebc23cefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:41 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c57e98a8-0dca-4ba5-9e1d-4fa0d08e70b2 tempest-ProjectReaderTests-655005113 None] Flow 'volume_create_manager' (a1c5bf2e-7366-4f4a-90db-900f85acfa56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:41 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-c57e98a8-0dca-4ba5-9e1d-4fa0d08e70b2 tempest-ProjectReaderTests-655005113 None] Created volume successfully. Jul 31 10:59:41 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-dcb2f9fd-9da9-4ef8-aa6f-928071947da8 tempest-CreateVolumesFromImageTest-135662986 None] Acquiring lock "cinder-quobyte-00cd9021-a8f8-445f-a137-d2ae50b70e7f" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:41 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-dcb2f9fd-9da9-4ef8-aa6f-928071947da8 tempest-CreateVolumesFromImageTest-135662986 None] Lock "cinder-quobyte-00cd9021-a8f8-445f-a137-d2ae50b70e7f" acquired by "delete_volume" :: waited 0.029s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:41 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c1f09e-fce6-4b6c-95b2-b1775fc80d94]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dcb2f9fd-9da9-4ef8-aa6f-928071947da8 tempest-CreateVolumesFromImageTest-135662986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-00cd9021-a8f8-445f-a137-d2ae50b70e7f {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:42 devstack sudo[107679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-00cd9021-a8f8-445f-a137-d2ae50b70e7f Jul 31 10:59:42 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:42 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dcb2f9fd-9da9-4ef8-aa6f-928071947da8 tempest-CreateVolumesFromImageTest-135662986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-00cd9021-a8f8-445f-a137-d2ae50b70e7f" returned: 0 in 0.519s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dcb2f9fd-9da9-4ef8-aa6f-928071947da8 tempest-CreateVolumesFromImageTest-135662986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-00cd9021-a8f8-445f-a137-d2ae50b70e7f {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:42 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-00cd9021-a8f8-445f-a137-d2ae50b70e7f Jul 31 10:59:42 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:42 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dcb2f9fd-9da9-4ef8-aa6f-928071947da8 tempest-CreateVolumesFromImageTest-135662986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-00cd9021-a8f8-445f-a137-d2ae50b70e7f" returned: 0 in 0.507s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-88daa64b-f7cf-45d3-97f2-08b9d16b9646 tempest-ProjectReaderTests-655005113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-88daa64b-f7cf-45d3-97f2-08b9d16b9646 tempest-ProjectReaderTests-655005113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:42 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-dcb2f9fd-9da9-4ef8-aa6f-928071947da8 tempest-CreateVolumesFromImageTest-135662986 None] Lock "cinder-quobyte-00cd9021-a8f8-445f-a137-d2ae50b70e7f" released by "delete_volume" :: held 1.102s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:42 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-88daa64b-f7cf-45d3-97f2-08b9d16b9646 tempest-ProjectReaderTests-655005113 None] Creating offline snapshot e3d42beb-0bb0-4377-89c1-bce661a984b6 of volume 9be8ce48-5f9d-4f03-a570-1173b47b9dd1 {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:59:42 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c3b03d-d75a-4645-8cb3-2ef59c26c612]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88daa64b-f7cf-45d3-97f2-08b9d16b9646 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:43 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-dcb2f9fd-9da9-4ef8-aa6f-928071947da8 tempest-CreateVolumesFromImageTest-135662986 None] Created reservations ['afbc899f-f968-4b57-930a-b34f11a27ce0', 'a938f433-25d4-4b4a-829c-229b6fe6dcee', 'de7c17fe-d41e-446a-8ced-a56d5b8a7119', '2adb5ee8-1226-43d1-ab18-c0e21155e4c2'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:43 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1 Jul 31 10:59:43 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-dcb2f9fd-9da9-4ef8-aa6f-928071947da8 tempest-CreateVolumesFromImageTest-135662986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-dcb2f9fd-9da9-4ef8-aa6f-928071947da8 tempest-CreateVolumesFromImageTest-135662986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:43 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-dcb2f9fd-9da9-4ef8-aa6f-928071947da8 tempest-CreateVolumesFromImageTest-135662986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:43 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-dcb2f9fd-9da9-4ef8-aa6f-928071947da8 tempest-CreateVolumesFromImageTest-135662986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-dcb2f9fd-9da9-4ef8-aa6f-928071947da8 tempest-CreateVolumesFromImageTest-135662986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dcb2f9fd-9da9-4ef8-aa6f-928071947da8 tempest-CreateVolumesFromImageTest-135662986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:43 devstack sudo[107689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:59:43 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:43 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88daa64b-f7cf-45d3-97f2-08b9d16b9646 tempest-ProjectReaderTests-655005113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1" returned: 0 in 0.519s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88daa64b-f7cf-45d3-97f2-08b9d16b9646 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1.e3d42beb-0bb0-4377-89c1-bce661a984b6 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:43 devstack sudo[107695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1.e3d42beb-0bb0-4377-89c1-bce661a984b6 1G Jul 31 10:59:43 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:43 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dcb2f9fd-9da9-4ef8-aa6f-928071947da8 tempest-CreateVolumesFromImageTest-135662986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.390s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:43 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-dcb2f9fd-9da9-4ef8-aa6f-928071947da8 tempest-CreateVolumesFromImageTest-135662986 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:43 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-dcb2f9fd-9da9-4ef8-aa6f-928071947da8 tempest-CreateVolumesFromImageTest-135662986 None] Deleted volume successfully. Jul 31 10:59:43 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-dcb2f9fd-9da9-4ef8-aa6f-928071947da8 tempest-CreateVolumesFromImageTest-135662986 None] Lock "cinder-00cd9021-a8f8-445f-a137-d2ae50b70e7f-delete_volume" released by "delete_volume" :: held 1.933s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:44 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-13b2c33a-e087-4465-affd-659dd0430ebc tempest-CreateVolumesFromImageTest-135662986 None] Acquiring lock "cinder-448b424b-33f4-468d-9338-309da94e7a66-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:44 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88daa64b-f7cf-45d3-97f2-08b9d16b9646 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1.e3d42beb-0bb0-4377-89c1-bce661a984b6 1G" returned: 0 in 0.616s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88daa64b-f7cf-45d3-97f2-08b9d16b9646 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1.e3d42beb-0bb0-4377-89c1-bce661a984b6 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:44 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-13b2c33a-e087-4465-affd-659dd0430ebc tempest-CreateVolumesFromImageTest-135662986 None] Lock "cinder-448b424b-33f4-468d-9338-309da94e7a66-delete_volume" acquired by "delete_volume" :: waited 0.146s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:44 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1.e3d42beb-0bb0-4377-89c1-bce661a984b6 Jul 31 10:59:44 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:44 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-13b2c33a-e087-4465-affd-659dd0430ebc tempest-CreateVolumesFromImageTest-135662986 None] Acquiring lock "cinder-quobyte-448b424b-33f4-468d-9338-309da94e7a66" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:44 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-13b2c33a-e087-4465-affd-659dd0430ebc tempest-CreateVolumesFromImageTest-135662986 None] Lock "cinder-quobyte-448b424b-33f4-468d-9338-309da94e7a66" acquired by "delete_volume" :: waited 0.026s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:44 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e9b3fd-36c8-403b-a457-a1f8c1dc1b80]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-13b2c33a-e087-4465-affd-659dd0430ebc tempest-CreateVolumesFromImageTest-135662986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-448b424b-33f4-468d-9338-309da94e7a66 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:44 devstack sudo[107703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-448b424b-33f4-468d-9338-309da94e7a66 Jul 31 10:59:44 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:44 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88daa64b-f7cf-45d3-97f2-08b9d16b9646 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1.e3d42beb-0bb0-4377-89c1-bce661a984b6" returned: 0 in 0.431s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:44 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-88daa64b-f7cf-45d3-97f2-08b9d16b9646 tempest-ProjectReaderTests-655005113 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1.e3d42beb-0bb0-4377-89c1-bce661a984b6 is being set with open permissions: ugo+rw Jul 31 10:59:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88daa64b-f7cf-45d3-97f2-08b9d16b9646 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1.e3d42beb-0bb0-4377-89c1-bce661a984b6 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:44 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1.e3d42beb-0bb0-4377-89c1-bce661a984b6 Jul 31 10:59:44 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:44 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-13b2c33a-e087-4465-affd-659dd0430ebc tempest-CreateVolumesFromImageTest-135662986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-448b424b-33f4-468d-9338-309da94e7a66" returned: 0 in 0.610s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-13b2c33a-e087-4465-affd-659dd0430ebc tempest-CreateVolumesFromImageTest-135662986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-448b424b-33f4-468d-9338-309da94e7a66 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:44 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-448b424b-33f4-468d-9338-309da94e7a66 Jul 31 10:59:44 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:44 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88daa64b-f7cf-45d3-97f2-08b9d16b9646 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1.e3d42beb-0bb0-4377-89c1-bce661a984b6" returned: 0 in 0.376s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88daa64b-f7cf-45d3-97f2-08b9d16b9646 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:45 devstack sudo[107716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1.info Jul 31 10:59:45 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:45 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-13b2c33a-e087-4465-affd-659dd0430ebc tempest-CreateVolumesFromImageTest-135662986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-448b424b-33f4-468d-9338-309da94e7a66" returned: 0 in 0.344s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:45 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-13b2c33a-e087-4465-affd-659dd0430ebc tempest-CreateVolumesFromImageTest-135662986 None] Lock "cinder-quobyte-448b424b-33f4-468d-9338-309da94e7a66" released by "delete_volume" :: held 1.025s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:45 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88daa64b-f7cf-45d3-97f2-08b9d16b9646 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1.info" returned: 0 in 0.334s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:45 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-88daa64b-f7cf-45d3-97f2-08b9d16b9646 tempest-ProjectReaderTests-655005113 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1.info is being set with open permissions: ugo+rw Jul 31 10:59:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88daa64b-f7cf-45d3-97f2-08b9d16b9646 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:45 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1.info Jul 31 10:59:45 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:45 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-13b2c33a-e087-4465-affd-659dd0430ebc tempest-CreateVolumesFromImageTest-135662986 None] Created reservations ['0fb3cc3e-f715-4b02-95e4-82cdc00a18c9', '41d371bf-d1d0-42a0-9e00-90bf59a07b0a', 'bfabc10a-02b5-419e-a8d5-15344634a70b', '81a3714b-f10e-4bb7-a0bc-2d7caf319048'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-13b2c33a-e087-4465-affd-659dd0430ebc tempest-CreateVolumesFromImageTest-135662986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-13b2c33a-e087-4465-affd-659dd0430ebc tempest-CreateVolumesFromImageTest-135662986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-13b2c33a-e087-4465-affd-659dd0430ebc tempest-CreateVolumesFromImageTest-135662986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-13b2c33a-e087-4465-affd-659dd0430ebc tempest-CreateVolumesFromImageTest-135662986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-13b2c33a-e087-4465-affd-659dd0430ebc tempest-CreateVolumesFromImageTest-135662986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-13b2c33a-e087-4465-affd-659dd0430ebc tempest-CreateVolumesFromImageTest-135662986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:45 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:59:45 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:45 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-88daa64b-f7cf-45d3-97f2-08b9d16b9646 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1.info" returned: 0 in 0.334s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-88daa64b-f7cf-45d3-97f2-08b9d16b9646 tempest-ProjectReaderTests-655005113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.755s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:45 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-88daa64b-f7cf-45d3-97f2-08b9d16b9646 tempest-ProjectReaderTests-655005113 None] Create snapshot completed successfully Jul 31 10:59:45 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-13b2c33a-e087-4465-affd-659dd0430ebc tempest-CreateVolumesFromImageTest-135662986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.336s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:45 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-13b2c33a-e087-4465-affd-659dd0430ebc tempest-CreateVolumesFromImageTest-135662986 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:45 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-13b2c33a-e087-4465-affd-659dd0430ebc tempest-CreateVolumesFromImageTest-135662986 None] Deleted volume successfully. Jul 31 10:59:45 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-13b2c33a-e087-4465-affd-659dd0430ebc tempest-CreateVolumesFromImageTest-135662986 None] Lock "cinder-448b424b-33f4-468d-9338-309da94e7a66-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:45 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:59:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:46 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:59:46 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a3cc06ae-b08d-45b1-8d08-c9c7129f9041 tempest-ProjectReaderTests-655005113 None] Acquiring lock "cinder-e3d42beb-0bb0-4377-89c1-bce661a984b6-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a3cc06ae-b08d-45b1-8d08-c9c7129f9041 tempest-ProjectReaderTests-655005113 None] Lock "cinder-e3d42beb-0bb0-4377-89c1-bce661a984b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a3cc06ae-b08d-45b1-8d08-c9c7129f9041 tempest-ProjectReaderTests-655005113 None] Acquiring lock "cinder-quobyte-9be8ce48-5f9d-4f03-a570-1173b47b9dd1" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a3cc06ae-b08d-45b1-8d08-c9c7129f9041 tempest-ProjectReaderTests-655005113 None] Lock "cinder-quobyte-9be8ce48-5f9d-4f03-a570-1173b47b9dd1" acquired by "delete_snapshot" :: waited 0.028s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a3cc06ae-b08d-45b1-8d08-c9c7129f9041 tempest-ProjectReaderTests-655005113 None] Acquiring lock "cinder-quobyte-e3d42beb-0bb0-4377-89c1-bce661a984b6" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a3cc06ae-b08d-45b1-8d08-c9c7129f9041 tempest-ProjectReaderTests-655005113 None] Lock "cinder-quobyte-e3d42beb-0bb0-4377-89c1-bce661a984b6" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-a3cc06ae-b08d-45b1-8d08-c9c7129f9041 tempest-ProjectReaderTests-655005113 None] Deleting offline snapshot e3d42beb-0bb0-4377-89c1-bce661a984b6 of volume 9be8ce48-5f9d-4f03-a570-1173b47b9dd1 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-a3cc06ae-b08d-45b1-8d08-c9c7129f9041 tempest-ProjectReaderTests-655005113 None] snapshot_file for this snap is: volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1.e3d42beb-0bb0-4377-89c1-bce661a984b6 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce325d71-7d15-45c7-8911-94cc33d34dd0]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a3cc06ae-b08d-45b1-8d08-c9c7129f9041 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1.e3d42beb-0bb0-4377-89c1-bce661a984b6 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:46 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.331s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager._thread_info {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread count: 28 {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread info: [<_MainThread(MainThread, started 134005426110592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-fc927080-a7f4-48b5-b591-f3cbbf9ce1ba tempest-CreateVolumesFromImageTest-135662986 None] Acquiring lock "cinder-8c0d9a86-3cbc-4222-8b08-8ea9ae15e8ac-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-fc927080-a7f4-48b5-b591-f3cbbf9ce1ba tempest-CreateVolumesFromImageTest-135662986 None] Lock "cinder-8c0d9a86-3cbc-4222-8b08-8ea9ae15e8ac-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:46 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1.e3d42beb-0bb0-4377-89c1-bce661a984b6 Jul 31 10:59:46 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bd8ee5d-8731-499f-8ffc-583999653eed tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0bd8ee5d-8731-499f-8ffc-583999653eed tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Flow 'volume_create_manager' (473d2125-1237-4659-aa13-8ff429445d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0bd8ee5d-8731-499f-8ffc-583999653eed tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (257fcf84-83ba-4d1d-add3-b9c30016f8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-fc927080-a7f4-48b5-b591-f3cbbf9ce1ba tempest-CreateVolumesFromImageTest-135662986 None] Acquiring lock "cinder-quobyte-8c0d9a86-3cbc-4222-8b08-8ea9ae15e8ac" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0bd8ee5d-8731-499f-8ffc-583999653eed tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (257fcf84-83ba-4d1d-add3-b9c30016f8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-937996841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f30dda02-eaf7-45d4-a1bc-f528a7635215,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d5fa925bdf34f50b4829410c639b5d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:46Z,use_quota=True,user_id='61375c26160947e1959b624bfc2c9d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0bd8ee5d-8731-499f-8ffc-583999653eed tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d4fe69-0e8f-43a1-bca8-d839ac5a954e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0bd8ee5d-8731-499f-8ffc-583999653eed tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d4fe69-0e8f-43a1-bca8-d839ac5a954e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0bd8ee5d-8731-499f-8ffc-583999653eed tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (682a92d8-2f48-4ba4-aa03-1c0bf5fbfaea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0bd8ee5d-8731-499f-8ffc-583999653eed tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (682a92d8-2f48-4ba4-aa03-1c0bf5fbfaea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f30dda02-eaf7-45d4-a1bc-f528a7635215', 'volume_name': 'volume-f30dda02-eaf7-45d4-a1bc-f528a7635215', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0bd8ee5d-8731-499f-8ffc-583999653eed tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2774ec9-b4fa-44fe-8ef5-1db35c8630a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0bd8ee5d-8731-499f-8ffc-583999653eed tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2774ec9-b4fa-44fe-8ef5-1db35c8630a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0bd8ee5d-8731-499f-8ffc-583999653eed tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8b7c259-f01a-4943-bf0e-229187676b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:46 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-0bd8ee5d-8731-499f-8ffc-583999653eed tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Volume f30dda02-eaf7-45d4-a1bc-f528a7635215: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f30dda02-eaf7-45d4-a1bc-f528a7635215', 'volume_size': 1} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0bd8ee5d-8731-499f-8ffc-583999653eed tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0bd8ee5d-8731-499f-8ffc-583999653eed tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0bd8ee5d-8731-499f-8ffc-583999653eed tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-937996841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f30dda02-eaf7-45d4-a1bc-f528a7635215,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d5fa925bdf34f50b4829410c639b5d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:46Z,use_quota=True,user_id='61375c26160947e1959b624bfc2c9d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-0bd8ee5d-8731-499f-8ffc-583999653eed tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Creating volume f30dda02-eaf7-45d4-a1bc-f528a7635215 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0bd8ee5d-8731-499f-8ffc-583999653eed tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0bd8ee5d-8731-499f-8ffc-583999653eed tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0bd8ee5d-8731-499f-8ffc-583999653eed tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0bd8ee5d-8731-499f-8ffc-583999653eed tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0bd8ee5d-8731-499f-8ffc-583999653eed tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0bd8ee5d-8731-499f-8ffc-583999653eed tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:59:46 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-0bd8ee5d-8731-499f-8ffc-583999653eed tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0bd8ee5d-8731-499f-8ffc-583999653eed tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f30dda02-eaf7-45d4-a1bc-f528a7635215 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-fc927080-a7f4-48b5-b591-f3cbbf9ce1ba tempest-CreateVolumesFromImageTest-135662986 None] Lock "cinder-quobyte-8c0d9a86-3cbc-4222-8b08-8ea9ae15e8ac" acquired by "delete_volume" :: waited 0.077s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:46 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f30dda02-eaf7-45d4-a1bc-f528a7635215 1073741824 Jul 31 10:59:46 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc73901-a3cf-4c15-ae34-19975cffe71d]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fc927080-a7f4-48b5-b591-f3cbbf9ce1ba tempest-CreateVolumesFromImageTest-135662986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8c0d9a86-3cbc-4222-8b08-8ea9ae15e8ac {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:46 devstack sudo[107734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8c0d9a86-3cbc-4222-8b08-8ea9ae15e8ac Jul 31 10:59:46 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:46 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a3cc06ae-b08d-45b1-8d08-c9c7129f9041 tempest-ProjectReaderTests-655005113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1.e3d42beb-0bb0-4377-89c1-bce661a984b6" returned: 0 in 0.499s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-a3cc06ae-b08d-45b1-8d08-c9c7129f9041 tempest-ProjectReaderTests-655005113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5935ee-769a-4cd0-afdf-d02a16a8d3a0]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a3cc06ae-b08d-45b1-8d08-c9c7129f9041 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:46 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1 Jul 31 10:59:46 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:47 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fc927080-a7f4-48b5-b591-f3cbbf9ce1ba tempest-CreateVolumesFromImageTest-135662986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8c0d9a86-3cbc-4222-8b08-8ea9ae15e8ac" returned: 0 in 0.434s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fc927080-a7f4-48b5-b591-f3cbbf9ce1ba tempest-CreateVolumesFromImageTest-135662986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8c0d9a86-3cbc-4222-8b08-8ea9ae15e8ac {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:47 devstack sudo[107748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8c0d9a86-3cbc-4222-8b08-8ea9ae15e8ac Jul 31 10:59:47 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:47 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0bd8ee5d-8731-499f-8ffc-583999653eed tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f30dda02-eaf7-45d4-a1bc-f528a7635215 1073741824" returned: 0 in 0.534s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0bd8ee5d-8731-499f-8ffc-583999653eed tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f30dda02-eaf7-45d4-a1bc-f528a7635215 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:47 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a3cc06ae-b08d-45b1-8d08-c9c7129f9041 tempest-ProjectReaderTests-655005113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1" returned: 0 in 0.437s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a3cc06ae-b08d-45b1-8d08-c9c7129f9041 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1.e3d42beb-0bb0-4377-89c1-bce661a984b6 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:47 devstack sudo[107753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f30dda02-eaf7-45d4-a1bc-f528a7635215 Jul 31 10:59:47 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:47 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1.e3d42beb-0bb0-4377-89c1-bce661a984b6 Jul 31 10:59:47 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:47 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fc927080-a7f4-48b5-b591-f3cbbf9ce1ba tempest-CreateVolumesFromImageTest-135662986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8c0d9a86-3cbc-4222-8b08-8ea9ae15e8ac" returned: 0 in 0.341s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:47 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-fc927080-a7f4-48b5-b591-f3cbbf9ce1ba tempest-CreateVolumesFromImageTest-135662986 None] Lock "cinder-quobyte-8c0d9a86-3cbc-4222-8b08-8ea9ae15e8ac" released by "delete_volume" :: held 0.835s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:47 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-0bd8ee5d-8731-499f-8ffc-583999653eed tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f30dda02-eaf7-45d4-a1bc-f528a7635215" returned: 0 in 0.322s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:47 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-0bd8ee5d-8731-499f-8ffc-583999653eed tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-0bd8ee5d-8731-499f-8ffc-583999653eed tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:47 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-fc927080-a7f4-48b5-b591-f3cbbf9ce1ba tempest-CreateVolumesFromImageTest-135662986 None] Created reservations ['f6a90745-ab10-4860-84a8-babf5baa5de9', 'ac47b2e0-d586-421f-b61a-64b33cc3125d', '50156da2-286c-4b1e-af7e-864e59253961', 'a112340d-e09d-4a9e-a88f-e48282cf0b4e'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:47 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0bd8ee5d-8731-499f-8ffc-583999653eed tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8b7c259-f01a-4943-bf0e-229187676b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f30dda02-eaf7-45d4-a1bc-f528a7635215', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:47 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0bd8ee5d-8731-499f-8ffc-583999653eed tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3edf604-b9be-4384-8545-adc6529af426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:47 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-0bd8ee5d-8731-499f-8ffc-583999653eed tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Volume volume-f30dda02-eaf7-45d4-a1bc-f528a7635215 (f30dda02-eaf7-45d4-a1bc-f528a7635215): created successfully Jul 31 10:59:47 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0bd8ee5d-8731-499f-8ffc-583999653eed tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3edf604-b9be-4384-8545-adc6529af426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:47 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-0bd8ee5d-8731-499f-8ffc-583999653eed tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Flow 'volume_create_manager' (473d2125-1237-4659-aa13-8ff429445d92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:47 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-0bd8ee5d-8731-499f-8ffc-583999653eed tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Created volume successfully. Jul 31 10:59:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-fc927080-a7f4-48b5-b591-f3cbbf9ce1ba tempest-CreateVolumesFromImageTest-135662986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-fc927080-a7f4-48b5-b591-f3cbbf9ce1ba tempest-CreateVolumesFromImageTest-135662986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:47 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-fc927080-a7f4-48b5-b591-f3cbbf9ce1ba tempest-CreateVolumesFromImageTest-135662986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:47 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-fc927080-a7f4-48b5-b591-f3cbbf9ce1ba tempest-CreateVolumesFromImageTest-135662986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-fc927080-a7f4-48b5-b591-f3cbbf9ce1ba tempest-CreateVolumesFromImageTest-135662986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fc927080-a7f4-48b5-b591-f3cbbf9ce1ba tempest-CreateVolumesFromImageTest-135662986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:47 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:59:47 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:47 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a3cc06ae-b08d-45b1-8d08-c9c7129f9041 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1.e3d42beb-0bb0-4377-89c1-bce661a984b6" returned: 0 in 0.502s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a3cc06ae-b08d-45b1-8d08-c9c7129f9041 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1.e3d42beb-0bb0-4377-89c1-bce661a984b6 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:47 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1.e3d42beb-0bb0-4377-89c1-bce661a984b6 Jul 31 10:59:47 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:48 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fc927080-a7f4-48b5-b591-f3cbbf9ce1ba tempest-CreateVolumesFromImageTest-135662986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.319s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:48 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-fc927080-a7f4-48b5-b591-f3cbbf9ce1ba tempest-CreateVolumesFromImageTest-135662986 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:48 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-fc927080-a7f4-48b5-b591-f3cbbf9ce1ba tempest-CreateVolumesFromImageTest-135662986 None] Deleted volume successfully. Jul 31 10:59:48 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a3cc06ae-b08d-45b1-8d08-c9c7129f9041 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1.e3d42beb-0bb0-4377-89c1-bce661a984b6" returned: 0 in 0.301s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:48 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a3cc06ae-b08d-45b1-8d08-c9c7129f9041 tempest-ProjectReaderTests-655005113 None] Lock "cinder-quobyte-e3d42beb-0bb0-4377-89c1-bce661a984b6" released by "_delete_snapshot" :: held 1.892s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:48 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-fc927080-a7f4-48b5-b591-f3cbbf9ce1ba tempest-CreateVolumesFromImageTest-135662986 None] Lock "cinder-8c0d9a86-3cbc-4222-8b08-8ea9ae15e8ac-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:48 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a3cc06ae-b08d-45b1-8d08-c9c7129f9041 tempest-ProjectReaderTests-655005113 None] Lock "cinder-quobyte-9be8ce48-5f9d-4f03-a570-1173b47b9dd1" released by "delete_snapshot" :: held 1.934s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:48 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-a3cc06ae-b08d-45b1-8d08-c9c7129f9041 tempest-ProjectReaderTests-655005113 None] Created reservations ['72dc6925-a9f0-4e87-955a-17ab40c79029', '4cbbe05c-ed54-4559-a52d-ce2a98162756', 'cc0394ed-64be-481a-a0cf-c232f208d19c', '5eb65c22-0295-4359-a626-f5d35fa5a51d'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:48 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-a3cc06ae-b08d-45b1-8d08-c9c7129f9041 tempest-ProjectReaderTests-655005113 None] Delete snapshot completed successfully. Jul 31 10:59:48 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-a3cc06ae-b08d-45b1-8d08-c9c7129f9041 tempest-ProjectReaderTests-655005113 None] Lock "cinder-e3d42beb-0bb0-4377-89c1-bce661a984b6-delete_snapshot" released by "delete_snapshot" :: held 2.164s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:48 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-593f4a79-2744-4cdc-935b-5981bf966ea9 tempest-ProjectReaderTests-655005113 None] Acquiring lock "cinder-9be8ce48-5f9d-4f03-a570-1173b47b9dd1-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:48 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-593f4a79-2744-4cdc-935b-5981bf966ea9 tempest-ProjectReaderTests-655005113 None] Lock "cinder-9be8ce48-5f9d-4f03-a570-1173b47b9dd1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:48 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-593f4a79-2744-4cdc-935b-5981bf966ea9 tempest-ProjectReaderTests-655005113 None] Acquiring lock "cinder-quobyte-9be8ce48-5f9d-4f03-a570-1173b47b9dd1" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:48 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-593f4a79-2744-4cdc-935b-5981bf966ea9 tempest-ProjectReaderTests-655005113 None] Lock "cinder-quobyte-9be8ce48-5f9d-4f03-a570-1173b47b9dd1" acquired by "delete_volume" :: waited 0.027s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:48 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[670d3ec0-56c0-4a5f-b551-f1afd7f910af]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-593f4a79-2744-4cdc-935b-5981bf966ea9 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:48 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1 Jul 31 10:59:48 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:48 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f54522f-7adc-41d9-9db2-dfd16ddc40a4 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2f54522f-7adc-41d9-9db2-dfd16ddc40a4 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Flow 'volume_create_manager' (b2722091-134d-4eb6-9165-0df84d023a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2f54522f-7adc-41d9-9db2-dfd16ddc40a4 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c06a7bea-7e77-4dce-93f4-0407e10023db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2f54522f-7adc-41d9-9db2-dfd16ddc40a4 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c06a7bea-7e77-4dce-93f4-0407e10023db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1151783862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6bfaa45-5a1a-4e4a-84e6-d803019e073b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d5fa925bdf34f50b4829410c639b5d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:49Z,use_quota=True,user_id='61375c26160947e1959b624bfc2c9d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2f54522f-7adc-41d9-9db2-dfd16ddc40a4 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7ba4163-5d30-4d47-ad22-65c3dc5d9ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2f54522f-7adc-41d9-9db2-dfd16ddc40a4 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7ba4163-5d30-4d47-ad22-65c3dc5d9ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2f54522f-7adc-41d9-9db2-dfd16ddc40a4 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2558e165-5b23-4961-89a1-219f9ca0154a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2f54522f-7adc-41d9-9db2-dfd16ddc40a4 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2558e165-5b23-4961-89a1-219f9ca0154a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6bfaa45-5a1a-4e4a-84e6-d803019e073b', 'volume_name': 'volume-a6bfaa45-5a1a-4e4a-84e6-d803019e073b', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2f54522f-7adc-41d9-9db2-dfd16ddc40a4 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6d343ba-2edf-436a-84e3-b5948856ad29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2f54522f-7adc-41d9-9db2-dfd16ddc40a4 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6d343ba-2edf-436a-84e3-b5948856ad29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:48 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2f54522f-7adc-41d9-9db2-dfd16ddc40a4 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e91a85c-88d3-43b2-8f43-2850acc7a907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:48 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-2f54522f-7adc-41d9-9db2-dfd16ddc40a4 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Volume a6bfaa45-5a1a-4e4a-84e6-d803019e073b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6bfaa45-5a1a-4e4a-84e6-d803019e073b', 'volume_size': 1} Jul 31 10:59:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2f54522f-7adc-41d9-9db2-dfd16ddc40a4 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2f54522f-7adc-41d9-9db2-dfd16ddc40a4 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:48 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2f54522f-7adc-41d9-9db2-dfd16ddc40a4 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1151783862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6bfaa45-5a1a-4e4a-84e6-d803019e073b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d5fa925bdf34f50b4829410c639b5d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:49Z,use_quota=True,user_id='61375c26160947e1959b624bfc2c9d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:48 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-2f54522f-7adc-41d9-9db2-dfd16ddc40a4 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Creating volume a6bfaa45-5a1a-4e4a-84e6-d803019e073b {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2f54522f-7adc-41d9-9db2-dfd16ddc40a4 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2f54522f-7adc-41d9-9db2-dfd16ddc40a4 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:48 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2f54522f-7adc-41d9-9db2-dfd16ddc40a4 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:48 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2f54522f-7adc-41d9-9db2-dfd16ddc40a4 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2f54522f-7adc-41d9-9db2-dfd16ddc40a4 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:48 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2f54522f-7adc-41d9-9db2-dfd16ddc40a4 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:59:48 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-2f54522f-7adc-41d9-9db2-dfd16ddc40a4 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:59:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2f54522f-7adc-41d9-9db2-dfd16ddc40a4 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a6bfaa45-5a1a-4e4a-84e6-d803019e073b 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:49 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-593f4a79-2744-4cdc-935b-5981bf966ea9 tempest-ProjectReaderTests-655005113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1" returned: 0 in 0.491s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-593f4a79-2744-4cdc-935b-5981bf966ea9 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:49 devstack sudo[107775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a6bfaa45-5a1a-4e4a-84e6-d803019e073b 1073741824 Jul 31 10:59:49 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:49 devstack sudo[107777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1 Jul 31 10:59:49 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:49 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-593f4a79-2744-4cdc-935b-5981bf966ea9 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9be8ce48-5f9d-4f03-a570-1173b47b9dd1" returned: 0 in 0.440s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:49 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-593f4a79-2744-4cdc-935b-5981bf966ea9 tempest-ProjectReaderTests-655005113 None] Lock "cinder-quobyte-9be8ce48-5f9d-4f03-a570-1173b47b9dd1" released by "delete_volume" :: held 1.041s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:49 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-afe3cd49-e051-4b69-8bb2-dfe4c5c34876 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-afe3cd49-e051-4b69-8bb2-dfe4c5c34876 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Flow 'volume_create_manager' (4316cf96-670a-4ce9-a448-518ffbcc93cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-afe3cd49-e051-4b69-8bb2-dfe4c5c34876 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd8a621d-8c01-489a-8eab-3ff20ea52449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:49 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-afe3cd49-e051-4b69-8bb2-dfe4c5c34876 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd8a621d-8c01-489a-8eab-3ff20ea52449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1898942167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20e88800-3937-405e-bc79-0732b3eb6935,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d5fa925bdf34f50b4829410c639b5d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:49Z,use_quota=True,user_id='61375c26160947e1959b624bfc2c9d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-afe3cd49-e051-4b69-8bb2-dfe4c5c34876 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75ac5e84-36b5-4986-8ab7-3a016346e6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-afe3cd49-e051-4b69-8bb2-dfe4c5c34876 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75ac5e84-36b5-4986-8ab7-3a016346e6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-afe3cd49-e051-4b69-8bb2-dfe4c5c34876 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (243673fa-362b-499c-9f41-c9e8e035ea2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-afe3cd49-e051-4b69-8bb2-dfe4c5c34876 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (243673fa-362b-499c-9f41-c9e8e035ea2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20e88800-3937-405e-bc79-0732b3eb6935', 'volume_name': 'volume-20e88800-3937-405e-bc79-0732b3eb6935', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-afe3cd49-e051-4b69-8bb2-dfe4c5c34876 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8987f781-36ec-4898-87ad-4ead0885d2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-afe3cd49-e051-4b69-8bb2-dfe4c5c34876 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8987f781-36ec-4898-87ad-4ead0885d2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:49 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-afe3cd49-e051-4b69-8bb2-dfe4c5c34876 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91646c29-0fca-4536-a8a5-962d13260be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:49 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-afe3cd49-e051-4b69-8bb2-dfe4c5c34876 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Volume 20e88800-3937-405e-bc79-0732b3eb6935: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20e88800-3937-405e-bc79-0732b3eb6935', 'volume_size': 1} Jul 31 10:59:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-afe3cd49-e051-4b69-8bb2-dfe4c5c34876 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2f54522f-7adc-41d9-9db2-dfd16ddc40a4 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a6bfaa45-5a1a-4e4a-84e6-d803019e073b 1073741824" returned: 0 in 0.827s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2f54522f-7adc-41d9-9db2-dfd16ddc40a4 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a6bfaa45-5a1a-4e4a-84e6-d803019e073b {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:49 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-593f4a79-2744-4cdc-935b-5981bf966ea9 tempest-ProjectReaderTests-655005113 None] Created reservations ['a0ae47cb-6ac7-4803-9074-405b62dbe053', '34a804f3-aa40-4e6e-9904-0c99e71d9a70', 'e77564a3-9cee-4522-ac5d-61bd553e6b58', '4118701a-b463-4530-8025-3217c5d9ad90'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:49 devstack sudo[107784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a6bfaa45-5a1a-4e4a-84e6-d803019e073b Jul 31 10:59:49 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:50 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9b89f05-b35c-4d34-938c-143fa8b4f7a6 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a9b89f05-b35c-4d34-938c-143fa8b4f7a6 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Flow 'volume_create_manager' (a55ca738-9336-4124-9be2-d660253095f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a9b89f05-b35c-4d34-938c-143fa8b4f7a6 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d78b3c2b-8ef7-4f2a-bf10-d5d8a7da879a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-593f4a79-2744-4cdc-935b-5981bf966ea9 tempest-ProjectReaderTests-655005113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-593f4a79-2744-4cdc-935b-5981bf966ea9 tempest-ProjectReaderTests-655005113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:50 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-593f4a79-2744-4cdc-935b-5981bf966ea9 tempest-ProjectReaderTests-655005113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:50 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-593f4a79-2744-4cdc-935b-5981bf966ea9 tempest-ProjectReaderTests-655005113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-593f4a79-2744-4cdc-935b-5981bf966ea9 tempest-ProjectReaderTests-655005113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-593f4a79-2744-4cdc-935b-5981bf966ea9 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a9b89f05-b35c-4d34-938c-143fa8b4f7a6 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d78b3c2b-8ef7-4f2a-bf10-d5d8a7da879a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1660924563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a941190-f817-4ff5-9408-01417e1321cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d5fa925bdf34f50b4829410c639b5d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:50Z,use_quota=True,user_id='61375c26160947e1959b624bfc2c9d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a9b89f05-b35c-4d34-938c-143fa8b4f7a6 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c21173-b5dd-46c7-a6c6-b48bb0d02faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a9b89f05-b35c-4d34-938c-143fa8b4f7a6 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c21173-b5dd-46c7-a6c6-b48bb0d02faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:50 devstack sudo[107786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:59:50 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a9b89f05-b35c-4d34-938c-143fa8b4f7a6 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04256be4-46ef-40e9-ab85-7388d51fc66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a9b89f05-b35c-4d34-938c-143fa8b4f7a6 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04256be4-46ef-40e9-ab85-7388d51fc66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a941190-f817-4ff5-9408-01417e1321cf', 'volume_name': 'volume-8a941190-f817-4ff5-9408-01417e1321cf', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a9b89f05-b35c-4d34-938c-143fa8b4f7a6 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a107591-04eb-42ee-b10f-0f45e67d1e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a9b89f05-b35c-4d34-938c-143fa8b4f7a6 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a107591-04eb-42ee-b10f-0f45e67d1e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a9b89f05-b35c-4d34-938c-143fa8b4f7a6 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3670281-7c6f-4d02-adfe-912fce40a5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:50 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-a9b89f05-b35c-4d34-938c-143fa8b4f7a6 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Volume 8a941190-f817-4ff5-9408-01417e1321cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a941190-f817-4ff5-9408-01417e1321cf', 'volume_size': 1} Jul 31 10:59:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a9b89f05-b35c-4d34-938c-143fa8b4f7a6 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:50 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2f54522f-7adc-41d9-9db2-dfd16ddc40a4 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a6bfaa45-5a1a-4e4a-84e6-d803019e073b" returned: 0 in 0.519s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:50 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2f54522f-7adc-41d9-9db2-dfd16ddc40a4 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2f54522f-7adc-41d9-9db2-dfd16ddc40a4 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-afe3cd49-e051-4b69-8bb2-dfe4c5c34876 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.627s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:50 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-afe3cd49-e051-4b69-8bb2-dfe4c5c34876 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1898942167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20e88800-3937-405e-bc79-0732b3eb6935,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d5fa925bdf34f50b4829410c639b5d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:49Z,use_quota=True,user_id='61375c26160947e1959b624bfc2c9d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:50 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-afe3cd49-e051-4b69-8bb2-dfe4c5c34876 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Creating volume 20e88800-3937-405e-bc79-0732b3eb6935 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-afe3cd49-e051-4b69-8bb2-dfe4c5c34876 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-afe3cd49-e051-4b69-8bb2-dfe4c5c34876 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:50 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-afe3cd49-e051-4b69-8bb2-dfe4c5c34876 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:50 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-afe3cd49-e051-4b69-8bb2-dfe4c5c34876 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-afe3cd49-e051-4b69-8bb2-dfe4c5c34876 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:50 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-afe3cd49-e051-4b69-8bb2-dfe4c5c34876 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:59:50 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-afe3cd49-e051-4b69-8bb2-dfe4c5c34876 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:59:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-afe3cd49-e051-4b69-8bb2-dfe4c5c34876 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-20e88800-3937-405e-bc79-0732b3eb6935 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:50 devstack sudo[107789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-20e88800-3937-405e-bc79-0732b3eb6935 1073741824 Jul 31 10:59:50 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2f54522f-7adc-41d9-9db2-dfd16ddc40a4 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e91a85c-88d3-43b2-8f43-2850acc7a907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6bfaa45-5a1a-4e4a-84e6-d803019e073b', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2f54522f-7adc-41d9-9db2-dfd16ddc40a4 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f86dd133-f9d8-41be-a1d3-e3d5115dc1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:50 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-2f54522f-7adc-41d9-9db2-dfd16ddc40a4 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Volume volume-a6bfaa45-5a1a-4e4a-84e6-d803019e073b (a6bfaa45-5a1a-4e4a-84e6-d803019e073b): created successfully Jul 31 10:59:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2f54522f-7adc-41d9-9db2-dfd16ddc40a4 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f86dd133-f9d8-41be-a1d3-e3d5115dc1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:50 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2f54522f-7adc-41d9-9db2-dfd16ddc40a4 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Flow 'volume_create_manager' (b2722091-134d-4eb6-9165-0df84d023a57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:50 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-2f54522f-7adc-41d9-9db2-dfd16ddc40a4 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Created volume successfully. Jul 31 10:59:50 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-593f4a79-2744-4cdc-935b-5981bf966ea9 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.696s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:50 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-593f4a79-2744-4cdc-935b-5981bf966ea9 tempest-ProjectReaderTests-655005113 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:50 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-593f4a79-2744-4cdc-935b-5981bf966ea9 tempest-ProjectReaderTests-655005113 None] Deleted volume successfully. Jul 31 10:59:50 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaf7a73c-c1da-4315-a731-75381bdca71f tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-aaf7a73c-c1da-4315-a731-75381bdca71f tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Flow 'volume_create_manager' (096bde87-e953-4490-bfd0-cba42c78fb0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-aaf7a73c-c1da-4315-a731-75381bdca71f tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (067052d9-a9cd-410b-adb3-e36919b6bf6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-593f4a79-2744-4cdc-935b-5981bf966ea9 tempest-ProjectReaderTests-655005113 None] Lock "cinder-9be8ce48-5f9d-4f03-a570-1173b47b9dd1-delete_volume" released by "delete_volume" :: held 2.649s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-aaf7a73c-c1da-4315-a731-75381bdca71f tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (067052d9-a9cd-410b-adb3-e36919b6bf6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1209341243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4245b7b0-2dc4-4b44-9017-756634241a84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d5fa925bdf34f50b4829410c639b5d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:51Z,use_quota=True,user_id='61375c26160947e1959b624bfc2c9d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-aaf7a73c-c1da-4315-a731-75381bdca71f tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb1f14fe-bd2f-46bd-9e16-67c0447687e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-aaf7a73c-c1da-4315-a731-75381bdca71f tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb1f14fe-bd2f-46bd-9e16-67c0447687e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-aaf7a73c-c1da-4315-a731-75381bdca71f tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2721e833-1b34-41c3-8778-7bc87e177f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-aaf7a73c-c1da-4315-a731-75381bdca71f tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2721e833-1b34-41c3-8778-7bc87e177f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4245b7b0-2dc4-4b44-9017-756634241a84', 'volume_name': 'volume-4245b7b0-2dc4-4b44-9017-756634241a84', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-aaf7a73c-c1da-4315-a731-75381bdca71f tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (290dcb5b-9c99-4a69-8856-d25ea184a3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-aaf7a73c-c1da-4315-a731-75381bdca71f tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (290dcb5b-9c99-4a69-8856-d25ea184a3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-aaf7a73c-c1da-4315-a731-75381bdca71f tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aa140c0-9af3-497e-a34c-6f4cf07b5c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:51 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-aaf7a73c-c1da-4315-a731-75381bdca71f tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Volume 4245b7b0-2dc4-4b44-9017-756634241a84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4245b7b0-2dc4-4b44-9017-756634241a84', 'volume_size': 1} Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-aaf7a73c-c1da-4315-a731-75381bdca71f tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:51 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-afe3cd49-e051-4b69-8bb2-dfe4c5c34876 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-20e88800-3937-405e-bc79-0732b3eb6935 1073741824" returned: 0 in 0.779s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-afe3cd49-e051-4b69-8bb2-dfe4c5c34876 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-20e88800-3937-405e-bc79-0732b3eb6935 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:51 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-20e88800-3937-405e-bc79-0732b3eb6935 Jul 31 10:59:51 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:51 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-afe3cd49-e051-4b69-8bb2-dfe4c5c34876 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-20e88800-3937-405e-bc79-0732b3eb6935" returned: 0 in 0.411s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-afe3cd49-e051-4b69-8bb2-dfe4c5c34876 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-afe3cd49-e051-4b69-8bb2-dfe4c5c34876 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a9b89f05-b35c-4d34-938c-143fa8b4f7a6 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.391s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a9b89f05-b35c-4d34-938c-143fa8b4f7a6 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1660924563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a941190-f817-4ff5-9408-01417e1321cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d5fa925bdf34f50b4829410c639b5d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:50Z,use_quota=True,user_id='61375c26160947e1959b624bfc2c9d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-a9b89f05-b35c-4d34-938c-143fa8b4f7a6 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Creating volume 8a941190-f817-4ff5-9408-01417e1321cf {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a9b89f05-b35c-4d34-938c-143fa8b4f7a6 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a9b89f05-b35c-4d34-938c-143fa8b4f7a6 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a9b89f05-b35c-4d34-938c-143fa8b4f7a6 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a9b89f05-b35c-4d34-938c-143fa8b4f7a6 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a9b89f05-b35c-4d34-938c-143fa8b4f7a6 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a9b89f05-b35c-4d34-938c-143fa8b4f7a6 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:59:51 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-a9b89f05-b35c-4d34-938c-143fa8b4f7a6 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a9b89f05-b35c-4d34-938c-143fa8b4f7a6 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8a941190-f817-4ff5-9408-01417e1321cf 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:51 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8a941190-f817-4ff5-9408-01417e1321cf 1073741824 Jul 31 10:59:51 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-afe3cd49-e051-4b69-8bb2-dfe4c5c34876 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91646c29-0fca-4536-a8a5-962d13260be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20e88800-3937-405e-bc79-0732b3eb6935', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-afe3cd49-e051-4b69-8bb2-dfe4c5c34876 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19291a9e-f41b-4577-9ee6-6cb5e3dc5e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:51 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-afe3cd49-e051-4b69-8bb2-dfe4c5c34876 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Volume volume-20e88800-3937-405e-bc79-0732b3eb6935 (20e88800-3937-405e-bc79-0732b3eb6935): created successfully Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-afe3cd49-e051-4b69-8bb2-dfe4c5c34876 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19291a9e-f41b-4577-9ee6-6cb5e3dc5e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-afe3cd49-e051-4b69-8bb2-dfe4c5c34876 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Flow 'volume_create_manager' (4316cf96-670a-4ce9-a448-518ffbcc93cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-39ff2305-aa6c-4ccb-806e-52ea3d93e324 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-39ff2305-aa6c-4ccb-806e-52ea3d93e324 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Flow 'volume_create_manager' (bad1a99a-b08d-41d1-ab31-9f241c5fcf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-39ff2305-aa6c-4ccb-806e-52ea3d93e324 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fd1b405-8e3b-4bcc-895b-f92c132ce20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:51 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-afe3cd49-e051-4b69-8bb2-dfe4c5c34876 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Created volume successfully. Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-39ff2305-aa6c-4ccb-806e-52ea3d93e324 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fd1b405-8e3b-4bcc-895b-f92c132ce20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1373292035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90f80ca4-7e82-4408-80f1-72cf4c0e2c6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d5fa925bdf34f50b4829410c639b5d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:52Z,use_quota=True,user_id='61375c26160947e1959b624bfc2c9d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-39ff2305-aa6c-4ccb-806e-52ea3d93e324 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd32754-106d-4830-b42a-c1f0ad93ceb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-39ff2305-aa6c-4ccb-806e-52ea3d93e324 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd32754-106d-4830-b42a-c1f0ad93ceb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-39ff2305-aa6c-4ccb-806e-52ea3d93e324 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (770a92fd-4a1d-4c23-981a-24a4aa8e18c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-39ff2305-aa6c-4ccb-806e-52ea3d93e324 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (770a92fd-4a1d-4c23-981a-24a4aa8e18c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90f80ca4-7e82-4408-80f1-72cf4c0e2c6f', 'volume_name': 'volume-90f80ca4-7e82-4408-80f1-72cf4c0e2c6f', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-39ff2305-aa6c-4ccb-806e-52ea3d93e324 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c79f9258-1b71-4eba-ac22-acf979519864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-39ff2305-aa6c-4ccb-806e-52ea3d93e324 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c79f9258-1b71-4eba-ac22-acf979519864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-39ff2305-aa6c-4ccb-806e-52ea3d93e324 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7c19d99-df81-46fd-9440-68af8ef09c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:51 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-39ff2305-aa6c-4ccb-806e-52ea3d93e324 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Volume 90f80ca4-7e82-4408-80f1-72cf4c0e2c6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90f80ca4-7e82-4408-80f1-72cf4c0e2c6f', 'volume_size': 1} Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-39ff2305-aa6c-4ccb-806e-52ea3d93e324 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:51 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e53143e-2f3e-4ad2-90c0-dc03e4a95106 tempest-ProjectReaderTests-655005113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-8e53143e-2f3e-4ad2-90c0-dc03e4a95106 tempest-ProjectReaderTests-655005113 None] Flow 'volume_create_manager' (9717f6f4-6b42-47f8-a8aa-b83e879daa49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-8e53143e-2f3e-4ad2-90c0-dc03e4a95106 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b7dbf1c-610b-4e48-836d-8d0953128967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-8e53143e-2f3e-4ad2-90c0-dc03e4a95106 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b7dbf1c-610b-4e48-836d-8d0953128967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-851983218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e3d3d0a-bfb9-4152-8e79-44604f1f82b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b5d38698e144460b69508dad3b475d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:52Z,use_quota=True,user_id='32cefb6cda3e4a039c41146d966b5446',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-8e53143e-2f3e-4ad2-90c0-dc03e4a95106 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fed95e7f-40c5-456b-a517-fe01589083f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-8e53143e-2f3e-4ad2-90c0-dc03e4a95106 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fed95e7f-40c5-456b-a517-fe01589083f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-8e53143e-2f3e-4ad2-90c0-dc03e4a95106 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4da65960-007e-4602-8201-5f1cb8baaac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-8e53143e-2f3e-4ad2-90c0-dc03e4a95106 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4da65960-007e-4602-8201-5f1cb8baaac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e3d3d0a-bfb9-4152-8e79-44604f1f82b3', 'volume_name': 'volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-8e53143e-2f3e-4ad2-90c0-dc03e4a95106 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6728d4eb-f099-4ced-b0ec-c4562216d9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-8e53143e-2f3e-4ad2-90c0-dc03e4a95106 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6728d4eb-f099-4ced-b0ec-c4562216d9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-8e53143e-2f3e-4ad2-90c0-dc03e4a95106 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bb01a58-c82a-4e4f-9266-8191e913ca44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:52 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-8e53143e-2f3e-4ad2-90c0-dc03e4a95106 tempest-ProjectReaderTests-655005113 None] Volume 8e3d3d0a-bfb9-4152-8e79-44604f1f82b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3', 'volume_size': 1} Jul 31 10:59:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8e53143e-2f3e-4ad2-90c0-dc03e4a95106 tempest-ProjectReaderTests-655005113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:52 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a9b89f05-b35c-4d34-938c-143fa8b4f7a6 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8a941190-f817-4ff5-9408-01417e1321cf 1073741824" returned: 0 in 0.695s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a9b89f05-b35c-4d34-938c-143fa8b4f7a6 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8a941190-f817-4ff5-9408-01417e1321cf {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:52 devstack sudo[107804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8a941190-f817-4ff5-9408-01417e1321cf Jul 31 10:59:52 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:52 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-a9b89f05-b35c-4d34-938c-143fa8b4f7a6 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8a941190-f817-4ff5-9408-01417e1321cf" returned: 0 in 0.312s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:52 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-a9b89f05-b35c-4d34-938c-143fa8b4f7a6 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-a9b89f05-b35c-4d34-938c-143fa8b4f7a6 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-aaf7a73c-c1da-4315-a731-75381bdca71f tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.662s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:52 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-aaf7a73c-c1da-4315-a731-75381bdca71f tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1209341243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4245b7b0-2dc4-4b44-9017-756634241a84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d5fa925bdf34f50b4829410c639b5d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:51Z,use_quota=True,user_id='61375c26160947e1959b624bfc2c9d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:52 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-aaf7a73c-c1da-4315-a731-75381bdca71f tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Creating volume 4245b7b0-2dc4-4b44-9017-756634241a84 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-aaf7a73c-c1da-4315-a731-75381bdca71f tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-aaf7a73c-c1da-4315-a731-75381bdca71f tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:52 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-aaf7a73c-c1da-4315-a731-75381bdca71f tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:52 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-aaf7a73c-c1da-4315-a731-75381bdca71f tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-aaf7a73c-c1da-4315-a731-75381bdca71f tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:52 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-aaf7a73c-c1da-4315-a731-75381bdca71f tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:59:52 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-aaf7a73c-c1da-4315-a731-75381bdca71f tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:59:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-aaf7a73c-c1da-4315-a731-75381bdca71f tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4245b7b0-2dc4-4b44-9017-756634241a84 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:52 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4245b7b0-2dc4-4b44-9017-756634241a84 1073741824 Jul 31 10:59:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a9b89f05-b35c-4d34-938c-143fa8b4f7a6 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3670281-7c6f-4d02-adfe-912fce40a5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a941190-f817-4ff5-9408-01417e1321cf', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:52 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a9b89f05-b35c-4d34-938c-143fa8b4f7a6 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (687306a9-8b23-4c6c-8c5f-5211bb5a454c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:52 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-a9b89f05-b35c-4d34-938c-143fa8b4f7a6 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Volume volume-8a941190-f817-4ff5-9408-01417e1321cf (8a941190-f817-4ff5-9408-01417e1321cf): created successfully Jul 31 10:59:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a9b89f05-b35c-4d34-938c-143fa8b4f7a6 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (687306a9-8b23-4c6c-8c5f-5211bb5a454c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:52 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-a9b89f05-b35c-4d34-938c-143fa8b4f7a6 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Flow 'volume_create_manager' (a55ca738-9336-4124-9be2-d660253095f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:52 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-a9b89f05-b35c-4d34-938c-143fa8b4f7a6 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Created volume successfully. Jul 31 10:59:53 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-aaf7a73c-c1da-4315-a731-75381bdca71f tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4245b7b0-2dc4-4b44-9017-756634241a84 1073741824" returned: 0 in 0.561s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-aaf7a73c-c1da-4315-a731-75381bdca71f tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4245b7b0-2dc4-4b44-9017-756634241a84 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:53 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4245b7b0-2dc4-4b44-9017-756634241a84 Jul 31 10:59:53 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:53 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-aaf7a73c-c1da-4315-a731-75381bdca71f tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4245b7b0-2dc4-4b44-9017-756634241a84" returned: 0 in 0.382s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:53 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-aaf7a73c-c1da-4315-a731-75381bdca71f tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-aaf7a73c-c1da-4315-a731-75381bdca71f tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-39ff2305-aa6c-4ccb-806e-52ea3d93e324 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.863s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:53 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-39ff2305-aa6c-4ccb-806e-52ea3d93e324 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1373292035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90f80ca4-7e82-4408-80f1-72cf4c0e2c6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d5fa925bdf34f50b4829410c639b5d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:52Z,use_quota=True,user_id='61375c26160947e1959b624bfc2c9d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:53 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-39ff2305-aa6c-4ccb-806e-52ea3d93e324 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Creating volume 90f80ca4-7e82-4408-80f1-72cf4c0e2c6f {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-39ff2305-aa6c-4ccb-806e-52ea3d93e324 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-39ff2305-aa6c-4ccb-806e-52ea3d93e324 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:53 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-39ff2305-aa6c-4ccb-806e-52ea3d93e324 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:53 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-39ff2305-aa6c-4ccb-806e-52ea3d93e324 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-39ff2305-aa6c-4ccb-806e-52ea3d93e324 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:53 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-39ff2305-aa6c-4ccb-806e-52ea3d93e324 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:59:53 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-39ff2305-aa6c-4ccb-806e-52ea3d93e324 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:59:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-39ff2305-aa6c-4ccb-806e-52ea3d93e324 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-90f80ca4-7e82-4408-80f1-72cf4c0e2c6f 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:53 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-90f80ca4-7e82-4408-80f1-72cf4c0e2c6f 1073741824 Jul 31 10:59:53 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-aaf7a73c-c1da-4315-a731-75381bdca71f tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aa140c0-9af3-497e-a34c-6f4cf07b5c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4245b7b0-2dc4-4b44-9017-756634241a84', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-aaf7a73c-c1da-4315-a731-75381bdca71f tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e608472-e776-44ee-944a-48993d180aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:53 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-aaf7a73c-c1da-4315-a731-75381bdca71f tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Volume volume-4245b7b0-2dc4-4b44-9017-756634241a84 (4245b7b0-2dc4-4b44-9017-756634241a84): created successfully Jul 31 10:59:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-aaf7a73c-c1da-4315-a731-75381bdca71f tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e608472-e776-44ee-944a-48993d180aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-aaf7a73c-c1da-4315-a731-75381bdca71f tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Flow 'volume_create_manager' (096bde87-e953-4490-bfd0-cba42c78fb0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:53 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-aaf7a73c-c1da-4315-a731-75381bdca71f tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Created volume successfully. Jul 31 10:59:54 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-39ff2305-aa6c-4ccb-806e-52ea3d93e324 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-90f80ca4-7e82-4408-80f1-72cf4c0e2c6f 1073741824" returned: 0 in 0.567s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-39ff2305-aa6c-4ccb-806e-52ea3d93e324 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-90f80ca4-7e82-4408-80f1-72cf4c0e2c6f {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:54 devstack sudo[107822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-90f80ca4-7e82-4408-80f1-72cf4c0e2c6f Jul 31 10:59:54 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:54 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-39ff2305-aa6c-4ccb-806e-52ea3d93e324 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-90f80ca4-7e82-4408-80f1-72cf4c0e2c6f" returned: 0 in 0.328s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:54 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-39ff2305-aa6c-4ccb-806e-52ea3d93e324 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-39ff2305-aa6c-4ccb-806e-52ea3d93e324 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8e53143e-2f3e-4ad2-90c0-dc03e4a95106 tempest-ProjectReaderTests-655005113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.711s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:54 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-8e53143e-2f3e-4ad2-90c0-dc03e4a95106 tempest-ProjectReaderTests-655005113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-851983218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e3d3d0a-bfb9-4152-8e79-44604f1f82b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b5d38698e144460b69508dad3b475d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:52Z,use_quota=True,user_id='32cefb6cda3e4a039c41146d966b5446',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:54 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-8e53143e-2f3e-4ad2-90c0-dc03e4a95106 tempest-ProjectReaderTests-655005113 None] Creating volume 8e3d3d0a-bfb9-4152-8e79-44604f1f82b3 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8e53143e-2f3e-4ad2-90c0-dc03e4a95106 tempest-ProjectReaderTests-655005113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8e53143e-2f3e-4ad2-90c0-dc03e4a95106 tempest-ProjectReaderTests-655005113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:54 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-8e53143e-2f3e-4ad2-90c0-dc03e4a95106 tempest-ProjectReaderTests-655005113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:54 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-8e53143e-2f3e-4ad2-90c0-dc03e4a95106 tempest-ProjectReaderTests-655005113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8e53143e-2f3e-4ad2-90c0-dc03e4a95106 tempest-ProjectReaderTests-655005113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:54 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-8e53143e-2f3e-4ad2-90c0-dc03e4a95106 tempest-ProjectReaderTests-655005113 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:59:54 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-8e53143e-2f3e-4ad2-90c0-dc03e4a95106 tempest-ProjectReaderTests-655005113 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:59:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8e53143e-2f3e-4ad2-90c0-dc03e4a95106 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:54 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-39ff2305-aa6c-4ccb-806e-52ea3d93e324 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7c19d99-df81-46fd-9440-68af8ef09c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90f80ca4-7e82-4408-80f1-72cf4c0e2c6f', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:54 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3 1073741824 Jul 31 10:59:54 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:54 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-39ff2305-aa6c-4ccb-806e-52ea3d93e324 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f337f7f4-f983-4e46-b485-9558d5355490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:54 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:UPDATE=248,cinder:SELECT=190,cinder:INSERT=70,cinder:DELETE=23 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:59:54 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-39ff2305-aa6c-4ccb-806e-52ea3d93e324 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Volume volume-90f80ca4-7e82-4408-80f1-72cf4c0e2c6f (90f80ca4-7e82-4408-80f1-72cf4c0e2c6f): created successfully Jul 31 10:59:54 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-39ff2305-aa6c-4ccb-806e-52ea3d93e324 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f337f7f4-f983-4e46-b485-9558d5355490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:54 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-39ff2305-aa6c-4ccb-806e-52ea3d93e324 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Flow 'volume_create_manager' (bad1a99a-b08d-41d1-ab31-9f241c5fcf36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:54 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=185,cinder:UPDATE=258,cinder:DELETE=23,cinder:INSERT=61 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:59:54 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-39ff2305-aa6c-4ccb-806e-52ea3d93e324 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Created volume successfully. Jul 31 10:59:55 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8e53143e-2f3e-4ad2-90c0-dc03e4a95106 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3 1073741824" returned: 0 in 0.622s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8e53143e-2f3e-4ad2-90c0-dc03e4a95106 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:55 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3 Jul 31 10:59:55 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:55 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8e53143e-2f3e-4ad2-90c0-dc03e4a95106 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3" returned: 0 in 0.344s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:55 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-8e53143e-2f3e-4ad2-90c0-dc03e4a95106 tempest-ProjectReaderTests-655005113 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:55 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8e53143e-2f3e-4ad2-90c0-dc03e4a95106 tempest-ProjectReaderTests-655005113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-8e53143e-2f3e-4ad2-90c0-dc03e4a95106 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bb01a58-c82a-4e4f-9266-8191e913ca44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-8e53143e-2f3e-4ad2-90c0-dc03e4a95106 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a236374-986f-4539-bf21-43f28f48d507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:55 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-8e53143e-2f3e-4ad2-90c0-dc03e4a95106 tempest-ProjectReaderTests-655005113 None] Volume volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3 (8e3d3d0a-bfb9-4152-8e79-44604f1f82b3): created successfully Jul 31 10:59:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-8e53143e-2f3e-4ad2-90c0-dc03e4a95106 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a236374-986f-4539-bf21-43f28f48d507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:55 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-8e53143e-2f3e-4ad2-90c0-dc03e4a95106 tempest-ProjectReaderTests-655005113 None] Flow 'volume_create_manager' (9717f6f4-6b42-47f8-a8aa-b83e879daa49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:55 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-8e53143e-2f3e-4ad2-90c0-dc03e4a95106 tempest-ProjectReaderTests-655005113 None] Created volume successfully. Jul 31 10:59:56 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-413a7172-0708-47d7-a7b9-776048da1842 tempest-ProjectReaderTests-43038077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-413a7172-0708-47d7-a7b9-776048da1842 tempest-ProjectReaderTests-43038077 None] Flow 'volume_create_manager' (90d3c798-6e4d-491d-be99-35b7125068d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-413a7172-0708-47d7-a7b9-776048da1842 tempest-ProjectReaderTests-43038077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b70074a4-7619-490a-9e63-fc7fcfdabe8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-413a7172-0708-47d7-a7b9-776048da1842 tempest-ProjectReaderTests-43038077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b70074a4-7619-490a-9e63-fc7fcfdabe8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1756797635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8018c966-08e2-4ec1-8753-dfebb252124a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9554f1b5d0a749198e5f1448dc2cc304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:56Z,use_quota=True,user_id='76d39ddeb75041bc8af3b6a4ae7ba71c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-413a7172-0708-47d7-a7b9-776048da1842 tempest-ProjectReaderTests-43038077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9507ed29-6869-4a3b-8f24-0ab317ccdd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-413a7172-0708-47d7-a7b9-776048da1842 tempest-ProjectReaderTests-43038077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9507ed29-6869-4a3b-8f24-0ab317ccdd06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-413a7172-0708-47d7-a7b9-776048da1842 tempest-ProjectReaderTests-43038077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c82b7f4-4417-4a65-acf0-688478fddb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-413a7172-0708-47d7-a7b9-776048da1842 tempest-ProjectReaderTests-43038077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c82b7f4-4417-4a65-acf0-688478fddb54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8018c966-08e2-4ec1-8753-dfebb252124a', 'volume_name': 'volume-8018c966-08e2-4ec1-8753-dfebb252124a', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-413a7172-0708-47d7-a7b9-776048da1842 tempest-ProjectReaderTests-43038077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb582779-04f6-4517-96f7-16a965ab1d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-413a7172-0708-47d7-a7b9-776048da1842 tempest-ProjectReaderTests-43038077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb582779-04f6-4517-96f7-16a965ab1d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-413a7172-0708-47d7-a7b9-776048da1842 tempest-ProjectReaderTests-43038077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c820c46-e463-4633-a751-1e46ec7a2900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:56 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-413a7172-0708-47d7-a7b9-776048da1842 tempest-ProjectReaderTests-43038077 None] Volume 8018c966-08e2-4ec1-8753-dfebb252124a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8018c966-08e2-4ec1-8753-dfebb252124a', 'volume_size': 1} Jul 31 10:59:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-413a7172-0708-47d7-a7b9-776048da1842 tempest-ProjectReaderTests-43038077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-413a7172-0708-47d7-a7b9-776048da1842 tempest-ProjectReaderTests-43038077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:56 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-413a7172-0708-47d7-a7b9-776048da1842 tempest-ProjectReaderTests-43038077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1756797635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8018c966-08e2-4ec1-8753-dfebb252124a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9554f1b5d0a749198e5f1448dc2cc304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:56Z,use_quota=True,user_id='76d39ddeb75041bc8af3b6a4ae7ba71c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:56 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-413a7172-0708-47d7-a7b9-776048da1842 tempest-ProjectReaderTests-43038077 None] Creating volume 8018c966-08e2-4ec1-8753-dfebb252124a {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-413a7172-0708-47d7-a7b9-776048da1842 tempest-ProjectReaderTests-43038077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-413a7172-0708-47d7-a7b9-776048da1842 tempest-ProjectReaderTests-43038077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:56 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-413a7172-0708-47d7-a7b9-776048da1842 tempest-ProjectReaderTests-43038077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:56 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-413a7172-0708-47d7-a7b9-776048da1842 tempest-ProjectReaderTests-43038077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-413a7172-0708-47d7-a7b9-776048da1842 tempest-ProjectReaderTests-43038077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:56 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-413a7172-0708-47d7-a7b9-776048da1842 tempest-ProjectReaderTests-43038077 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 10:59:56 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-413a7172-0708-47d7-a7b9-776048da1842 tempest-ProjectReaderTests-43038077 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 10:59:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-413a7172-0708-47d7-a7b9-776048da1842 tempest-ProjectReaderTests-43038077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8018c966-08e2-4ec1-8753-dfebb252124a 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:56 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9b7750af-3f0f-46f5-986c-6d136078b528 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Acquiring lock "cinder-90f80ca4-7e82-4408-80f1-72cf4c0e2c6f-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:56 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9b7750af-3f0f-46f5-986c-6d136078b528 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "cinder-90f80ca4-7e82-4408-80f1-72cf4c0e2c6f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:56 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8018c966-08e2-4ec1-8753-dfebb252124a 1073741824 Jul 31 10:59:56 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:56 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9b7750af-3f0f-46f5-986c-6d136078b528 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Acquiring lock "cinder-quobyte-90f80ca4-7e82-4408-80f1-72cf4c0e2c6f" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:56 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9b7750af-3f0f-46f5-986c-6d136078b528 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "cinder-quobyte-90f80ca4-7e82-4408-80f1-72cf4c0e2c6f" acquired by "delete_volume" :: waited 0.018s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:56 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c68bf7-d011-4257-bb99-cc8ab3af2fb0]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9b7750af-3f0f-46f5-986c-6d136078b528 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-90f80ca4-7e82-4408-80f1-72cf4c0e2c6f {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:56 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-90f80ca4-7e82-4408-80f1-72cf4c0e2c6f Jul 31 10:59:56 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:56 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9b7750af-3f0f-46f5-986c-6d136078b528 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-90f80ca4-7e82-4408-80f1-72cf4c0e2c6f" returned: 0 in 0.479s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9b7750af-3f0f-46f5-986c-6d136078b528 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-90f80ca4-7e82-4408-80f1-72cf4c0e2c6f {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:56 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-413a7172-0708-47d7-a7b9-776048da1842 tempest-ProjectReaderTests-43038077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8018c966-08e2-4ec1-8753-dfebb252124a 1073741824" returned: 0 in 0.642s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:56 devstack sudo[107844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-90f80ca4-7e82-4408-80f1-72cf4c0e2c6f Jul 31 10:59:56 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-413a7172-0708-47d7-a7b9-776048da1842 tempest-ProjectReaderTests-43038077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8018c966-08e2-4ec1-8753-dfebb252124a {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:56 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8018c966-08e2-4ec1-8753-dfebb252124a Jul 31 10:59:56 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:56 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Flow 'volume_create_manager' (d7c171ab-a61e-4ba1-a3e1-dc05caa5fe83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19628286-a960-4f86-bc45-47e28ad77469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19628286-a960-4f86-bc45-47e28ad77469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21cf5e91-756d-48e2-bff6-da3b66037220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79e8b004b941464895df96a831421a7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:57Z,use_quota=True,user_id='3e3a0fa8efbe4b52bb6c9abb2d0aeba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83eed035-370b-4441-81c7-868336e04ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83eed035-370b-4441-81c7-868336e04ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (304bd40d-8fc4-476f-b1e9-1bbb7a66fac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:57 devstack cinder-volume[89090]: DEBUG cinder.image.glance [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Creating Keystone auth plugin from conf {{(pid=89090) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 10:59:57 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9b7750af-3f0f-46f5-986c-6d136078b528 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-90f80ca4-7e82-4408-80f1-72cf4c0e2c6f" returned: 0 in 0.333s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:57 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9b7750af-3f0f-46f5-986c-6d136078b528 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "cinder-quobyte-90f80ca4-7e82-4408-80f1-72cf4c0e2c6f" released by "delete_volume" :: held 0.875s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:57 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-9b7750af-3f0f-46f5-986c-6d136078b528 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Created reservations ['aca80df0-e848-4dd5-a220-005869812ad6', '42d67a54-2bba-4e60-9078-79724ee4eac7', '51a4b610-d647-44ec-a045-ebdcb8f9f163', 'f9953a66-cce2-4365-aa22-19f55256804e'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:57 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-413a7172-0708-47d7-a7b9-776048da1842 tempest-ProjectReaderTests-43038077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8018c966-08e2-4ec1-8753-dfebb252124a" returned: 0 in 0.442s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:57 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-413a7172-0708-47d7-a7b9-776048da1842 tempest-ProjectReaderTests-43038077 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-413a7172-0708-47d7-a7b9-776048da1842 tempest-ProjectReaderTests-43038077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-55c569e7-34d4-4d96-bd03-1c83b7fb8d04 tempest-ProjectReaderTests-655005113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-55c569e7-34d4-4d96-bd03-1c83b7fb8d04 tempest-ProjectReaderTests-655005113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-413a7172-0708-47d7-a7b9-776048da1842 tempest-ProjectReaderTests-43038077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c820c46-e463-4633-a751-1e46ec7a2900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8018c966-08e2-4ec1-8753-dfebb252124a', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-413a7172-0708-47d7-a7b9-776048da1842 tempest-ProjectReaderTests-43038077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9d7e41f-fc11-4740-95b3-f2f225e6eda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:57 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-55c569e7-34d4-4d96-bd03-1c83b7fb8d04 tempest-ProjectReaderTests-655005113 None] Creating offline snapshot f6a7a8a1-cec5-4065-b78e-ab1815883acc of volume 8e3d3d0a-bfb9-4152-8e79-44604f1f82b3 {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:59:57 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-413a7172-0708-47d7-a7b9-776048da1842 tempest-ProjectReaderTests-43038077 None] Volume volume-8018c966-08e2-4ec1-8753-dfebb252124a (8018c966-08e2-4ec1-8753-dfebb252124a): created successfully Jul 31 10:59:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-413a7172-0708-47d7-a7b9-776048da1842 tempest-ProjectReaderTests-43038077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9d7e41f-fc11-4740-95b3-f2f225e6eda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-413a7172-0708-47d7-a7b9-776048da1842 tempest-ProjectReaderTests-43038077 None] Flow 'volume_create_manager' (90d3c798-6e4d-491d-be99-35b7125068d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:57 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[64617fbe-8af9-41c9-bd05-eefbdf03549e]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-55c569e7-34d4-4d96-bd03-1c83b7fb8d04 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:57 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-413a7172-0708-47d7-a7b9-776048da1842 tempest-ProjectReaderTests-43038077 None] Created volume successfully. Jul 31 10:59:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9b7750af-3f0f-46f5-986c-6d136078b528 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9b7750af-3f0f-46f5-986c-6d136078b528 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:57 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-9b7750af-3f0f-46f5-986c-6d136078b528 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:57 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-9b7750af-3f0f-46f5-986c-6d136078b528 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9b7750af-3f0f-46f5-986c-6d136078b528 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9b7750af-3f0f-46f5-986c-6d136078b528 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:57 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:59:57 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (304bd40d-8fc4-476f-b1e9-1bbb7a66fac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '21cf5e91-756d-48e2-bff6-da3b66037220', 'volume_name': 'volume-21cf5e91-756d-48e2-bff6-da3b66037220', 'volume_size': 1, 'image_id': 'b2523fb1-9b5e-4803-8753-2f494afd0eed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2523fb1-9b5e-4803-8753-2f494afd0eed', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '23197e6ab3720ff5e147331ae9111c58', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '79e8b004b941464895df96a831421a7a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f187fb0a15528b5ecf712383c9625b764bd5e60eceb16b73471a7118676f2a08145a3401e4683ac45d2d8192318aacc9178fb1ae9b86ce23c07bc03578bcde51', 'id': 'b2523fb1-9b5e-4803-8753-2f494afd0eed', 'created_at': datetime.datetime(2026, 7, 31, 8, 59, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 59, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2523fb1-9b5e-4803-8753-2f494afd0eed/file', 'properties': {}}, 'image_service': }' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006fa044-0fc4-40fb-a4f7-9b5db43da849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:57 devstack sudo[107850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3 Jul 31 10:59:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006fa044-0fc4-40fb-a4f7-9b5db43da849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:57 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:57 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b89178b-40f0-4b88-a2fc-bf4260b98863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:57 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Volume 21cf5e91-756d-48e2-bff6-da3b66037220: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-21cf5e91-756d-48e2-bff6-da3b66037220', 'volume_size': 1, 'image_id': 'b2523fb1-9b5e-4803-8753-2f494afd0eed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2523fb1-9b5e-4803-8753-2f494afd0eed', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '23197e6ab3720ff5e147331ae9111c58', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '79e8b004b941464895df96a831421a7a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f187fb0a15528b5ecf712383c9625b764bd5e60eceb16b73471a7118676f2a08145a3401e4683ac45d2d8192318aacc9178fb1ae9b86ce23c07bc03578bcde51', 'id': 'b2523fb1-9b5e-4803-8753-2f494afd0eed', 'created_at': datetime.datetime(2026, 7, 31, 8, 59, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 59, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2523fb1-9b5e-4803-8753-2f494afd0eed/file', 'properties': {}}, 'image_service': } Jul 31 10:59:57 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Trying to clone 21cf5e91-756d-48e2-bff6-da3b66037220 from image b2523fb1-9b5e-4803-8753-2f494afd0eed at location (None, [{'url': 'file:///opt/stack/data/glance/images/b2523fb1-9b5e-4803-8753-2f494afd0eed', 'metadata': {}}]). {{(pid=89090) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 10:59:57 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b2523fb1-9b5e-4803-8753-2f494afd0eed_nfozhv0odevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89090) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 10:59:57 devstack cinder-volume[89090]: INFO cinder.image.image_utils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Image download 0.00 MB at 0.00 MB/s Jul 31 10:59:57 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c49d299-a43b-4ff3-9ded-28faf1e03e48]: (4, 'raw') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2523fb1-9b5e-4803-8753-2f494afd0eed_nfozhv0odevstack@QuobyteHD {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:57 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9b7750af-3f0f-46f5-986c-6d136078b528 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.260s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:57 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-9b7750af-3f0f-46f5-986c-6d136078b528 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:57 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-9b7750af-3f0f-46f5-986c-6d136078b528 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Deleted volume successfully. Jul 31 10:59:57 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9b7750af-3f0f-46f5-986c-6d136078b528 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "cinder-90f80ca4-7e82-4408-80f1-72cf4c0e2c6f-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:57 devstack sudo[107855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2523fb1-9b5e-4803-8753-2f494afd0eed_nfozhv0odevstack@QuobyteHD Jul 31 10:59:57 devstack sudo[107855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:57 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-55c569e7-34d4-4d96-bd03-1c83b7fb8d04 tempest-ProjectReaderTests-655005113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3" returned: 0 in 0.496s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-55c569e7-34d4-4d96-bd03-1c83b7fb8d04 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3.f6a7a8a1-cec5-4065-b78e-ab1815883acc 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:57 devstack sudo[107860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3.f6a7a8a1-cec5-4065-b78e-ab1815883acc 1G Jul 31 10:59:57 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:58 devstack sudo[107855]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2523fb1-9b5e-4803-8753-2f494afd0eed_nfozhv0odevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2523fb1-9b5e-4803-8753-2f494afd0eed_nfozhv0odevstack@QuobyteHD {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:58 devstack sudo[107865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2523fb1-9b5e-4803-8753-2f494afd0eed_nfozhv0odevstack@QuobyteHD Jul 31 10:59:58 devstack sudo[107865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:58 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-90a7f2ae-e68e-4f9d-b20a-482bb1b4e323 tempest-ProjectReaderTests-43038077 None] Acquiring lock "cinder-8018c966-08e2-4ec1-8753-dfebb252124a-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:58 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-90a7f2ae-e68e-4f9d-b20a-482bb1b4e323 tempest-ProjectReaderTests-43038077 None] Lock "cinder-8018c966-08e2-4ec1-8753-dfebb252124a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:58 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-4e0bc8ab-2bdb-4eb0-afcd-49e1223b1a9b tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Acquiring lock "cinder-4245b7b0-2dc4-4b44-9017-756634241a84-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:58 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-55c569e7-34d4-4d96-bd03-1c83b7fb8d04 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3.f6a7a8a1-cec5-4065-b78e-ab1815883acc 1G" returned: 0 in 0.635s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-55c569e7-34d4-4d96-bd03-1c83b7fb8d04 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3.f6a7a8a1-cec5-4065-b78e-ab1815883acc {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:58 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-4e0bc8ab-2bdb-4eb0-afcd-49e1223b1a9b tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "cinder-4245b7b0-2dc4-4b44-9017-756634241a84-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:58 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3.f6a7a8a1-cec5-4065-b78e-ab1815883acc Jul 31 10:59:58 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-90a7f2ae-e68e-4f9d-b20a-482bb1b4e323 tempest-ProjectReaderTests-43038077 None] Acquiring lock "cinder-quobyte-8018c966-08e2-4ec1-8753-dfebb252124a" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:58 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:58 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-90a7f2ae-e68e-4f9d-b20a-482bb1b4e323 tempest-ProjectReaderTests-43038077 None] Lock "cinder-quobyte-8018c966-08e2-4ec1-8753-dfebb252124a" acquired by "delete_volume" :: waited 0.023s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:58 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-4e0bc8ab-2bdb-4eb0-afcd-49e1223b1a9b tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Acquiring lock "cinder-quobyte-4245b7b0-2dc4-4b44-9017-756634241a84" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:58 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f1d34b-3dd1-402b-81dc-1d47c3d88b47]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-90a7f2ae-e68e-4f9d-b20a-482bb1b4e323 tempest-ProjectReaderTests-43038077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8018c966-08e2-4ec1-8753-dfebb252124a {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:58 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-4e0bc8ab-2bdb-4eb0-afcd-49e1223b1a9b tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "cinder-quobyte-4245b7b0-2dc4-4b44-9017-756634241a84" acquired by "delete_volume" :: waited 0.039s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:58 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2a46e3-e137-4f7b-bdc1-b583fa3643d0]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4e0bc8ab-2bdb-4eb0-afcd-49e1223b1a9b tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4245b7b0-2dc4-4b44-9017-756634241a84 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:58 devstack sudo[107865]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2523fb1-9b5e-4803-8753-2f494afd0eed_nfozhv0odevstack@QuobyteHD" returned: 1 in 0.632s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2523fb1-9b5e-4803-8753-2f494afd0eed_nfozhv0odevstack@QuobyteHD' failed. Not Retrying. {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 10:59:58 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Temporary image b2523fb1-9b5e-4803-8753-2f494afd0eed is fetched for user 3e3a0fa8efbe4b52bb6c9abb2d0aeba1. {{(pid=89090) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 10:59:58 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8018c966-08e2-4ec1-8753-dfebb252124a Jul 31 10:59:58 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:58 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c411c2-66df-4629-9848-de653046f7cc]: (4, 'raw') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2523fb1-9b5e-4803-8753-2f494afd0eed_nfozhv0odevstack@QuobyteHD {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:58 devstack sudo[107877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4245b7b0-2dc4-4b44-9017-756634241a84 Jul 31 10:59:58 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:58 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-55c569e7-34d4-4d96-bd03-1c83b7fb8d04 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3.f6a7a8a1-cec5-4065-b78e-ab1815883acc" returned: 0 in 0.442s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:58 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-55c569e7-34d4-4d96-bd03-1c83b7fb8d04 tempest-ProjectReaderTests-655005113 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3.f6a7a8a1-cec5-4065-b78e-ab1815883acc is being set with open permissions: ugo+rw Jul 31 10:59:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-55c569e7-34d4-4d96-bd03-1c83b7fb8d04 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3.f6a7a8a1-cec5-4065-b78e-ab1815883acc {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:59 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2523fb1-9b5e-4803-8753-2f494afd0eed_nfozhv0odevstack@QuobyteHD Jul 31 10:59:59 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:59 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3.f6a7a8a1-cec5-4065-b78e-ab1815883acc Jul 31 10:59:59 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:59 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-90a7f2ae-e68e-4f9d-b20a-482bb1b4e323 tempest-ProjectReaderTests-43038077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8018c966-08e2-4ec1-8753-dfebb252124a" returned: 0 in 0.507s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-90a7f2ae-e68e-4f9d-b20a-482bb1b4e323 tempest-ProjectReaderTests-43038077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8018c966-08e2-4ec1-8753-dfebb252124a {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:59 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8018c966-08e2-4ec1-8753-dfebb252124a Jul 31 10:59:59 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:59 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4e0bc8ab-2bdb-4eb0-afcd-49e1223b1a9b tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4245b7b0-2dc4-4b44-9017-756634241a84" returned: 0 in 0.534s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4e0bc8ab-2bdb-4eb0-afcd-49e1223b1a9b tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4245b7b0-2dc4-4b44-9017-756634241a84 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:59 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2523fb1-9b5e-4803-8753-2f494afd0eed_nfozhv0odevstack@QuobyteHD" returned: 0 in 0.416s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2523fb1-9b5e-4803-8753-2f494afd0eed_nfozhv0odevstack@QuobyteHD {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:59 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4245b7b0-2dc4-4b44-9017-756634241a84 Jul 31 10:59:59 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:59 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-55c569e7-34d4-4d96-bd03-1c83b7fb8d04 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3.f6a7a8a1-cec5-4065-b78e-ab1815883acc" returned: 0 in 0.320s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-55c569e7-34d4-4d96-bd03-1c83b7fb8d04 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:59 devstack sudo[107902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3.info Jul 31 10:59:59 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:59 devstack sudo[107901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2523fb1-9b5e-4803-8753-2f494afd0eed_nfozhv0odevstack@QuobyteHD Jul 31 10:59:59 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:59 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-90a7f2ae-e68e-4f9d-b20a-482bb1b4e323 tempest-ProjectReaderTests-43038077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8018c966-08e2-4ec1-8753-dfebb252124a" returned: 0 in 0.311s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:59 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-90a7f2ae-e68e-4f9d-b20a-482bb1b4e323 tempest-ProjectReaderTests-43038077 None] Lock "cinder-quobyte-8018c966-08e2-4ec1-8753-dfebb252124a" released by "delete_volume" :: held 0.886s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:59 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-90a7f2ae-e68e-4f9d-b20a-482bb1b4e323 tempest-ProjectReaderTests-43038077 None] Created reservations ['beaffd01-c2e9-4ea3-88f1-fd8b096e0faa', 'b93ca3c3-e6f3-49a1-bb3f-a758426986bb', '5ab362c3-5310-436b-8471-91810223187f', '1ffd4343-f51c-427f-854b-ffdf18a13ae1'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:59 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4e0bc8ab-2bdb-4eb0-afcd-49e1223b1a9b tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-4245b7b0-2dc4-4b44-9017-756634241a84" returned: 0 in 0.391s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:59 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-4e0bc8ab-2bdb-4eb0-afcd-49e1223b1a9b tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "cinder-quobyte-4245b7b0-2dc4-4b44-9017-756634241a84" released by "delete_volume" :: held 0.997s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:59 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2523fb1-9b5e-4803-8753-2f494afd0eed_nfozhv0odevstack@QuobyteHD" returned: 1 in 0.432s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2523fb1-9b5e-4803-8753-2f494afd0eed_nfozhv0odevstack@QuobyteHD' failed. Not Retrying. {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 10:59:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:59 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-90a7f2ae-e68e-4f9d-b20a-482bb1b4e323 tempest-ProjectReaderTests-43038077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-90a7f2ae-e68e-4f9d-b20a-482bb1b4e323 tempest-ProjectReaderTests-43038077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:59 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-90a7f2ae-e68e-4f9d-b20a-482bb1b4e323 tempest-ProjectReaderTests-43038077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:59 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-90a7f2ae-e68e-4f9d-b20a-482bb1b4e323 tempest-ProjectReaderTests-43038077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-90a7f2ae-e68e-4f9d-b20a-482bb1b4e323 tempest-ProjectReaderTests-43038077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-90a7f2ae-e68e-4f9d-b20a-482bb1b4e323 tempest-ProjectReaderTests-43038077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-55c569e7-34d4-4d96-bd03-1c83b7fb8d04 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3.info" returned: 0 in 0.411s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:59 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-55c569e7-34d4-4d96-bd03-1c83b7fb8d04 tempest-ProjectReaderTests-655005113 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3.info is being set with open permissions: ugo+rw Jul 31 10:59:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-55c569e7-34d4-4d96-bd03-1c83b7fb8d04 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:59 devstack sudo[107911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:59:59 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:59 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-4e0bc8ab-2bdb-4eb0-afcd-49e1223b1a9b tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Created reservations ['967bf2cb-6ead-4732-af6c-ac78400f2318', 'cd671cbc-8353-43e4-bbc4-595a555352fb', '32e56093-2efd-4258-b42e-d213aa96cfda', '005a1c58-d342-4f27-9e03-e8300fae2fc6'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:59 devstack sudo[107912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3.info Jul 31 10:59:59 devstack sudo[107912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4e0bc8ab-2bdb-4eb0-afcd-49e1223b1a9b tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4e0bc8ab-2bdb-4eb0-afcd-49e1223b1a9b tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:59 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4e0bc8ab-2bdb-4eb0-afcd-49e1223b1a9b tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 10:59:59 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4e0bc8ab-2bdb-4eb0-afcd-49e1223b1a9b tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 10:59:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4e0bc8ab-2bdb-4eb0-afcd-49e1223b1a9b tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4e0bc8ab-2bdb-4eb0-afcd-49e1223b1a9b tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:59 devstack sudo[107915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 10:59:59 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:00 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-90a7f2ae-e68e-4f9d-b20a-482bb1b4e323 tempest-ProjectReaderTests-43038077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.316s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:00 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-90a7f2ae-e68e-4f9d-b20a-482bb1b4e323 tempest-ProjectReaderTests-43038077 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:00 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-90a7f2ae-e68e-4f9d-b20a-482bb1b4e323 tempest-ProjectReaderTests-43038077 None] Deleted volume successfully. Jul 31 11:00:00 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-90a7f2ae-e68e-4f9d-b20a-482bb1b4e323 tempest-ProjectReaderTests-43038077 None] Lock "cinder-8018c966-08e2-4ec1-8753-dfebb252124a-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:00 devstack sudo[107912]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-55c569e7-34d4-4d96-bd03-1c83b7fb8d04 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3.info" returned: 0 in 0.387s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-55c569e7-34d4-4d96-bd03-1c83b7fb8d04 tempest-ProjectReaderTests-655005113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.836s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.465s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:00 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21cf5e91-756d-48e2-bff6-da3b66037220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79e8b004b941464895df96a831421a7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:57Z,use_quota=True,user_id='3e3a0fa8efbe4b52bb6c9abb2d0aeba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:00:00 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Creating volume 21cf5e91-756d-48e2-bff6-da3b66037220 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:00:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:00 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:00:00 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:00:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:00 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 11:00:00 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 11:00:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-21cf5e91-756d-48e2-bff6-da3b66037220 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:00 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:00 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-21cf5e91-756d-48e2-bff6-da3b66037220 1073741824 Jul 31 11:00:00 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4e0bc8ab-2bdb-4eb0-afcd-49e1223b1a9b tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.338s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:00 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-4e0bc8ab-2bdb-4eb0-afcd-49e1223b1a9b tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:00 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-55c569e7-34d4-4d96-bd03-1c83b7fb8d04 tempest-ProjectReaderTests-655005113 None] Create snapshot completed successfully Jul 31 11:00:00 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-4e0bc8ab-2bdb-4eb0-afcd-49e1223b1a9b tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Deleted volume successfully. Jul 31 11:00:00 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-4e0bc8ab-2bdb-4eb0-afcd-49e1223b1a9b tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "cinder-4245b7b0-2dc4-4b44-9017-756634241a84-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:00 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-721cd2f4-ed2a-411e-a807-916b5cd688dd tempest-ProjectReaderTests-655005113 None] Acquiring lock "cinder-f6a7a8a1-cec5-4065-b78e-ab1815883acc-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:00 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-721cd2f4-ed2a-411e-a807-916b5cd688dd tempest-ProjectReaderTests-655005113 None] Lock "cinder-f6a7a8a1-cec5-4065-b78e-ab1815883acc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:00 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-721cd2f4-ed2a-411e-a807-916b5cd688dd tempest-ProjectReaderTests-655005113 None] Acquiring lock "cinder-quobyte-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:00 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-721cd2f4-ed2a-411e-a807-916b5cd688dd tempest-ProjectReaderTests-655005113 None] Lock "cinder-quobyte-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3" acquired by "delete_snapshot" :: waited 0.025s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:00 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-721cd2f4-ed2a-411e-a807-916b5cd688dd tempest-ProjectReaderTests-655005113 None] Acquiring lock "cinder-quobyte-f6a7a8a1-cec5-4065-b78e-ab1815883acc" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:00 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-721cd2f4-ed2a-411e-a807-916b5cd688dd tempest-ProjectReaderTests-655005113 None] Lock "cinder-quobyte-f6a7a8a1-cec5-4065-b78e-ab1815883acc" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:00 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-721cd2f4-ed2a-411e-a807-916b5cd688dd tempest-ProjectReaderTests-655005113 None] Deleting offline snapshot f6a7a8a1-cec5-4065-b78e-ab1815883acc of volume 8e3d3d0a-bfb9-4152-8e79-44604f1f82b3 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:00:00 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-721cd2f4-ed2a-411e-a807-916b5cd688dd tempest-ProjectReaderTests-655005113 None] snapshot_file for this snap is: volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3.f6a7a8a1-cec5-4065-b78e-ab1815883acc {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:00:00 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0d4a76-ba2c-4135-a020-0c4450960258]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-721cd2f4-ed2a-411e-a807-916b5cd688dd tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3.f6a7a8a1-cec5-4065-b78e-ab1815883acc {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:00 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6b0ad7cf-1b8c-4ccf-90c6-e89b3c7a6d71 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Acquiring lock "cinder-8a941190-f817-4ff5-9408-01417e1321cf-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:00 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3.f6a7a8a1-cec5-4065-b78e-ab1815883acc Jul 31 11:00:00 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:00 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6b0ad7cf-1b8c-4ccf-90c6-e89b3c7a6d71 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "cinder-8a941190-f817-4ff5-9408-01417e1321cf-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:00 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-21cf5e91-756d-48e2-bff6-da3b66037220 1073741824" returned: 0 in 0.678s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:00 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6b0ad7cf-1b8c-4ccf-90c6-e89b3c7a6d71 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Acquiring lock "cinder-quobyte-8a941190-f817-4ff5-9408-01417e1321cf" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-21cf5e91-756d-48e2-bff6-da3b66037220 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:00 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6b0ad7cf-1b8c-4ccf-90c6-e89b3c7a6d71 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "cinder-quobyte-8a941190-f817-4ff5-9408-01417e1321cf" acquired by "delete_volume" :: waited 0.046s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:01 devstack sudo[107928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-21cf5e91-756d-48e2-bff6-da3b66037220 Jul 31 11:00:01 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:01 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[779e5568-23d2-4eaf-ab19-9c27066e4c4d]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6b0ad7cf-1b8c-4ccf-90c6-e89b3c7a6d71 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8a941190-f817-4ff5-9408-01417e1321cf {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:01 devstack sudo[107930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8a941190-f817-4ff5-9408-01417e1321cf Jul 31 11:00:01 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:01 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-721cd2f4-ed2a-411e-a807-916b5cd688dd tempest-ProjectReaderTests-655005113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3.f6a7a8a1-cec5-4065-b78e-ab1815883acc" returned: 0 in 0.586s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:01 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-721cd2f4-ed2a-411e-a807-916b5cd688dd tempest-ProjectReaderTests-655005113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:00:01 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ef599f-c154-44fa-b937-5a69b2338c0a]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-721cd2f4-ed2a-411e-a807-916b5cd688dd tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:01 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-21cf5e91-756d-48e2-bff6-da3b66037220" returned: 0 in 0.432s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:01 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:00:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:01 devstack cinder-volume[89090]: DEBUG cinder.volume.volume_utils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Attempting download of b2523fb1-9b5e-4803-8753-2f494afd0eed ((None, [{'url': 'file:///opt/stack/data/glance/images/b2523fb1-9b5e-4803-8753-2f494afd0eed', 'metadata': {}}])) to volume 21cf5e91-756d-48e2-bff6-da3b66037220. {{(pid=89090) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 11:00:01 devstack sudo[107936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3 Jul 31 11:00:01 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:01 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-20bddb1b-377f-498b-9f42-b1ee51b708e5 tempest-ProjectReaderTests-43038077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:00:01 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-20bddb1b-377f-498b-9f42-b1ee51b708e5 tempest-ProjectReaderTests-43038077 None] Flow 'volume_create_manager' (c71316df-4371-4ef9-826b-636b6fbbfe9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:01 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-20bddb1b-377f-498b-9f42-b1ee51b708e5 tempest-ProjectReaderTests-43038077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d790c212-e427-4bbc-857d-95aacab84136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:01 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b708b5-bf66-44bf-8297-7ac29d7d9db0]: (4, 'raw') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:01 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2523fb1-9b5e-4803-8753-2f494afd0eed_lmvrwo0v {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:01 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-20bddb1b-377f-498b-9f42-b1ee51b708e5 tempest-ProjectReaderTests-43038077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d790c212-e427-4bbc-857d-95aacab84136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1932972108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b579b9fe-107f-4b41-81b1-1f8e26bc1d9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9554f1b5d0a749198e5f1448dc2cc304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:01Z,use_quota=True,user_id='76d39ddeb75041bc8af3b6a4ae7ba71c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:01 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-20bddb1b-377f-498b-9f42-b1ee51b708e5 tempest-ProjectReaderTests-43038077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d99c481-e722-4e59-8f69-0316878ecf84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:01 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-20bddb1b-377f-498b-9f42-b1ee51b708e5 tempest-ProjectReaderTests-43038077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d99c481-e722-4e59-8f69-0316878ecf84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:01 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-20bddb1b-377f-498b-9f42-b1ee51b708e5 tempest-ProjectReaderTests-43038077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd17336-e7c7-4275-bb7e-fbfe5d4017d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:01 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-20bddb1b-377f-498b-9f42-b1ee51b708e5 tempest-ProjectReaderTests-43038077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd17336-e7c7-4275-bb7e-fbfe5d4017d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b579b9fe-107f-4b41-81b1-1f8e26bc1d9f', 'volume_name': 'volume-b579b9fe-107f-4b41-81b1-1f8e26bc1d9f', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:01 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-20bddb1b-377f-498b-9f42-b1ee51b708e5 tempest-ProjectReaderTests-43038077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6c9d493-a4f0-4dfa-bec3-63107d22c50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:01 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-20bddb1b-377f-498b-9f42-b1ee51b708e5 tempest-ProjectReaderTests-43038077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6c9d493-a4f0-4dfa-bec3-63107d22c50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:01 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-20bddb1b-377f-498b-9f42-b1ee51b708e5 tempest-ProjectReaderTests-43038077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c920139c-b5cb-417d-b2f7-9252ed49db03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:01 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-20bddb1b-377f-498b-9f42-b1ee51b708e5 tempest-ProjectReaderTests-43038077 None] Volume b579b9fe-107f-4b41-81b1-1f8e26bc1d9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b579b9fe-107f-4b41-81b1-1f8e26bc1d9f', 'volume_size': 1} Jul 31 11:00:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-20bddb1b-377f-498b-9f42-b1ee51b708e5 tempest-ProjectReaderTests-43038077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-20bddb1b-377f-498b-9f42-b1ee51b708e5 tempest-ProjectReaderTests-43038077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:01 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-20bddb1b-377f-498b-9f42-b1ee51b708e5 tempest-ProjectReaderTests-43038077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1932972108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b579b9fe-107f-4b41-81b1-1f8e26bc1d9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9554f1b5d0a749198e5f1448dc2cc304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:01Z,use_quota=True,user_id='76d39ddeb75041bc8af3b6a4ae7ba71c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:00:01 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-20bddb1b-377f-498b-9f42-b1ee51b708e5 tempest-ProjectReaderTests-43038077 None] Creating volume b579b9fe-107f-4b41-81b1-1f8e26bc1d9f {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:00:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-20bddb1b-377f-498b-9f42-b1ee51b708e5 tempest-ProjectReaderTests-43038077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-20bddb1b-377f-498b-9f42-b1ee51b708e5 tempest-ProjectReaderTests-43038077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:01 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-20bddb1b-377f-498b-9f42-b1ee51b708e5 tempest-ProjectReaderTests-43038077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:00:01 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-20bddb1b-377f-498b-9f42-b1ee51b708e5 tempest-ProjectReaderTests-43038077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:00:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-20bddb1b-377f-498b-9f42-b1ee51b708e5 tempest-ProjectReaderTests-43038077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:01 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-20bddb1b-377f-498b-9f42-b1ee51b708e5 tempest-ProjectReaderTests-43038077 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 11:00:01 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-20bddb1b-377f-498b-9f42-b1ee51b708e5 tempest-ProjectReaderTests-43038077 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 11:00:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-20bddb1b-377f-498b-9f42-b1ee51b708e5 tempest-ProjectReaderTests-43038077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b579b9fe-107f-4b41-81b1-1f8e26bc1d9f 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6b0ad7cf-1b8c-4ccf-90c6-e89b3c7a6d71 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8a941190-f817-4ff5-9408-01417e1321cf" returned: 0 in 0.644s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6b0ad7cf-1b8c-4ccf-90c6-e89b3c7a6d71 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8a941190-f817-4ff5-9408-01417e1321cf {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:01 devstack sudo[107942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b579b9fe-107f-4b41-81b1-1f8e26bc1d9f 1073741824 Jul 31 11:00:01 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:01 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8a941190-f817-4ff5-9408-01417e1321cf Jul 31 11:00:01 devstack sudo[107941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2523fb1-9b5e-4803-8753-2f494afd0eed_lmvrwo0v Jul 31 11:00:01 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:01 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:01 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-721cd2f4-ed2a-411e-a807-916b5cd688dd tempest-ProjectReaderTests-655005113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3" returned: 0 in 0.485s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-721cd2f4-ed2a-411e-a807-916b5cd688dd tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3.f6a7a8a1-cec5-4065-b78e-ab1815883acc {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:01 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3.f6a7a8a1-cec5-4065-b78e-ab1815883acc Jul 31 11:00:01 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:02 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2523fb1-9b5e-4803-8753-2f494afd0eed_lmvrwo0v" returned: 0 in 0.445s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2523fb1-9b5e-4803-8753-2f494afd0eed_lmvrwo0v {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:02 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6b0ad7cf-1b8c-4ccf-90c6-e89b3c7a6d71 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8a941190-f817-4ff5-9408-01417e1321cf" returned: 0 in 0.429s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:02 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6b0ad7cf-1b8c-4ccf-90c6-e89b3c7a6d71 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "cinder-quobyte-8a941190-f817-4ff5-9408-01417e1321cf" released by "delete_volume" :: held 1.154s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:02 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2523fb1-9b5e-4803-8753-2f494afd0eed_lmvrwo0v Jul 31 11:00:02 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:02 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-6b0ad7cf-1b8c-4ccf-90c6-e89b3c7a6d71 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Created reservations ['05fe544c-1b1e-42d0-92e5-58fa69465fb8', 'b33cb590-d3d8-406e-bde6-e6dca8d881b5', 'bf78b6f2-b535-4c4f-8546-2ae01e542981', 'e08404f8-9566-4e71-8f12-a8610a93c3e2'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:02 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-20bddb1b-377f-498b-9f42-b1ee51b708e5 tempest-ProjectReaderTests-43038077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b579b9fe-107f-4b41-81b1-1f8e26bc1d9f 1073741824" returned: 0 in 0.666s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:02 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-721cd2f4-ed2a-411e-a807-916b5cd688dd tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3.f6a7a8a1-cec5-4065-b78e-ab1815883acc" returned: 0 in 0.532s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-721cd2f4-ed2a-411e-a807-916b5cd688dd tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3.f6a7a8a1-cec5-4065-b78e-ab1815883acc {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:02 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3.f6a7a8a1-cec5-4065-b78e-ab1815883acc Jul 31 11:00:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6b0ad7cf-1b8c-4ccf-90c6-e89b3c7a6d71 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6b0ad7cf-1b8c-4ccf-90c6-e89b3c7a6d71 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:02 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:02 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-6b0ad7cf-1b8c-4ccf-90c6-e89b3c7a6d71 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:00:02 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-6b0ad7cf-1b8c-4ccf-90c6-e89b3c7a6d71 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:00:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6b0ad7cf-1b8c-4ccf-90c6-e89b3c7a6d71 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6b0ad7cf-1b8c-4ccf-90c6-e89b3c7a6d71 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:02 devstack sudo[107969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 11:00:02 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-20bddb1b-377f-498b-9f42-b1ee51b708e5 tempest-ProjectReaderTests-43038077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b579b9fe-107f-4b41-81b1-1f8e26bc1d9f {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:02 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b579b9fe-107f-4b41-81b1-1f8e26bc1d9f Jul 31 11:00:02 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:02 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2523fb1-9b5e-4803-8753-2f494afd0eed_lmvrwo0v" returned: 1 in 0.488s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2523fb1-9b5e-4803-8753-2f494afd0eed_lmvrwo0v' failed. Not Retrying. {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:00:02 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc7119c-8985-434d-8f16-442ee181c7a2]: (4, 'raw') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2523fb1-9b5e-4803-8753-2f494afd0eed_nfozhv0odevstack@QuobyteHD {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:02 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2523fb1-9b5e-4803-8753-2f494afd0eed_nfozhv0odevstack@QuobyteHD Jul 31 11:00:02 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:02 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-721cd2f4-ed2a-411e-a807-916b5cd688dd tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3.f6a7a8a1-cec5-4065-b78e-ab1815883acc" returned: 0 in 0.371s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:02 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6b0ad7cf-1b8c-4ccf-90c6-e89b3c7a6d71 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.352s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:02 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-6b0ad7cf-1b8c-4ccf-90c6-e89b3c7a6d71 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:02 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-721cd2f4-ed2a-411e-a807-916b5cd688dd tempest-ProjectReaderTests-655005113 None] Lock "cinder-quobyte-f6a7a8a1-cec5-4065-b78e-ab1815883acc" released by "_delete_snapshot" :: held 2.116s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:02 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-6b0ad7cf-1b8c-4ccf-90c6-e89b3c7a6d71 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Deleted volume successfully. Jul 31 11:00:02 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-721cd2f4-ed2a-411e-a807-916b5cd688dd tempest-ProjectReaderTests-655005113 None] Lock "cinder-quobyte-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3" released by "delete_snapshot" :: held 2.171s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:02 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:02 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6b0ad7cf-1b8c-4ccf-90c6-e89b3c7a6d71 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "cinder-8a941190-f817-4ff5-9408-01417e1321cf-delete_volume" released by "delete_volume" :: held 1.971s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-20bddb1b-377f-498b-9f42-b1ee51b708e5 tempest-ProjectReaderTests-43038077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b579b9fe-107f-4b41-81b1-1f8e26bc1d9f" returned: 0 in 0.368s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:02 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-20bddb1b-377f-498b-9f42-b1ee51b708e5 tempest-ProjectReaderTests-43038077 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:00:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-20bddb1b-377f-498b-9f42-b1ee51b708e5 tempest-ProjectReaderTests-43038077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-20bddb1b-377f-498b-9f42-b1ee51b708e5 tempest-ProjectReaderTests-43038077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c920139c-b5cb-417d-b2f7-9252ed49db03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b579b9fe-107f-4b41-81b1-1f8e26bc1d9f', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-20bddb1b-377f-498b-9f42-b1ee51b708e5 tempest-ProjectReaderTests-43038077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7597246c-828d-46a0-bc40-23340101769c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:02 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-20bddb1b-377f-498b-9f42-b1ee51b708e5 tempest-ProjectReaderTests-43038077 None] Volume volume-b579b9fe-107f-4b41-81b1-1f8e26bc1d9f (b579b9fe-107f-4b41-81b1-1f8e26bc1d9f): created successfully Jul 31 11:00:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-20bddb1b-377f-498b-9f42-b1ee51b708e5 tempest-ProjectReaderTests-43038077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7597246c-828d-46a0-bc40-23340101769c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:02 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-20bddb1b-377f-498b-9f42-b1ee51b708e5 tempest-ProjectReaderTests-43038077 None] Flow 'volume_create_manager' (c71316df-4371-4ef9-826b-636b6fbbfe9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:02 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-20bddb1b-377f-498b-9f42-b1ee51b708e5 tempest-ProjectReaderTests-43038077 None] Created volume successfully. Jul 31 11:00:02 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2523fb1-9b5e-4803-8753-2f494afd0eed_nfozhv0odevstack@QuobyteHD" returned: 0 in 0.422s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2523fb1-9b5e-4803-8753-2f494afd0eed_nfozhv0odevstack@QuobyteHD {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:02 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-721cd2f4-ed2a-411e-a807-916b5cd688dd tempest-ProjectReaderTests-655005113 None] Created reservations ['d3600d11-725b-4e13-aabf-9b436cacf1aa', '2014d94a-9b92-4039-b53b-f4ce288f3db2', '76507cc1-634e-42e5-9324-738222977559', '55c2ced5-d45c-45b7-aa10-8469c828fca3'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:03 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-721cd2f4-ed2a-411e-a807-916b5cd688dd tempest-ProjectReaderTests-655005113 None] Delete snapshot completed successfully. Jul 31 11:00:03 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-721cd2f4-ed2a-411e-a807-916b5cd688dd tempest-ProjectReaderTests-655005113 None] Lock "cinder-f6a7a8a1-cec5-4065-b78e-ab1815883acc-delete_snapshot" released by "delete_snapshot" :: held 2.447s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:03 devstack sudo[107982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2523fb1-9b5e-4803-8753-2f494afd0eed_nfozhv0odevstack@QuobyteHD Jul 31 11:00:03 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:03 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e5871247-ee0d-41a3-ab2d-4b6595280617 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Acquiring lock "cinder-20e88800-3937-405e-bc79-0732b3eb6935-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:03 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e5871247-ee0d-41a3-ab2d-4b6595280617 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "cinder-20e88800-3937-405e-bc79-0732b3eb6935-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:03 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e5871247-ee0d-41a3-ab2d-4b6595280617 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Acquiring lock "cinder-quobyte-20e88800-3937-405e-bc79-0732b3eb6935" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:03 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e5871247-ee0d-41a3-ab2d-4b6595280617 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "cinder-quobyte-20e88800-3937-405e-bc79-0732b3eb6935" acquired by "delete_volume" :: waited 0.021s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:03 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[31029482-cee0-4a00-98dc-2f550f3c35f0]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e5871247-ee0d-41a3-ab2d-4b6595280617 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-20e88800-3937-405e-bc79-0732b3eb6935 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:03 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2523fb1-9b5e-4803-8753-2f494afd0eed_nfozhv0odevstack@QuobyteHD" returned: 1 in 0.387s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2523fb1-9b5e-4803-8753-2f494afd0eed_nfozhv0odevstack@QuobyteHD' failed. Not Retrying. {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:00:03 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] b2523fb1-9b5e-4803-8753-2f494afd0eed was raw, converting to qcow2 {{(pid=89090) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 11:00:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b2523fb1-9b5e-4803-8753-2f494afd0eed_nfozhv0odevstack@QuobyteHD /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-21cf5e91-756d-48e2-bff6-da3b66037220 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:03 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b2523fb1-9b5e-4803-8753-2f494afd0eed_nfozhv0odevstack@QuobyteHD /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-21cf5e91-756d-48e2-bff6-da3b66037220 Jul 31 11:00:03 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:03 devstack sudo[107984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-20e88800-3937-405e-bc79-0732b3eb6935 Jul 31 11:00:03 devstack sudo[107984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:03 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e5f8a16f-5099-4238-890f-f5149da5202e tempest-ProjectReaderTests-43038077 None] Acquiring lock "cinder-b579b9fe-107f-4b41-81b1-1f8e26bc1d9f-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:03 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e5f8a16f-5099-4238-890f-f5149da5202e tempest-ProjectReaderTests-43038077 None] Lock "cinder-b579b9fe-107f-4b41-81b1-1f8e26bc1d9f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:03 devstack sudo[107984]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e5871247-ee0d-41a3-ab2d-4b6595280617 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-20e88800-3937-405e-bc79-0732b3eb6935" returned: 0 in 0.472s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e5871247-ee0d-41a3-ab2d-4b6595280617 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-20e88800-3937-405e-bc79-0732b3eb6935 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:03 devstack sudo[107998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-20e88800-3937-405e-bc79-0732b3eb6935 Jul 31 11:00:03 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:03 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e5f8a16f-5099-4238-890f-f5149da5202e tempest-ProjectReaderTests-43038077 None] Acquiring lock "cinder-quobyte-b579b9fe-107f-4b41-81b1-1f8e26bc1d9f" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:03 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e5f8a16f-5099-4238-890f-f5149da5202e tempest-ProjectReaderTests-43038077 None] Lock "cinder-quobyte-b579b9fe-107f-4b41-81b1-1f8e26bc1d9f" acquired by "delete_volume" :: waited 0.026s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:03 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-dfdf9811-ad2f-4866-8624-ea545d97f484 tempest-ProjectReaderTests-655005113 None] Acquiring lock "cinder-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:03 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7ba078-356c-4c7d-bad8-11646038f8a9]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e5f8a16f-5099-4238-890f-f5149da5202e tempest-ProjectReaderTests-43038077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b579b9fe-107f-4b41-81b1-1f8e26bc1d9f {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:03 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-dfdf9811-ad2f-4866-8624-ea545d97f484 tempest-ProjectReaderTests-655005113 None] Lock "cinder-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:03 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-dfdf9811-ad2f-4866-8624-ea545d97f484 tempest-ProjectReaderTests-655005113 None] Acquiring lock "cinder-quobyte-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:03 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-dfdf9811-ad2f-4866-8624-ea545d97f484 tempest-ProjectReaderTests-655005113 None] Lock "cinder-quobyte-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3" acquired by "delete_volume" :: waited 0.020s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:04 devstack sudo[108000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b579b9fe-107f-4b41-81b1-1f8e26bc1d9f Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[1daffec1-6f48-4fc0-8c04-e3286eee5fa7]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dfdf9811-ad2f-4866-8624-ea545d97f484 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:04 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:04 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:04 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e5871247-ee0d-41a3-ab2d-4b6595280617 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-20e88800-3937-405e-bc79-0732b3eb6935" returned: 0 in 0.316s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b2523fb1-9b5e-4803-8753-2f494afd0eed_nfozhv0odevstack@QuobyteHD /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-21cf5e91-756d-48e2-bff6-da3b66037220" returned: 0 in 0.726s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b2523fb1-9b5e-4803-8753-2f494afd0eed_nfozhv0odevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-21cf5e91-756d-48e2-bff6-da3b66037220 {{(pid=89090) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 11:00:04 devstack cinder-volume[89090]: INFO cinder.image.image_utils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Converted 0.00 MB image at 0.00 MB/s Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-21cf5e91-756d-48e2-bff6-da3b66037220 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e5871247-ee0d-41a3-ab2d-4b6595280617 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "cinder-quobyte-20e88800-3937-405e-bc79-0732b3eb6935" released by "delete_volume" :: held 0.845s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:04 devstack sudo[108004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-21cf5e91-756d-48e2-bff6-da3b66037220 1G Jul 31 11:00:04 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-e5871247-ee0d-41a3-ab2d-4b6595280617 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Created reservations ['9cd200be-f527-47ff-a9ba-e15eb3069dde', '07ee8983-af5d-4286-99d8-c9e148be9296', '828ac8d9-e50b-4683-a4fb-7937a00ecf5f', 'fb978e30-e2cb-406c-a470-1cde752ad5de'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:04 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3 Jul 31 11:00:04 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e5871247-ee0d-41a3-ab2d-4b6595280617 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e5871247-ee0d-41a3-ab2d-4b6595280617 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-e5871247-ee0d-41a3-ab2d-4b6595280617 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-e5871247-ee0d-41a3-ab2d-4b6595280617 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e5871247-ee0d-41a3-ab2d-4b6595280617 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e5871247-ee0d-41a3-ab2d-4b6595280617 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:04 devstack sudo[108007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 11:00:04 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:04 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e5f8a16f-5099-4238-890f-f5149da5202e tempest-ProjectReaderTests-43038077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b579b9fe-107f-4b41-81b1-1f8e26bc1d9f" returned: 0 in 0.498s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e5f8a16f-5099-4238-890f-f5149da5202e tempest-ProjectReaderTests-43038077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b579b9fe-107f-4b41-81b1-1f8e26bc1d9f {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:04 devstack sudo[108014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b579b9fe-107f-4b41-81b1-1f8e26bc1d9f Jul 31 11:00:04 devstack sudo[108014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-5d1afece-54f1-4860-b886-64fae223bd28 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Acquiring lock "cinder-a6bfaa45-5a1a-4e4a-84e6-d803019e073b-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-5d1afece-54f1-4860-b886-64fae223bd28 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "cinder-a6bfaa45-5a1a-4e4a-84e6-d803019e073b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-5d1afece-54f1-4860-b886-64fae223bd28 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Acquiring lock "cinder-quobyte-a6bfaa45-5a1a-4e4a-84e6-d803019e073b" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-5d1afece-54f1-4860-b886-64fae223bd28 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "cinder-quobyte-a6bfaa45-5a1a-4e4a-84e6-d803019e073b" acquired by "delete_volume" :: waited 0.036s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a9bb43-d7eb-48c0-b59d-485604215ff5]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5d1afece-54f1-4860-b886-64fae223bd28 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a6bfaa45-5a1a-4e4a-84e6-d803019e073b {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:04 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-21cf5e91-756d-48e2-bff6-da3b66037220 1G" returned: 0 in 0.527s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG cinder.volume.volume_utils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Downloaded image b2523fb1-9b5e-4803-8753-2f494afd0eed ((None, [{'url': 'file:///opt/stack/data/glance/images/b2523fb1-9b5e-4803-8753-2f494afd0eed', 'metadata': {}}])) to volume 21cf5e91-756d-48e2-bff6-da3b66037220 successfully. {{(pid=89090) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Temporary image b2523fb1-9b5e-4803-8753-2f494afd0eed for user 3e3a0fa8efbe4b52bb6c9abb2d0aeba1 is deleted. {{(pid=89090) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG cinder.volume.volume_utils [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Marking volume 21cf5e91-756d-48e2-bff6-da3b66037220 as bootable. {{(pid=89090) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Copying metadata from image b2523fb1-9b5e-4803-8753-2f494afd0eed to 21cf5e91-756d-48e2-bff6-da3b66037220. {{(pid=89090) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Creating volume glance metadata for volume 21cf5e91-756d-48e2-bff6-da3b66037220 backed by image b2523fb1-9b5e-4803-8753-2f494afd0eed with: {'image_id': 'b2523fb1-9b5e-4803-8753-2f494afd0eed', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '23197e6ab3720ff5e147331ae9111c58', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89090) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 11:00:04 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e5871247-ee0d-41a3-ab2d-4b6595280617 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.421s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-e5871247-ee0d-41a3-ab2d-4b6595280617 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:04 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:04 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-e5871247-ee0d-41a3-ab2d-4b6595280617 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Deleted volume successfully. Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dfdf9811-ad2f-4866-8624-ea545d97f484 tempest-ProjectReaderTests-655005113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3" returned: 0 in 0.635s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dfdf9811-ad2f-4866-8624-ea545d97f484 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:04 devstack sudo[108024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3 Jul 31 11:00:04 devstack sudo[108024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:04 devstack sudo[108014]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e5f8a16f-5099-4238-890f-f5149da5202e tempest-ProjectReaderTests-43038077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-b579b9fe-107f-4b41-81b1-1f8e26bc1d9f" returned: 0 in 0.363s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:04 devstack sudo[108021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a6bfaa45-5a1a-4e4a-84e6-d803019e073b Jul 31 11:00:04 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e5871247-ee0d-41a3-ab2d-4b6595280617 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "cinder-20e88800-3937-405e-bc79-0732b3eb6935-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e5f8a16f-5099-4238-890f-f5149da5202e tempest-ProjectReaderTests-43038077 None] Lock "cinder-quobyte-b579b9fe-107f-4b41-81b1-1f8e26bc1d9f" released by "delete_volume" :: held 0.948s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b89178b-40f0-4b88-a2fc-bf4260b98863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21cf5e91-756d-48e2-bff6-da3b66037220', 'volume_size': 1, 'image_id': 'b2523fb1-9b5e-4803-8753-2f494afd0eed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2523fb1-9b5e-4803-8753-2f494afd0eed', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '23197e6ab3720ff5e147331ae9111c58', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '79e8b004b941464895df96a831421a7a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f187fb0a15528b5ecf712383c9625b764bd5e60eceb16b73471a7118676f2a08145a3401e4683ac45d2d8192318aacc9178fb1ae9b86ce23c07bc03578bcde51', 'id': 'b2523fb1-9b5e-4803-8753-2f494afd0eed', 'created_at': datetime.datetime(2026, 7, 31, 8, 59, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 59, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2523fb1-9b5e-4803-8753-2f494afd0eed/file', 'properties': {}}, 'image_service': }' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (981fca78-1d6e-4635-9262-8712f81181a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:04 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Volume volume-21cf5e91-756d-48e2-bff6-da3b66037220 (21cf5e91-756d-48e2-bff6-da3b66037220): created successfully Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (981fca78-1d6e-4635-9262-8712f81181a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Flow 'volume_create_manager' (d7c171ab-a61e-4ba1-a3e1-dc05caa5fe83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:04 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-b73f67d9-10c1-4cd5-9bd5-ff37fa2fdf12 tempest-VolumeImageDependencyTests-533641282 None] Created volume successfully. Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-e5f8a16f-5099-4238-890f-f5149da5202e tempest-ProjectReaderTests-43038077 None] Created reservations ['15a26018-86de-49f0-bcc8-0a82616a8b57', '4c73194c-7f52-468e-9ee3-d9514db95a8f', 'a105d441-ab2c-43e8-b0f9-6219490b8759', 'a2922ebc-f454-45c7-be30-074bb2cedb88'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e5f8a16f-5099-4238-890f-f5149da5202e tempest-ProjectReaderTests-43038077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e5f8a16f-5099-4238-890f-f5149da5202e tempest-ProjectReaderTests-43038077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-e5f8a16f-5099-4238-890f-f5149da5202e tempest-ProjectReaderTests-43038077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-e5f8a16f-5099-4238-890f-f5149da5202e tempest-ProjectReaderTests-43038077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e5f8a16f-5099-4238-890f-f5149da5202e tempest-ProjectReaderTests-43038077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e5f8a16f-5099-4238-890f-f5149da5202e tempest-ProjectReaderTests-43038077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:05 devstack sudo[108024]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:05 devstack sudo[108031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 11:00:05 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dfdf9811-ad2f-4866-8624-ea545d97f484 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3" returned: 0 in 0.366s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:05 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5d1afece-54f1-4860-b886-64fae223bd28 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a6bfaa45-5a1a-4e4a-84e6-d803019e073b" returned: 0 in 0.477s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5d1afece-54f1-4860-b886-64fae223bd28 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a6bfaa45-5a1a-4e4a-84e6-d803019e073b {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:05 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-dfdf9811-ad2f-4866-8624-ea545d97f484 tempest-ProjectReaderTests-655005113 None] Lock "cinder-quobyte-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3" released by "delete_volume" :: held 1.082s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:05 devstack sudo[108033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a6bfaa45-5a1a-4e4a-84e6-d803019e073b Jul 31 11:00:05 devstack sudo[108033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:05 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-dfdf9811-ad2f-4866-8624-ea545d97f484 tempest-ProjectReaderTests-655005113 None] Created reservations ['22d0b574-475d-448f-8188-9eba8667b600', '185caac3-75db-4ee3-a2a6-61c959628ab7', '0a55759b-3760-4f50-ab88-80206d260013', '58357cd7-8d8e-4d99-9613-80f231b568c7'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-dfdf9811-ad2f-4866-8624-ea545d97f484 tempest-ProjectReaderTests-655005113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-dfdf9811-ad2f-4866-8624-ea545d97f484 tempest-ProjectReaderTests-655005113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:05 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-dfdf9811-ad2f-4866-8624-ea545d97f484 tempest-ProjectReaderTests-655005113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:00:05 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-dfdf9811-ad2f-4866-8624-ea545d97f484 tempest-ProjectReaderTests-655005113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:00:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-dfdf9811-ad2f-4866-8624-ea545d97f484 tempest-ProjectReaderTests-655005113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dfdf9811-ad2f-4866-8624-ea545d97f484 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:05 devstack sudo[108035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 11:00:05 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:05 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e5f8a16f-5099-4238-890f-f5149da5202e tempest-ProjectReaderTests-43038077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.270s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:05 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-e5f8a16f-5099-4238-890f-f5149da5202e tempest-ProjectReaderTests-43038077 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:05 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-e5f8a16f-5099-4238-890f-f5149da5202e tempest-ProjectReaderTests-43038077 None] Deleted volume successfully. Jul 31 11:00:05 devstack sudo[108033]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5d1afece-54f1-4860-b886-64fae223bd28 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-a6bfaa45-5a1a-4e4a-84e6-d803019e073b" returned: 0 in 0.254s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:05 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e5f8a16f-5099-4238-890f-f5149da5202e tempest-ProjectReaderTests-43038077 None] Lock "cinder-b579b9fe-107f-4b41-81b1-1f8e26bc1d9f-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:05 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-5d1afece-54f1-4860-b886-64fae223bd28 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "cinder-quobyte-a6bfaa45-5a1a-4e4a-84e6-d803019e073b" released by "delete_volume" :: held 0.794s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:05 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-5d1afece-54f1-4860-b886-64fae223bd28 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Created reservations ['d80daeb7-e2ac-4131-9664-8e1d2488f046', 'ae4d1dd6-e21f-4b11-9bfb-c161fc43982b', 'bb297908-c80d-40b7-8ac7-f8d839033671', 'dc8eb7b7-8b43-4e1c-989b-b59b4088ffa5'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-5d1afece-54f1-4860-b886-64fae223bd28 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-5d1afece-54f1-4860-b886-64fae223bd28 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:05 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-5d1afece-54f1-4860-b886-64fae223bd28 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:00:05 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-5d1afece-54f1-4860-b886-64fae223bd28 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:00:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-5d1afece-54f1-4860-b886-64fae223bd28 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5d1afece-54f1-4860-b886-64fae223bd28 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:05 devstack sudo[108040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 11:00:05 devstack sudo[108040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:05 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-dfdf9811-ad2f-4866-8624-ea545d97f484 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.280s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:05 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-dfdf9811-ad2f-4866-8624-ea545d97f484 tempest-ProjectReaderTests-655005113 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:05 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-dfdf9811-ad2f-4866-8624-ea545d97f484 tempest-ProjectReaderTests-655005113 None] Deleted volume successfully. Jul 31 11:00:05 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-dfdf9811-ad2f-4866-8624-ea545d97f484 tempest-ProjectReaderTests-655005113 None] Lock "cinder-8e3d3d0a-bfb9-4152-8e79-44604f1f82b3-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:05 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8c40d65c-bbbe-4d8c-a4f6-fc7afd86894e tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Acquiring lock "cinder-f30dda02-eaf7-45d4-a1bc-f528a7635215-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:05 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8c40d65c-bbbe-4d8c-a4f6-fc7afd86894e tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "cinder-f30dda02-eaf7-45d4-a1bc-f528a7635215-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:05 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8c40d65c-bbbe-4d8c-a4f6-fc7afd86894e tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Acquiring lock "cinder-quobyte-f30dda02-eaf7-45d4-a1bc-f528a7635215" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:05 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8c40d65c-bbbe-4d8c-a4f6-fc7afd86894e tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "cinder-quobyte-f30dda02-eaf7-45d4-a1bc-f528a7635215" acquired by "delete_volume" :: waited 0.016s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:05 devstack sudo[108040]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-5d1afece-54f1-4860-b886-64fae223bd28 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.298s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:05 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-5d1afece-54f1-4860-b886-64fae223bd28 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:05 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebda4a28-1198-436a-abbc-1e7e893c4fa1]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:05 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-5d1afece-54f1-4860-b886-64fae223bd28 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Deleted volume successfully. Jul 31 11:00:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8c40d65c-bbbe-4d8c-a4f6-fc7afd86894e tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f30dda02-eaf7-45d4-a1bc-f528a7635215 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:05 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-5d1afece-54f1-4860-b886-64fae223bd28 tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "cinder-a6bfaa45-5a1a-4e4a-84e6-d803019e073b-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:05 devstack sudo[108043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f30dda02-eaf7-45d4-a1bc-f528a7635215 Jul 31 11:00:05 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:06 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-c77374c3-d1ab-4490-b89b-e1a26db6f75f tempest-VolumeImageDependencyTests-533641282 None] Acquiring lock "cinder-21cf5e91-756d-48e2-bff6-da3b66037220-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:06 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-c77374c3-d1ab-4490-b89b-e1a26db6f75f tempest-VolumeImageDependencyTests-533641282 None] Lock "cinder-21cf5e91-756d-48e2-bff6-da3b66037220-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:06 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-c77374c3-d1ab-4490-b89b-e1a26db6f75f tempest-VolumeImageDependencyTests-533641282 None] Acquiring lock "cinder-quobyte-21cf5e91-756d-48e2-bff6-da3b66037220" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:06 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-c77374c3-d1ab-4490-b89b-e1a26db6f75f tempest-VolumeImageDependencyTests-533641282 None] Lock "cinder-quobyte-21cf5e91-756d-48e2-bff6-da3b66037220" acquired by "delete_volume" :: waited 0.026s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:06 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c67fb5-2863-41d8-918e-76d87dc71df1]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c77374c3-d1ab-4490-b89b-e1a26db6f75f tempest-VolumeImageDependencyTests-533641282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-21cf5e91-756d-48e2-bff6-da3b66037220 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:06 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8c40d65c-bbbe-4d8c-a4f6-fc7afd86894e tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f30dda02-eaf7-45d4-a1bc-f528a7635215" returned: 0 in 0.545s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8c40d65c-bbbe-4d8c-a4f6-fc7afd86894e tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f30dda02-eaf7-45d4-a1bc-f528a7635215 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:06 devstack sudo[108049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f30dda02-eaf7-45d4-a1bc-f528a7635215 Jul 31 11:00:06 devstack sudo[108049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:06 devstack sudo[108048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-21cf5e91-756d-48e2-bff6-da3b66037220 Jul 31 11:00:06 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:06 devstack sudo[108049]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8c40d65c-bbbe-4d8c-a4f6-fc7afd86894e tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f30dda02-eaf7-45d4-a1bc-f528a7635215" returned: 0 in 0.403s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:06 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8c40d65c-bbbe-4d8c-a4f6-fc7afd86894e tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "cinder-quobyte-f30dda02-eaf7-45d4-a1bc-f528a7635215" released by "delete_volume" :: held 1.015s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:06 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-8c40d65c-bbbe-4d8c-a4f6-fc7afd86894e tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Created reservations ['6269696a-fb44-46c6-a33e-da44041e2907', '6aef8cff-1143-4a1a-9ca2-7fecc4b73e40', '11fded4c-bc1f-43bf-8c42-cae31c4d7572', 'b707f877-9d49-471a-8e52-1809a42770ae'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:06 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c77374c3-d1ab-4490-b89b-e1a26db6f75f tempest-VolumeImageDependencyTests-533641282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-21cf5e91-756d-48e2-bff6-da3b66037220" returned: 0 in 0.591s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:06 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c77374c3-d1ab-4490-b89b-e1a26db6f75f tempest-VolumeImageDependencyTests-533641282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-21cf5e91-756d-48e2-bff6-da3b66037220 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:06 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-21cf5e91-756d-48e2-bff6-da3b66037220 Jul 31 11:00:06 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:06 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebe2d5ac-7c1e-4157-8f23-fb435b5c56c0 tempest-ProjectReaderTests-655005113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:00:06 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ebe2d5ac-7c1e-4157-8f23-fb435b5c56c0 tempest-ProjectReaderTests-655005113 None] Flow 'volume_create_manager' (8d1445e0-ea47-4665-b910-216b17aca1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:06 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ebe2d5ac-7c1e-4157-8f23-fb435b5c56c0 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d18b5519-af43-4b7b-9708-5c2c01d99a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:06 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ebe2d5ac-7c1e-4157-8f23-fb435b5c56c0 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d18b5519-af43-4b7b-9708-5c2c01d99a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1105377972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5e9681d-5a93-4cd2-8885-9c2c8baa0db3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b5d38698e144460b69508dad3b475d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:07Z,use_quota=True,user_id='32cefb6cda3e4a039c41146d966b5446',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:06 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ebe2d5ac-7c1e-4157-8f23-fb435b5c56c0 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d6d24f1-f850-49e5-a2ae-8f1709a5ef84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:06 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ebe2d5ac-7c1e-4157-8f23-fb435b5c56c0 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d6d24f1-f850-49e5-a2ae-8f1709a5ef84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:06 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ebe2d5ac-7c1e-4157-8f23-fb435b5c56c0 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5f0cab7-81e0-4acf-b194-49f2c4c325c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:06 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ebe2d5ac-7c1e-4157-8f23-fb435b5c56c0 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5f0cab7-81e0-4acf-b194-49f2c4c325c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5e9681d-5a93-4cd2-8885-9c2c8baa0db3', 'volume_name': 'volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:07 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ebe2d5ac-7c1e-4157-8f23-fb435b5c56c0 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f45e346e-d296-4f30-b71d-53dadc25deaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:07 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ebe2d5ac-7c1e-4157-8f23-fb435b5c56c0 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f45e346e-d296-4f30-b71d-53dadc25deaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:07 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ebe2d5ac-7c1e-4157-8f23-fb435b5c56c0 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33051a9b-a3d2-4b3c-b05c-952088a3974c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:07 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-ebe2d5ac-7c1e-4157-8f23-fb435b5c56c0 tempest-ProjectReaderTests-655005113 None] Volume f5e9681d-5a93-4cd2-8885-9c2c8baa0db3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3', 'volume_size': 1} Jul 31 11:00:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ebe2d5ac-7c1e-4157-8f23-fb435b5c56c0 tempest-ProjectReaderTests-655005113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ebe2d5ac-7c1e-4157-8f23-fb435b5c56c0 tempest-ProjectReaderTests-655005113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:07 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ebe2d5ac-7c1e-4157-8f23-fb435b5c56c0 tempest-ProjectReaderTests-655005113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1105377972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5e9681d-5a93-4cd2-8885-9c2c8baa0db3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b5d38698e144460b69508dad3b475d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:07Z,use_quota=True,user_id='32cefb6cda3e4a039c41146d966b5446',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:00:07 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-ebe2d5ac-7c1e-4157-8f23-fb435b5c56c0 tempest-ProjectReaderTests-655005113 None] Creating volume f5e9681d-5a93-4cd2-8885-9c2c8baa0db3 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:00:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ebe2d5ac-7c1e-4157-8f23-fb435b5c56c0 tempest-ProjectReaderTests-655005113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ebe2d5ac-7c1e-4157-8f23-fb435b5c56c0 tempest-ProjectReaderTests-655005113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:07 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ebe2d5ac-7c1e-4157-8f23-fb435b5c56c0 tempest-ProjectReaderTests-655005113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:00:07 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ebe2d5ac-7c1e-4157-8f23-fb435b5c56c0 tempest-ProjectReaderTests-655005113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:00:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ebe2d5ac-7c1e-4157-8f23-fb435b5c56c0 tempest-ProjectReaderTests-655005113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:07 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ebe2d5ac-7c1e-4157-8f23-fb435b5c56c0 tempest-ProjectReaderTests-655005113 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 11:00:07 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-ebe2d5ac-7c1e-4157-8f23-fb435b5c56c0 tempest-ProjectReaderTests-655005113 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 11:00:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ebe2d5ac-7c1e-4157-8f23-fb435b5c56c0 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:07 devstack sudo[108061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3 1073741824 Jul 31 11:00:07 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8c40d65c-bbbe-4d8c-a4f6-fc7afd86894e tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8c40d65c-bbbe-4d8c-a4f6-fc7afd86894e tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:07 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-8c40d65c-bbbe-4d8c-a4f6-fc7afd86894e tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:00:07 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-8c40d65c-bbbe-4d8c-a4f6-fc7afd86894e tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:00:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8c40d65c-bbbe-4d8c-a4f6-fc7afd86894e tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8c40d65c-bbbe-4d8c-a4f6-fc7afd86894e tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:07 devstack sudo[108064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 11:00:07 devstack sudo[108064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:07 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c77374c3-d1ab-4490-b89b-e1a26db6f75f tempest-VolumeImageDependencyTests-533641282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-21cf5e91-756d-48e2-bff6-da3b66037220" returned: 0 in 0.311s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:07 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-c77374c3-d1ab-4490-b89b-e1a26db6f75f tempest-VolumeImageDependencyTests-533641282 None] Lock "cinder-quobyte-21cf5e91-756d-48e2-bff6-da3b66037220" released by "delete_volume" :: held 0.963s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:07 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-c77374c3-d1ab-4490-b89b-e1a26db6f75f tempest-VolumeImageDependencyTests-533641282 None] Created reservations ['6cf435a5-98a8-4b0f-8891-7d0de4893424', '3924e88d-7852-4718-8b8e-962513df33cf', 'fd8dfc1e-4f78-4082-8668-619c1fe4e179', 'a86570fa-6976-44b6-be28-55a446491355'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c77374c3-d1ab-4490-b89b-e1a26db6f75f tempest-VolumeImageDependencyTests-533641282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c77374c3-d1ab-4490-b89b-e1a26db6f75f tempest-VolumeImageDependencyTests-533641282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:07 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c77374c3-d1ab-4490-b89b-e1a26db6f75f tempest-VolumeImageDependencyTests-533641282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:00:07 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c77374c3-d1ab-4490-b89b-e1a26db6f75f tempest-VolumeImageDependencyTests-533641282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:00:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c77374c3-d1ab-4490-b89b-e1a26db6f75f tempest-VolumeImageDependencyTests-533641282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c77374c3-d1ab-4490-b89b-e1a26db6f75f tempest-VolumeImageDependencyTests-533641282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:07 devstack sudo[108067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 11:00:07 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:07 devstack sudo[108064]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8c40d65c-bbbe-4d8c-a4f6-fc7afd86894e tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.328s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:07 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-8c40d65c-bbbe-4d8c-a4f6-fc7afd86894e tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:07 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-8c40d65c-bbbe-4d8c-a4f6-fc7afd86894e tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Deleted volume successfully. Jul 31 11:00:07 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-8c40d65c-bbbe-4d8c-a4f6-fc7afd86894e tempest-CreateVolumesFromSourceVolumeTest-1676825748 None] Lock "cinder-f30dda02-eaf7-45d4-a1bc-f528a7635215-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:07 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ebe2d5ac-7c1e-4157-8f23-fb435b5c56c0 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3 1073741824" returned: 0 in 0.652s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:07 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c77374c3-d1ab-4490-b89b-e1a26db6f75f tempest-VolumeImageDependencyTests-533641282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.335s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:07 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-c77374c3-d1ab-4490-b89b-e1a26db6f75f tempest-VolumeImageDependencyTests-533641282 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:07 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-c77374c3-d1ab-4490-b89b-e1a26db6f75f tempest-VolumeImageDependencyTests-533641282 None] Deleted volume successfully. Jul 31 11:00:07 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ebe2d5ac-7c1e-4157-8f23-fb435b5c56c0 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:07 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-c77374c3-d1ab-4490-b89b-e1a26db6f75f tempest-VolumeImageDependencyTests-533641282 None] Lock "cinder-21cf5e91-756d-48e2-bff6-da3b66037220-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:07 devstack sudo[108075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3 Jul 31 11:00:07 devstack sudo[108075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:08 devstack sudo[108075]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ebe2d5ac-7c1e-4157-8f23-fb435b5c56c0 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3" returned: 0 in 0.292s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:08 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ebe2d5ac-7c1e-4157-8f23-fb435b5c56c0 tempest-ProjectReaderTests-655005113 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:00:08 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ebe2d5ac-7c1e-4157-8f23-fb435b5c56c0 tempest-ProjectReaderTests-655005113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ebe2d5ac-7c1e-4157-8f23-fb435b5c56c0 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33051a9b-a3d2-4b3c-b05c-952088a3974c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ebe2d5ac-7c1e-4157-8f23-fb435b5c56c0 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed22468e-0839-4237-8f23-c11dcfd71a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:08 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-ebe2d5ac-7c1e-4157-8f23-fb435b5c56c0 tempest-ProjectReaderTests-655005113 None] Volume volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3 (f5e9681d-5a93-4cd2-8885-9c2c8baa0db3): created successfully Jul 31 11:00:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ebe2d5ac-7c1e-4157-8f23-fb435b5c56c0 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed22468e-0839-4237-8f23-c11dcfd71a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:08 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-ebe2d5ac-7c1e-4157-8f23-fb435b5c56c0 tempest-ProjectReaderTests-655005113 None] Flow 'volume_create_manager' (8d1445e0-ea47-4665-b910-216b17aca1af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:08 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-ebe2d5ac-7c1e-4157-8f23-fb435b5c56c0 tempest-ProjectReaderTests-655005113 None] Created volume successfully. Jul 31 11:00:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9fe63e5f-9015-43f2-9992-46a58eaf8da4 tempest-ProjectReaderTests-655005113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9fe63e5f-9015-43f2-9992-46a58eaf8da4 tempest-ProjectReaderTests-655005113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:09 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-9fe63e5f-9015-43f2-9992-46a58eaf8da4 tempest-ProjectReaderTests-655005113 None] Creating offline snapshot 1314eb24-1d51-4be6-a1c4-c8a49306b68e of volume f5e9681d-5a93-4cd2-8885-9c2c8baa0db3 {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:00:09 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[39661725-d56d-41db-a27a-824c04896ff8]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9fe63e5f-9015-43f2-9992-46a58eaf8da4 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:09 devstack sudo[108079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3 Jul 31 11:00:09 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:09 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9fe63e5f-9015-43f2-9992-46a58eaf8da4 tempest-ProjectReaderTests-655005113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3" returned: 0 in 0.531s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9fe63e5f-9015-43f2-9992-46a58eaf8da4 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3.1314eb24-1d51-4be6-a1c4-c8a49306b68e 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:09 devstack sudo[108084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3.1314eb24-1d51-4be6-a1c4-c8a49306b68e 1G Jul 31 11:00:09 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:10 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9fe63e5f-9015-43f2-9992-46a58eaf8da4 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3.1314eb24-1d51-4be6-a1c4-c8a49306b68e 1G" returned: 0 in 0.564s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9fe63e5f-9015-43f2-9992-46a58eaf8da4 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3.1314eb24-1d51-4be6-a1c4-c8a49306b68e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:10 devstack sudo[108090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3.1314eb24-1d51-4be6-a1c4-c8a49306b68e Jul 31 11:00:10 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:10 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9fe63e5f-9015-43f2-9992-46a58eaf8da4 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3.1314eb24-1d51-4be6-a1c4-c8a49306b68e" returned: 0 in 0.435s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:10 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-9fe63e5f-9015-43f2-9992-46a58eaf8da4 tempest-ProjectReaderTests-655005113 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3.1314eb24-1d51-4be6-a1c4-c8a49306b68e is being set with open permissions: ugo+rw Jul 31 11:00:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9fe63e5f-9015-43f2-9992-46a58eaf8da4 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3.1314eb24-1d51-4be6-a1c4-c8a49306b68e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:10 devstack sudo[108129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3.1314eb24-1d51-4be6-a1c4-c8a49306b68e Jul 31 11:00:10 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:11 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9fe63e5f-9015-43f2-9992-46a58eaf8da4 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3.1314eb24-1d51-4be6-a1c4-c8a49306b68e" returned: 0 in 0.344s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9fe63e5f-9015-43f2-9992-46a58eaf8da4 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:11 devstack sudo[108134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3.info Jul 31 11:00:11 devstack sudo[108134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:11 devstack sudo[108134]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9fe63e5f-9015-43f2-9992-46a58eaf8da4 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3.info" returned: 0 in 0.312s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:11 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-9fe63e5f-9015-43f2-9992-46a58eaf8da4 tempest-ProjectReaderTests-655005113 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3.info is being set with open permissions: ugo+rw Jul 31 11:00:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9fe63e5f-9015-43f2-9992-46a58eaf8da4 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:11 devstack sudo[108137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3.info Jul 31 11:00:11 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:11 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9fe63e5f-9015-43f2-9992-46a58eaf8da4 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3.info" returned: 0 in 0.404s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9fe63e5f-9015-43f2-9992-46a58eaf8da4 tempest-ProjectReaderTests-655005113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.722s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:12 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-9fe63e5f-9015-43f2-9992-46a58eaf8da4 tempest-ProjectReaderTests-655005113 None] Create snapshot completed successfully Jul 31 11:00:12 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-994812c4-4630-41f3-9a17-76d3c8a36b01 tempest-ProjectReaderTests-1151784049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:00:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-994812c4-4630-41f3-9a17-76d3c8a36b01 tempest-ProjectReaderTests-1151784049 None] Flow 'volume_create_manager' (85cab278-290d-448c-97a5-0e2e31d06014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-994812c4-4630-41f3-9a17-76d3c8a36b01 tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df850ad-b855-4cae-b121-6a16a6970520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-994812c4-4630-41f3-9a17-76d3c8a36b01 tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df850ad-b855-4cae-b121-6a16a6970520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1352650472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa88e596-f78c-496b-bcdf-ea1dab0ff9cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d2265effb3c4d76b2c4cf25b967bd34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:12Z,use_quota=True,user_id='dd6439e8099b41089fd7a876e7dcbb48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-994812c4-4630-41f3-9a17-76d3c8a36b01 tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af0b4e19-345d-4c7e-956b-8270e3258058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-994812c4-4630-41f3-9a17-76d3c8a36b01 tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af0b4e19-345d-4c7e-956b-8270e3258058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-994812c4-4630-41f3-9a17-76d3c8a36b01 tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (607b9d2a-8177-41a5-a874-3d758253abc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-994812c4-4630-41f3-9a17-76d3c8a36b01 tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (607b9d2a-8177-41a5-a874-3d758253abc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa88e596-f78c-496b-bcdf-ea1dab0ff9cd', 'volume_name': 'volume-fa88e596-f78c-496b-bcdf-ea1dab0ff9cd', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-994812c4-4630-41f3-9a17-76d3c8a36b01 tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82aca183-710a-4353-9e3e-8827bd9b1036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-994812c4-4630-41f3-9a17-76d3c8a36b01 tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82aca183-710a-4353-9e3e-8827bd9b1036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:12 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-994812c4-4630-41f3-9a17-76d3c8a36b01 tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3851fa88-6825-4390-9b9f-f51c7fbd3dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:12 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-994812c4-4630-41f3-9a17-76d3c8a36b01 tempest-ProjectReaderTests-1151784049 None] Volume fa88e596-f78c-496b-bcdf-ea1dab0ff9cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa88e596-f78c-496b-bcdf-ea1dab0ff9cd', 'volume_size': 1} Jul 31 11:00:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-994812c4-4630-41f3-9a17-76d3c8a36b01 tempest-ProjectReaderTests-1151784049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-994812c4-4630-41f3-9a17-76d3c8a36b01 tempest-ProjectReaderTests-1151784049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:12 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-994812c4-4630-41f3-9a17-76d3c8a36b01 tempest-ProjectReaderTests-1151784049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1352650472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa88e596-f78c-496b-bcdf-ea1dab0ff9cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d2265effb3c4d76b2c4cf25b967bd34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:12Z,use_quota=True,user_id='dd6439e8099b41089fd7a876e7dcbb48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:00:12 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-994812c4-4630-41f3-9a17-76d3c8a36b01 tempest-ProjectReaderTests-1151784049 None] Creating volume fa88e596-f78c-496b-bcdf-ea1dab0ff9cd {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:00:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-994812c4-4630-41f3-9a17-76d3c8a36b01 tempest-ProjectReaderTests-1151784049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-994812c4-4630-41f3-9a17-76d3c8a36b01 tempest-ProjectReaderTests-1151784049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:12 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-994812c4-4630-41f3-9a17-76d3c8a36b01 tempest-ProjectReaderTests-1151784049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:00:12 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-994812c4-4630-41f3-9a17-76d3c8a36b01 tempest-ProjectReaderTests-1151784049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:00:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-994812c4-4630-41f3-9a17-76d3c8a36b01 tempest-ProjectReaderTests-1151784049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:12 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-994812c4-4630-41f3-9a17-76d3c8a36b01 tempest-ProjectReaderTests-1151784049 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 11:00:12 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-994812c4-4630-41f3-9a17-76d3c8a36b01 tempest-ProjectReaderTests-1151784049 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 11:00:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-994812c4-4630-41f3-9a17-76d3c8a36b01 tempest-ProjectReaderTests-1151784049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fa88e596-f78c-496b-bcdf-ea1dab0ff9cd 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:12 devstack sudo[108146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fa88e596-f78c-496b-bcdf-ea1dab0ff9cd 1073741824 Jul 31 11:00:12 devstack sudo[108146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:12 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f20bbc0b-3737-4b58-bff3-898dfa7ac65f tempest-ProjectReaderTests-655005113 None] Acquiring lock "cinder-1314eb24-1d51-4be6-a1c4-c8a49306b68e-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:12 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f20bbc0b-3737-4b58-bff3-898dfa7ac65f tempest-ProjectReaderTests-655005113 None] Lock "cinder-1314eb24-1d51-4be6-a1c4-c8a49306b68e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:12 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f20bbc0b-3737-4b58-bff3-898dfa7ac65f tempest-ProjectReaderTests-655005113 None] Acquiring lock "cinder-quobyte-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:12 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f20bbc0b-3737-4b58-bff3-898dfa7ac65f tempest-ProjectReaderTests-655005113 None] Lock "cinder-quobyte-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3" acquired by "delete_snapshot" :: waited 0.029s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:12 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f20bbc0b-3737-4b58-bff3-898dfa7ac65f tempest-ProjectReaderTests-655005113 None] Acquiring lock "cinder-quobyte-1314eb24-1d51-4be6-a1c4-c8a49306b68e" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:12 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f20bbc0b-3737-4b58-bff3-898dfa7ac65f tempest-ProjectReaderTests-655005113 None] Lock "cinder-quobyte-1314eb24-1d51-4be6-a1c4-c8a49306b68e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:12 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-f20bbc0b-3737-4b58-bff3-898dfa7ac65f tempest-ProjectReaderTests-655005113 None] Deleting offline snapshot 1314eb24-1d51-4be6-a1c4-c8a49306b68e of volume f5e9681d-5a93-4cd2-8885-9c2c8baa0db3 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:00:12 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-f20bbc0b-3737-4b58-bff3-898dfa7ac65f tempest-ProjectReaderTests-655005113 None] snapshot_file for this snap is: volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3.1314eb24-1d51-4be6-a1c4-c8a49306b68e {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:00:12 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f08e886-0326-4aba-8a2d-8c84c046907c]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f20bbc0b-3737-4b58-bff3-898dfa7ac65f tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3.1314eb24-1d51-4be6-a1c4-c8a49306b68e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:12 devstack sudo[108148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3.1314eb24-1d51-4be6-a1c4-c8a49306b68e Jul 31 11:00:12 devstack sudo[108148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:12 devstack sudo[108146]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-994812c4-4630-41f3-9a17-76d3c8a36b01 tempest-ProjectReaderTests-1151784049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fa88e596-f78c-496b-bcdf-ea1dab0ff9cd 1073741824" returned: 0 in 0.561s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-994812c4-4630-41f3-9a17-76d3c8a36b01 tempest-ProjectReaderTests-1151784049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fa88e596-f78c-496b-bcdf-ea1dab0ff9cd {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:13 devstack sudo[108154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fa88e596-f78c-496b-bcdf-ea1dab0ff9cd Jul 31 11:00:13 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:13 devstack sudo[108148]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f20bbc0b-3737-4b58-bff3-898dfa7ac65f tempest-ProjectReaderTests-655005113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3.1314eb24-1d51-4be6-a1c4-c8a49306b68e" returned: 0 in 0.558s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:13 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-f20bbc0b-3737-4b58-bff3-898dfa7ac65f tempest-ProjectReaderTests-655005113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:00:13 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ee1e0a-8762-416c-a137-a7d2cccdb2ee]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f20bbc0b-3737-4b58-bff3-898dfa7ac65f tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:13 devstack sudo[108159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3 Jul 31 11:00:13 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:13 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-994812c4-4630-41f3-9a17-76d3c8a36b01 tempest-ProjectReaderTests-1151784049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fa88e596-f78c-496b-bcdf-ea1dab0ff9cd" returned: 0 in 0.378s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:13 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-994812c4-4630-41f3-9a17-76d3c8a36b01 tempest-ProjectReaderTests-1151784049 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:00:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-994812c4-4630-41f3-9a17-76d3c8a36b01 tempest-ProjectReaderTests-1151784049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:13 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-994812c4-4630-41f3-9a17-76d3c8a36b01 tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3851fa88-6825-4390-9b9f-f51c7fbd3dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa88e596-f78c-496b-bcdf-ea1dab0ff9cd', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:13 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-994812c4-4630-41f3-9a17-76d3c8a36b01 tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf71c47-7123-4d84-b803-755967a94427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:13 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-994812c4-4630-41f3-9a17-76d3c8a36b01 tempest-ProjectReaderTests-1151784049 None] Volume volume-fa88e596-f78c-496b-bcdf-ea1dab0ff9cd (fa88e596-f78c-496b-bcdf-ea1dab0ff9cd): created successfully Jul 31 11:00:13 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-994812c4-4630-41f3-9a17-76d3c8a36b01 tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf71c47-7123-4d84-b803-755967a94427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:13 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-994812c4-4630-41f3-9a17-76d3c8a36b01 tempest-ProjectReaderTests-1151784049 None] Flow 'volume_create_manager' (85cab278-290d-448c-97a5-0e2e31d06014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:13 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-994812c4-4630-41f3-9a17-76d3c8a36b01 tempest-ProjectReaderTests-1151784049 None] Created volume successfully. Jul 31 11:00:13 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f20bbc0b-3737-4b58-bff3-898dfa7ac65f tempest-ProjectReaderTests-655005113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3" returned: 0 in 0.569s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f20bbc0b-3737-4b58-bff3-898dfa7ac65f tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3.1314eb24-1d51-4be6-a1c4-c8a49306b68e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:13 devstack sudo[108166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3.1314eb24-1d51-4be6-a1c4-c8a49306b68e Jul 31 11:00:13 devstack sudo[108166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:13 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-21c66a00-5e57-41ad-889e-681bcd24919b tempest-ProjectAdminTests-1434259505 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.752670288086, 'free_capacity_gb': 1775.752670288086, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89090) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 31 11:00:13 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-02c2d86b-18be-4b7f-89d9-545053e8ede2 tempest-ProjectMemberTests-1695234881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:00:13 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-02c2d86b-18be-4b7f-89d9-545053e8ede2 tempest-ProjectMemberTests-1695234881 None] Flow 'volume_create_manager' (54122ae0-508c-45e3-a9d1-824dccee40ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:13 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-02c2d86b-18be-4b7f-89d9-545053e8ede2 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b78bd194-4636-4fb4-99d5-7a73f923a813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:13 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e226e789-5cf2-4208-af66-68cc7b30a43e tempest-ProjectReaderTests-1151784049 None] Acquiring lock "cinder-fa88e596-f78c-496b-bcdf-ea1dab0ff9cd-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:13 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-02c2d86b-18be-4b7f-89d9-545053e8ede2 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b78bd194-4636-4fb4-99d5-7a73f923a813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-518584002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9865a84-e5a5-4d09-84e4-de518725a536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b176847c446546949fa03ac443e36966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:14Z,use_quota=True,user_id='6d7378e77478417881535d0f0f80d4b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:13 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-02c2d86b-18be-4b7f-89d9-545053e8ede2 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (560f6ea3-63ae-4b57-a6cf-b05dbdddf01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:13 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-02c2d86b-18be-4b7f-89d9-545053e8ede2 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (560f6ea3-63ae-4b57-a6cf-b05dbdddf01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-02c2d86b-18be-4b7f-89d9-545053e8ede2 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a05fd1f2-9f76-41e8-b42f-d7844330ec3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-02c2d86b-18be-4b7f-89d9-545053e8ede2 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a05fd1f2-9f76-41e8-b42f-d7844330ec3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9865a84-e5a5-4d09-84e4-de518725a536', 'volume_name': 'volume-c9865a84-e5a5-4d09-84e4-de518725a536', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-02c2d86b-18be-4b7f-89d9-545053e8ede2 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2868c599-c71f-4225-b859-8db6184a09f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-02c2d86b-18be-4b7f-89d9-545053e8ede2 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2868c599-c71f-4225-b859-8db6184a09f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:14 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-02c2d86b-18be-4b7f-89d9-545053e8ede2 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54bb57d2-ea18-4987-8a4a-f03828379800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:14 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-02c2d86b-18be-4b7f-89d9-545053e8ede2 tempest-ProjectMemberTests-1695234881 None] Volume c9865a84-e5a5-4d09-84e4-de518725a536: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9865a84-e5a5-4d09-84e4-de518725a536', 'volume_size': 1} Jul 31 11:00:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-02c2d86b-18be-4b7f-89d9-545053e8ede2 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-02c2d86b-18be-4b7f-89d9-545053e8ede2 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:14 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-02c2d86b-18be-4b7f-89d9-545053e8ede2 tempest-ProjectMemberTests-1695234881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-518584002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9865a84-e5a5-4d09-84e4-de518725a536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b176847c446546949fa03ac443e36966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:14Z,use_quota=True,user_id='6d7378e77478417881535d0f0f80d4b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:00:14 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-02c2d86b-18be-4b7f-89d9-545053e8ede2 tempest-ProjectMemberTests-1695234881 None] Creating volume c9865a84-e5a5-4d09-84e4-de518725a536 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:00:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-02c2d86b-18be-4b7f-89d9-545053e8ede2 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-02c2d86b-18be-4b7f-89d9-545053e8ede2 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:14 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-02c2d86b-18be-4b7f-89d9-545053e8ede2 tempest-ProjectMemberTests-1695234881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:00:14 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-02c2d86b-18be-4b7f-89d9-545053e8ede2 tempest-ProjectMemberTests-1695234881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:00:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-02c2d86b-18be-4b7f-89d9-545053e8ede2 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:14 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-02c2d86b-18be-4b7f-89d9-545053e8ede2 tempest-ProjectMemberTests-1695234881 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 11:00:14 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-02c2d86b-18be-4b7f-89d9-545053e8ede2 tempest-ProjectMemberTests-1695234881 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 11:00:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-02c2d86b-18be-4b7f-89d9-545053e8ede2 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:14 devstack sudo[108168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536 1073741824 Jul 31 11:00:14 devstack sudo[108168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:14 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e226e789-5cf2-4208-af66-68cc7b30a43e tempest-ProjectReaderTests-1151784049 None] Lock "cinder-fa88e596-f78c-496b-bcdf-ea1dab0ff9cd-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:14 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e226e789-5cf2-4208-af66-68cc7b30a43e tempest-ProjectReaderTests-1151784049 None] Acquiring lock "cinder-quobyte-fa88e596-f78c-496b-bcdf-ea1dab0ff9cd" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:14 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e226e789-5cf2-4208-af66-68cc7b30a43e tempest-ProjectReaderTests-1151784049 None] Lock "cinder-quobyte-fa88e596-f78c-496b-bcdf-ea1dab0ff9cd" acquired by "delete_volume" :: waited 0.021s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:14 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc78bb4-b080-4bd6-a42c-90ca1ee1ae55]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e226e789-5cf2-4208-af66-68cc7b30a43e tempest-ProjectReaderTests-1151784049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fa88e596-f78c-496b-bcdf-ea1dab0ff9cd {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:14 devstack sudo[108166]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f20bbc0b-3737-4b58-bff3-898dfa7ac65f tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3.1314eb24-1d51-4be6-a1c4-c8a49306b68e" returned: 0 in 0.502s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f20bbc0b-3737-4b58-bff3-898dfa7ac65f tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3.1314eb24-1d51-4be6-a1c4-c8a49306b68e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:14 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3.1314eb24-1d51-4be6-a1c4-c8a49306b68e Jul 31 11:00:14 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:14 devstack sudo[108173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fa88e596-f78c-496b-bcdf-ea1dab0ff9cd Jul 31 11:00:14 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:14 devstack sudo[108168]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-02c2d86b-18be-4b7f-89d9-545053e8ede2 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536 1073741824" returned: 0 in 0.552s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:14 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f20bbc0b-3737-4b58-bff3-898dfa7ac65f tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3.1314eb24-1d51-4be6-a1c4-c8a49306b68e" returned: 0 in 0.347s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:14 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f20bbc0b-3737-4b58-bff3-898dfa7ac65f tempest-ProjectReaderTests-655005113 None] Lock "cinder-quobyte-1314eb24-1d51-4be6-a1c4-c8a49306b68e" released by "_delete_snapshot" :: held 2.130s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:14 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f20bbc0b-3737-4b58-bff3-898dfa7ac65f tempest-ProjectReaderTests-655005113 None] Lock "cinder-quobyte-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3" released by "delete_snapshot" :: held 2.171s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:14 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e226e789-5cf2-4208-af66-68cc7b30a43e tempest-ProjectReaderTests-1151784049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fa88e596-f78c-496b-bcdf-ea1dab0ff9cd" returned: 0 in 0.524s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e226e789-5cf2-4208-af66-68cc7b30a43e tempest-ProjectReaderTests-1151784049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fa88e596-f78c-496b-bcdf-ea1dab0ff9cd {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-02c2d86b-18be-4b7f-89d9-545053e8ede2 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:14 devstack sudo[108186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fa88e596-f78c-496b-bcdf-ea1dab0ff9cd Jul 31 11:00:14 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:14 devstack sudo[108187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536 Jul 31 11:00:14 devstack sudo[108187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:14 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-f20bbc0b-3737-4b58-bff3-898dfa7ac65f tempest-ProjectReaderTests-655005113 None] Created reservations ['2531c171-26ba-4c85-94f7-11e9335a5de0', '92c01c4d-4e77-4247-af11-4076b21395ad', '7f2fc1f9-8b0e-466c-bdfd-28db9a87782a', 'a809a381-bb41-407e-8a27-c24eaaefcde4'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:14 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-f20bbc0b-3737-4b58-bff3-898dfa7ac65f tempest-ProjectReaderTests-655005113 None] Delete snapshot completed successfully. Jul 31 11:00:14 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f20bbc0b-3737-4b58-bff3-898dfa7ac65f tempest-ProjectReaderTests-655005113 None] Lock "cinder-1314eb24-1d51-4be6-a1c4-c8a49306b68e-delete_snapshot" released by "delete_snapshot" :: held 2.440s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:15 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e226e789-5cf2-4208-af66-68cc7b30a43e tempest-ProjectReaderTests-1151784049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-fa88e596-f78c-496b-bcdf-ea1dab0ff9cd" returned: 0 in 0.336s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:15 devstack sudo[108187]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-02c2d86b-18be-4b7f-89d9-545053e8ede2 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536" returned: 0 in 0.330s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:15 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-02c2d86b-18be-4b7f-89d9-545053e8ede2 tempest-ProjectMemberTests-1695234881 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:00:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-02c2d86b-18be-4b7f-89d9-545053e8ede2 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:15 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e226e789-5cf2-4208-af66-68cc7b30a43e tempest-ProjectReaderTests-1151784049 None] Lock "cinder-quobyte-fa88e596-f78c-496b-bcdf-ea1dab0ff9cd" released by "delete_volume" :: held 0.916s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:15 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-02c2d86b-18be-4b7f-89d9-545053e8ede2 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54bb57d2-ea18-4987-8a4a-f03828379800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9865a84-e5a5-4d09-84e4-de518725a536', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:15 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-02c2d86b-18be-4b7f-89d9-545053e8ede2 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af040791-2572-4d06-b6dc-f9d8ed0c9266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:15 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-02c2d86b-18be-4b7f-89d9-545053e8ede2 tempest-ProjectMemberTests-1695234881 None] Volume volume-c9865a84-e5a5-4d09-84e4-de518725a536 (c9865a84-e5a5-4d09-84e4-de518725a536): created successfully Jul 31 11:00:15 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-02c2d86b-18be-4b7f-89d9-545053e8ede2 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af040791-2572-4d06-b6dc-f9d8ed0c9266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:15 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-02c2d86b-18be-4b7f-89d9-545053e8ede2 tempest-ProjectMemberTests-1695234881 None] Flow 'volume_create_manager' (54122ae0-508c-45e3-a9d1-824dccee40ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:15 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-02c2d86b-18be-4b7f-89d9-545053e8ede2 tempest-ProjectMemberTests-1695234881 None] Created volume successfully. Jul 31 11:00:15 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-e226e789-5cf2-4208-af66-68cc7b30a43e tempest-ProjectReaderTests-1151784049 None] Created reservations ['4517cab6-e355-4fb6-9007-bed029e3924a', 'da50d1fa-d712-4927-9b2e-2a55e3eca42f', 'cadc4547-50f6-470a-8b66-ce116d0ee271', '265cc206-237f-4839-aa53-5b4e2de1ea62'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e226e789-5cf2-4208-af66-68cc7b30a43e tempest-ProjectReaderTests-1151784049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e226e789-5cf2-4208-af66-68cc7b30a43e tempest-ProjectReaderTests-1151784049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:15 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-e226e789-5cf2-4208-af66-68cc7b30a43e tempest-ProjectReaderTests-1151784049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:00:15 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-e226e789-5cf2-4208-af66-68cc7b30a43e tempest-ProjectReaderTests-1151784049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:00:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e226e789-5cf2-4208-af66-68cc7b30a43e tempest-ProjectReaderTests-1151784049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e226e789-5cf2-4208-af66-68cc7b30a43e tempest-ProjectReaderTests-1151784049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:15 devstack sudo[108192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 11:00:15 devstack sudo[108192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:15 devstack sudo[108192]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e226e789-5cf2-4208-af66-68cc7b30a43e tempest-ProjectReaderTests-1151784049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.293s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:15 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-e226e789-5cf2-4208-af66-68cc7b30a43e tempest-ProjectReaderTests-1151784049 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:15 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-e226e789-5cf2-4208-af66-68cc7b30a43e tempest-ProjectReaderTests-1151784049 None] Deleted volume successfully. Jul 31 11:00:15 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e226e789-5cf2-4208-af66-68cc7b30a43e tempest-ProjectReaderTests-1151784049 None] Lock "cinder-fa88e596-f78c-496b-bcdf-ea1dab0ff9cd-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:15 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-608fcd0a-dce5-49bd-bb92-0805c8f53f5d tempest-ProjectReaderTests-655005113 None] Acquiring lock "cinder-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:15 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-608fcd0a-dce5-49bd-bb92-0805c8f53f5d tempest-ProjectReaderTests-655005113 None] Lock "cinder-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:15 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-608fcd0a-dce5-49bd-bb92-0805c8f53f5d tempest-ProjectReaderTests-655005113 None] Acquiring lock "cinder-quobyte-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:15 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-608fcd0a-dce5-49bd-bb92-0805c8f53f5d tempest-ProjectReaderTests-655005113 None] Lock "cinder-quobyte-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3" acquired by "delete_volume" :: waited 0.032s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:16 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd000e1-dd95-4b9d-97c0-d845863aec73]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-608fcd0a-dce5-49bd-bb92-0805c8f53f5d tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:16 devstack sudo[108195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3 Jul 31 11:00:16 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-57a0ff2f-3b4d-483c-b91d-7f6bb556ff48 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-57a0ff2f-3b4d-483c-b91d-7f6bb556ff48 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:16 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-608fcd0a-dce5-49bd-bb92-0805c8f53f5d tempest-ProjectReaderTests-655005113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3" returned: 0 in 0.562s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-608fcd0a-dce5-49bd-bb92-0805c8f53f5d tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:16 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-57a0ff2f-3b4d-483c-b91d-7f6bb556ff48 tempest-ProjectMemberTests-1695234881 None] Creating offline snapshot d4aef361-efde-41bf-8373-060ba024ea47 of volume c9865a84-e5a5-4d09-84e4-de518725a536 {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:00:16 devstack sudo[108200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3 Jul 31 11:00:16 devstack sudo[108200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:16 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced53fd5-b870-4c68-962a-6d412e0ffb87]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-57a0ff2f-3b4d-483c-b91d-7f6bb556ff48 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:16 devstack sudo[108202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536 Jul 31 11:00:16 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:16 devstack sudo[108200]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:16 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-df219f88-9678-4d12-9800-f4935fbb6f7d tempest-ProjectReaderTests-1151784049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:00:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-df219f88-9678-4d12-9800-f4935fbb6f7d tempest-ProjectReaderTests-1151784049 None] Flow 'volume_create_manager' (9969719f-896b-41c7-86d8-da2b8254796a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-df219f88-9678-4d12-9800-f4935fbb6f7d tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc0280f1-c8c1-4159-9c76-6edf5c3d0749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-608fcd0a-dce5-49bd-bb92-0805c8f53f5d tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3" returned: 0 in 0.452s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-df219f88-9678-4d12-9800-f4935fbb6f7d tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc0280f1-c8c1-4159-9c76-6edf5c3d0749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1400604272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0285ed7f-091e-40a6-8080-98165146b75b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d2265effb3c4d76b2c4cf25b967bd34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:17Z,use_quota=True,user_id='dd6439e8099b41089fd7a876e7dcbb48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-df219f88-9678-4d12-9800-f4935fbb6f7d tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (184f0b8c-2b7b-4bdd-b683-b0ca7ee9c77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-df219f88-9678-4d12-9800-f4935fbb6f7d tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (184f0b8c-2b7b-4bdd-b683-b0ca7ee9c77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-df219f88-9678-4d12-9800-f4935fbb6f7d tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c2f1d10-8931-4103-865c-7660b1c4b249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:17 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-df219f88-9678-4d12-9800-f4935fbb6f7d tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c2f1d10-8931-4103-865c-7660b1c4b249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0285ed7f-091e-40a6-8080-98165146b75b', 'volume_name': 'volume-0285ed7f-091e-40a6-8080-98165146b75b', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-df219f88-9678-4d12-9800-f4935fbb6f7d tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (157e6465-a21f-438d-b701-065cbbbdc1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-df219f88-9678-4d12-9800-f4935fbb6f7d tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (157e6465-a21f-438d-b701-065cbbbdc1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:17 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-df219f88-9678-4d12-9800-f4935fbb6f7d tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a605a60-9b26-46e3-9729-ee03b0f531c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:17 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-df219f88-9678-4d12-9800-f4935fbb6f7d tempest-ProjectReaderTests-1151784049 None] Volume 0285ed7f-091e-40a6-8080-98165146b75b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0285ed7f-091e-40a6-8080-98165146b75b', 'volume_size': 1} Jul 31 11:00:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-df219f88-9678-4d12-9800-f4935fbb6f7d tempest-ProjectReaderTests-1151784049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:17 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-608fcd0a-dce5-49bd-bb92-0805c8f53f5d tempest-ProjectReaderTests-655005113 None] Lock "cinder-quobyte-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3" released by "delete_volume" :: held 1.164s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-57a0ff2f-3b4d-483c-b91d-7f6bb556ff48 tempest-ProjectMemberTests-1695234881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536" returned: 0 in 0.477s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-57a0ff2f-3b4d-483c-b91d-7f6bb556ff48 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536.d4aef361-efde-41bf-8373-060ba024ea47 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:17 devstack sudo[108208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536.d4aef361-efde-41bf-8373-060ba024ea47 1G Jul 31 11:00:17 devstack sudo[108208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:17 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-608fcd0a-dce5-49bd-bb92-0805c8f53f5d tempest-ProjectReaderTests-655005113 None] Created reservations ['a8643d0f-976d-46c0-8845-cbef4647478c', '088b590f-4087-42d4-9707-200c3daeb412', 'b876dfc6-a2ff-4df6-8e75-e8fbd69bce57', '55b605bf-60a5-4aab-a82a-c9fe07a4cc45'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-608fcd0a-dce5-49bd-bb92-0805c8f53f5d tempest-ProjectReaderTests-655005113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-608fcd0a-dce5-49bd-bb92-0805c8f53f5d tempest-ProjectReaderTests-655005113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:17 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-608fcd0a-dce5-49bd-bb92-0805c8f53f5d tempest-ProjectReaderTests-655005113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:00:17 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-608fcd0a-dce5-49bd-bb92-0805c8f53f5d tempest-ProjectReaderTests-655005113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:00:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-608fcd0a-dce5-49bd-bb92-0805c8f53f5d tempest-ProjectReaderTests-655005113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-608fcd0a-dce5-49bd-bb92-0805c8f53f5d tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:17 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 11:00:17 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:17 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-608fcd0a-dce5-49bd-bb92-0805c8f53f5d tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.336s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:17 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-608fcd0a-dce5-49bd-bb92-0805c8f53f5d tempest-ProjectReaderTests-655005113 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:17 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-608fcd0a-dce5-49bd-bb92-0805c8f53f5d tempest-ProjectReaderTests-655005113 None] Deleted volume successfully. Jul 31 11:00:17 devstack sudo[108208]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-57a0ff2f-3b4d-483c-b91d-7f6bb556ff48 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536.d4aef361-efde-41bf-8373-060ba024ea47 1G" returned: 0 in 0.549s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-57a0ff2f-3b4d-483c-b91d-7f6bb556ff48 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9865a84-e5a5-4d09-84e4-de518725a536 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536.d4aef361-efde-41bf-8373-060ba024ea47 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:17 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-608fcd0a-dce5-49bd-bb92-0805c8f53f5d tempest-ProjectReaderTests-655005113 None] Lock "cinder-f5e9681d-5a93-4cd2-8885-9c2c8baa0db3-delete_volume" released by "delete_volume" :: held 1.864s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:17 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9865a84-e5a5-4d09-84e4-de518725a536 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536.d4aef361-efde-41bf-8373-060ba024ea47 Jul 31 11:00:17 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:17 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-57a0ff2f-3b4d-483c-b91d-7f6bb556ff48 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9865a84-e5a5-4d09-84e4-de518725a536 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536.d4aef361-efde-41bf-8373-060ba024ea47" returned: 0 in 0.327s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:17 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-57a0ff2f-3b4d-483c-b91d-7f6bb556ff48 tempest-ProjectMemberTests-1695234881 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536.d4aef361-efde-41bf-8373-060ba024ea47 is being set with open permissions: ugo+rw Jul 31 11:00:17 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-57a0ff2f-3b4d-483c-b91d-7f6bb556ff48 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536.d4aef361-efde-41bf-8373-060ba024ea47 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:18 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536.d4aef361-efde-41bf-8373-060ba024ea47 Jul 31 11:00:18 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:18 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-57a0ff2f-3b4d-483c-b91d-7f6bb556ff48 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536.d4aef361-efde-41bf-8373-060ba024ea47" returned: 0 in 0.288s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-57a0ff2f-3b4d-483c-b91d-7f6bb556ff48 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:18 devstack sudo[108226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536.info Jul 31 11:00:18 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:18 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-57a0ff2f-3b4d-483c-b91d-7f6bb556ff48 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536.info" returned: 0 in 0.322s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:18 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-57a0ff2f-3b4d-483c-b91d-7f6bb556ff48 tempest-ProjectMemberTests-1695234881 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536.info is being set with open permissions: ugo+rw Jul 31 11:00:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-57a0ff2f-3b4d-483c-b91d-7f6bb556ff48 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:18 devstack sudo[108229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536.info Jul 31 11:00:18 devstack sudo[108229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:18 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-edc74544-0e63-46c5-b9a8-e19dda13eaf0 tempest-ProjectReaderTests-655005113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:00:18 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-edc74544-0e63-46c5-b9a8-e19dda13eaf0 tempest-ProjectReaderTests-655005113 None] Flow 'volume_create_manager' (30a47bd9-9982-42a5-a258-01d063d520c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:18 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-edc74544-0e63-46c5-b9a8-e19dda13eaf0 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b9246de-0738-4d1d-b215-17e321822a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:18 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-edc74544-0e63-46c5-b9a8-e19dda13eaf0 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b9246de-0738-4d1d-b215-17e321822a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1526943321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=631cde2c-d1d3-4353-934e-f75e69e94588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b5d38698e144460b69508dad3b475d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:19Z,use_quota=True,user_id='32cefb6cda3e4a039c41146d966b5446',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:18 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-edc74544-0e63-46c5-b9a8-e19dda13eaf0 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c2d7f1-e3f4-4451-8e1a-392138f47f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:18 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-edc74544-0e63-46c5-b9a8-e19dda13eaf0 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c2d7f1-e3f4-4451-8e1a-392138f47f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:18 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-edc74544-0e63-46c5-b9a8-e19dda13eaf0 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6abf8282-3415-4508-ae8f-38b1b4037d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:18 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-edc74544-0e63-46c5-b9a8-e19dda13eaf0 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6abf8282-3415-4508-ae8f-38b1b4037d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '631cde2c-d1d3-4353-934e-f75e69e94588', 'volume_name': 'volume-631cde2c-d1d3-4353-934e-f75e69e94588', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:18 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-edc74544-0e63-46c5-b9a8-e19dda13eaf0 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a44891a2-e049-4801-825f-9e414dc1cc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:18 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-edc74544-0e63-46c5-b9a8-e19dda13eaf0 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a44891a2-e049-4801-825f-9e414dc1cc28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:18 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-edc74544-0e63-46c5-b9a8-e19dda13eaf0 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (585a7287-2377-4612-ad3e-fe5804295406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:18 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-edc74544-0e63-46c5-b9a8-e19dda13eaf0 tempest-ProjectReaderTests-655005113 None] Volume 631cde2c-d1d3-4353-934e-f75e69e94588: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-631cde2c-d1d3-4353-934e-f75e69e94588', 'volume_size': 1} Jul 31 11:00:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-edc74544-0e63-46c5-b9a8-e19dda13eaf0 tempest-ProjectReaderTests-655005113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:18 devstack sudo[108229]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-57a0ff2f-3b4d-483c-b91d-7f6bb556ff48 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536.info" returned: 0 in 0.263s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-57a0ff2f-3b4d-483c-b91d-7f6bb556ff48 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.381s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-df219f88-9678-4d12-9800-f4935fbb6f7d tempest-ProjectReaderTests-1151784049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.832s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-df219f88-9678-4d12-9800-f4935fbb6f7d tempest-ProjectReaderTests-1151784049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1400604272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0285ed7f-091e-40a6-8080-98165146b75b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d2265effb3c4d76b2c4cf25b967bd34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:17Z,use_quota=True,user_id='dd6439e8099b41089fd7a876e7dcbb48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:00:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-df219f88-9678-4d12-9800-f4935fbb6f7d tempest-ProjectReaderTests-1151784049 None] Creating volume 0285ed7f-091e-40a6-8080-98165146b75b {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:00:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-df219f88-9678-4d12-9800-f4935fbb6f7d tempest-ProjectReaderTests-1151784049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-df219f88-9678-4d12-9800-f4935fbb6f7d tempest-ProjectReaderTests-1151784049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-df219f88-9678-4d12-9800-f4935fbb6f7d tempest-ProjectReaderTests-1151784049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:00:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-df219f88-9678-4d12-9800-f4935fbb6f7d tempest-ProjectReaderTests-1151784049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:00:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-df219f88-9678-4d12-9800-f4935fbb6f7d tempest-ProjectReaderTests-1151784049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-df219f88-9678-4d12-9800-f4935fbb6f7d tempest-ProjectReaderTests-1151784049 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 11:00:18 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-df219f88-9678-4d12-9800-f4935fbb6f7d tempest-ProjectReaderTests-1151784049 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 11:00:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-df219f88-9678-4d12-9800-f4935fbb6f7d tempest-ProjectReaderTests-1151784049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0285ed7f-091e-40a6-8080-98165146b75b 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:18 devstack sudo[108232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0285ed7f-091e-40a6-8080-98165146b75b 1073741824 Jul 31 11:00:18 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:18 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-57a0ff2f-3b4d-483c-b91d-7f6bb556ff48 tempest-ProjectMemberTests-1695234881 None] Create snapshot completed successfully Jul 31 11:00:19 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-df219f88-9678-4d12-9800-f4935fbb6f7d tempest-ProjectReaderTests-1151784049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0285ed7f-091e-40a6-8080-98165146b75b 1073741824" returned: 0 in 0.477s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-df219f88-9678-4d12-9800-f4935fbb6f7d tempest-ProjectReaderTests-1151784049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0285ed7f-091e-40a6-8080-98165146b75b {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:19 devstack sudo[108238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0285ed7f-091e-40a6-8080-98165146b75b Jul 31 11:00:19 devstack sudo[108238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:19 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-53f39f40-e00c-4fd9-b227-2ccd2a803dec tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-d4aef361-efde-41bf-8373-060ba024ea47-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:19 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-53f39f40-e00c-4fd9-b227-2ccd2a803dec tempest-ProjectMemberTests-1695234881 None] Lock "cinder-d4aef361-efde-41bf-8373-060ba024ea47-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:19 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-53f39f40-e00c-4fd9-b227-2ccd2a803dec tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-quobyte-c9865a84-e5a5-4d09-84e4-de518725a536" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:19 devstack sudo[108238]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-df219f88-9678-4d12-9800-f4935fbb6f7d tempest-ProjectReaderTests-1151784049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0285ed7f-091e-40a6-8080-98165146b75b" returned: 0 in 0.297s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:19 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-df219f88-9678-4d12-9800-f4935fbb6f7d tempest-ProjectReaderTests-1151784049 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:00:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-df219f88-9678-4d12-9800-f4935fbb6f7d tempest-ProjectReaderTests-1151784049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:19 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-53f39f40-e00c-4fd9-b227-2ccd2a803dec tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-c9865a84-e5a5-4d09-84e4-de518725a536" acquired by "delete_snapshot" :: waited 0.033s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:19 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-53f39f40-e00c-4fd9-b227-2ccd2a803dec tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-quobyte-d4aef361-efde-41bf-8373-060ba024ea47" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-edc74544-0e63-46c5-b9a8-e19dda13eaf0 tempest-ProjectReaderTests-655005113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.907s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:19 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-edc74544-0e63-46c5-b9a8-e19dda13eaf0 tempest-ProjectReaderTests-655005113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1526943321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=631cde2c-d1d3-4353-934e-f75e69e94588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b5d38698e144460b69508dad3b475d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:19Z,use_quota=True,user_id='32cefb6cda3e4a039c41146d966b5446',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:00:19 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-edc74544-0e63-46c5-b9a8-e19dda13eaf0 tempest-ProjectReaderTests-655005113 None] Creating volume 631cde2c-d1d3-4353-934e-f75e69e94588 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:00:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-edc74544-0e63-46c5-b9a8-e19dda13eaf0 tempest-ProjectReaderTests-655005113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-edc74544-0e63-46c5-b9a8-e19dda13eaf0 tempest-ProjectReaderTests-655005113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:19 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-edc74544-0e63-46c5-b9a8-e19dda13eaf0 tempest-ProjectReaderTests-655005113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:00:19 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-edc74544-0e63-46c5-b9a8-e19dda13eaf0 tempest-ProjectReaderTests-655005113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:00:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-edc74544-0e63-46c5-b9a8-e19dda13eaf0 tempest-ProjectReaderTests-655005113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:19 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-edc74544-0e63-46c5-b9a8-e19dda13eaf0 tempest-ProjectReaderTests-655005113 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 11:00:19 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-edc74544-0e63-46c5-b9a8-e19dda13eaf0 tempest-ProjectReaderTests-655005113 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 11:00:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-edc74544-0e63-46c5-b9a8-e19dda13eaf0 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:19 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-df219f88-9678-4d12-9800-f4935fbb6f7d tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a605a60-9b26-46e3-9729-ee03b0f531c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0285ed7f-091e-40a6-8080-98165146b75b', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:19 devstack sudo[108241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588 1073741824 Jul 31 11:00:19 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:19 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-df219f88-9678-4d12-9800-f4935fbb6f7d tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68e03963-39c1-4fd2-b465-c1db7da6526c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:19 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-53f39f40-e00c-4fd9-b227-2ccd2a803dec tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-d4aef361-efde-41bf-8373-060ba024ea47" acquired by "_delete_snapshot" :: waited 0.068s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:19 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-53f39f40-e00c-4fd9-b227-2ccd2a803dec tempest-ProjectMemberTests-1695234881 None] Deleting offline snapshot d4aef361-efde-41bf-8373-060ba024ea47 of volume c9865a84-e5a5-4d09-84e4-de518725a536 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:00:19 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-53f39f40-e00c-4fd9-b227-2ccd2a803dec tempest-ProjectMemberTests-1695234881 None] snapshot_file for this snap is: volume-c9865a84-e5a5-4d09-84e4-de518725a536.d4aef361-efde-41bf-8373-060ba024ea47 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:00:19 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-df219f88-9678-4d12-9800-f4935fbb6f7d tempest-ProjectReaderTests-1151784049 None] Volume volume-0285ed7f-091e-40a6-8080-98165146b75b (0285ed7f-091e-40a6-8080-98165146b75b): created successfully Jul 31 11:00:19 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-df219f88-9678-4d12-9800-f4935fbb6f7d tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68e03963-39c1-4fd2-b465-c1db7da6526c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:19 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-df219f88-9678-4d12-9800-f4935fbb6f7d tempest-ProjectReaderTests-1151784049 None] Flow 'volume_create_manager' (9969719f-896b-41c7-86d8-da2b8254796a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:19 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0976058-cb4e-47cf-aac1-b5edcc07885a]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-53f39f40-e00c-4fd9-b227-2ccd2a803dec tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536.d4aef361-efde-41bf-8373-060ba024ea47 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:19 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-df219f88-9678-4d12-9800-f4935fbb6f7d tempest-ProjectReaderTests-1151784049 None] Created volume successfully. Jul 31 11:00:20 devstack sudo[108243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536.d4aef361-efde-41bf-8373-060ba024ea47 Jul 31 11:00:20 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:20 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e096ed2c-cf1c-4074-a4f3-d3911b6869e6 tempest-ProjectReaderTests-1151784049 None] Acquiring lock "cinder-0285ed7f-091e-40a6-8080-98165146b75b-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:20 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e096ed2c-cf1c-4074-a4f3-d3911b6869e6 tempest-ProjectReaderTests-1151784049 None] Lock "cinder-0285ed7f-091e-40a6-8080-98165146b75b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:20 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e096ed2c-cf1c-4074-a4f3-d3911b6869e6 tempest-ProjectReaderTests-1151784049 None] Acquiring lock "cinder-quobyte-0285ed7f-091e-40a6-8080-98165146b75b" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:20 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e096ed2c-cf1c-4074-a4f3-d3911b6869e6 tempest-ProjectReaderTests-1151784049 None] Lock "cinder-quobyte-0285ed7f-091e-40a6-8080-98165146b75b" acquired by "delete_volume" :: waited 0.018s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:20 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[808b2116-f2be-48a3-acce-f4c10bb66700]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e096ed2c-cf1c-4074-a4f3-d3911b6869e6 tempest-ProjectReaderTests-1151784049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0285ed7f-091e-40a6-8080-98165146b75b {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:20 devstack sudo[108248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0285ed7f-091e-40a6-8080-98165146b75b Jul 31 11:00:20 devstack sudo[108248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:20 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-edc74544-0e63-46c5-b9a8-e19dda13eaf0 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588 1073741824" returned: 0 in 0.691s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:20 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-edc74544-0e63-46c5-b9a8-e19dda13eaf0 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-53f39f40-e00c-4fd9-b227-2ccd2a803dec tempest-ProjectMemberTests-1695234881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536.d4aef361-efde-41bf-8373-060ba024ea47" returned: 0 in 0.654s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:20 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-53f39f40-e00c-4fd9-b227-2ccd2a803dec tempest-ProjectMemberTests-1695234881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9865a84-e5a5-4d09-84e4-de518725a536(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:00:20 devstack sudo[108253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588 Jul 31 11:00:20 devstack sudo[108253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:20 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1f3b25-4a09-40ab-91cc-7c68058b9f38]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-53f39f40-e00c-4fd9-b227-2ccd2a803dec tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:20 devstack sudo[108248]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e096ed2c-cf1c-4074-a4f3-d3911b6869e6 tempest-ProjectReaderTests-1151784049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0285ed7f-091e-40a6-8080-98165146b75b" returned: 0 in 0.514s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e096ed2c-cf1c-4074-a4f3-d3911b6869e6 tempest-ProjectReaderTests-1151784049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0285ed7f-091e-40a6-8080-98165146b75b {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:20 devstack sudo[108255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536 Jul 31 11:00:20 devstack sudo[108255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:20 devstack sudo[108259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0285ed7f-091e-40a6-8080-98165146b75b Jul 31 11:00:20 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:20 devstack sudo[108253]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-edc74544-0e63-46c5-b9a8-e19dda13eaf0 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588" returned: 0 in 0.343s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:20 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-edc74544-0e63-46c5-b9a8-e19dda13eaf0 tempest-ProjectReaderTests-655005113 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:00:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-edc74544-0e63-46c5-b9a8-e19dda13eaf0 tempest-ProjectReaderTests-655005113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:20 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-edc74544-0e63-46c5-b9a8-e19dda13eaf0 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (585a7287-2377-4612-ad3e-fe5804295406) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-631cde2c-d1d3-4353-934e-f75e69e94588', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:20 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-edc74544-0e63-46c5-b9a8-e19dda13eaf0 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (678a982f-26bf-4dbe-a5fd-0c26d06651d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:20 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-edc74544-0e63-46c5-b9a8-e19dda13eaf0 tempest-ProjectReaderTests-655005113 None] Volume volume-631cde2c-d1d3-4353-934e-f75e69e94588 (631cde2c-d1d3-4353-934e-f75e69e94588): created successfully Jul 31 11:00:20 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-edc74544-0e63-46c5-b9a8-e19dda13eaf0 tempest-ProjectReaderTests-655005113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (678a982f-26bf-4dbe-a5fd-0c26d06651d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:20 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-edc74544-0e63-46c5-b9a8-e19dda13eaf0 tempest-ProjectReaderTests-655005113 None] Flow 'volume_create_manager' (30a47bd9-9982-42a5-a258-01d063d520c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:20 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-edc74544-0e63-46c5-b9a8-e19dda13eaf0 tempest-ProjectReaderTests-655005113 None] Created volume successfully. Jul 31 11:00:21 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e096ed2c-cf1c-4074-a4f3-d3911b6869e6 tempest-ProjectReaderTests-1151784049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-0285ed7f-091e-40a6-8080-98165146b75b" returned: 0 in 0.272s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:21 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e096ed2c-cf1c-4074-a4f3-d3911b6869e6 tempest-ProjectReaderTests-1151784049 None] Lock "cinder-quobyte-0285ed7f-091e-40a6-8080-98165146b75b" released by "delete_volume" :: held 0.835s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:21 devstack sudo[108255]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-53f39f40-e00c-4fd9-b227-2ccd2a803dec tempest-ProjectMemberTests-1695234881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536" returned: 0 in 0.472s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-53f39f40-e00c-4fd9-b227-2ccd2a803dec tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536.d4aef361-efde-41bf-8373-060ba024ea47 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:21 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-e096ed2c-cf1c-4074-a4f3-d3911b6869e6 tempest-ProjectReaderTests-1151784049 None] Created reservations ['e892c926-376f-40ab-a5a6-04e1263d2f3c', '2f279b1d-1c78-4049-87e2-3ab252149104', '3373b7db-a8e7-49ba-9dd4-cb3b58698044', '58c500d5-f569-46a9-a151-393d264df3cd'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:21 devstack sudo[108267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536.d4aef361-efde-41bf-8373-060ba024ea47 Jul 31 11:00:21 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e096ed2c-cf1c-4074-a4f3-d3911b6869e6 tempest-ProjectReaderTests-1151784049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e096ed2c-cf1c-4074-a4f3-d3911b6869e6 tempest-ProjectReaderTests-1151784049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:21 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-e096ed2c-cf1c-4074-a4f3-d3911b6869e6 tempest-ProjectReaderTests-1151784049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:00:21 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-e096ed2c-cf1c-4074-a4f3-d3911b6869e6 tempest-ProjectReaderTests-1151784049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:00:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e096ed2c-cf1c-4074-a4f3-d3911b6869e6 tempest-ProjectReaderTests-1151784049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e096ed2c-cf1c-4074-a4f3-d3911b6869e6 tempest-ProjectReaderTests-1151784049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:21 devstack sudo[108269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 11:00:21 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:21 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-53f39f40-e00c-4fd9-b227-2ccd2a803dec tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536.d4aef361-efde-41bf-8373-060ba024ea47" returned: 0 in 0.451s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-53f39f40-e00c-4fd9-b227-2ccd2a803dec tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536.d4aef361-efde-41bf-8373-060ba024ea47 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:21 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e096ed2c-cf1c-4074-a4f3-d3911b6869e6 tempest-ProjectReaderTests-1151784049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.353s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:21 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-e096ed2c-cf1c-4074-a4f3-d3911b6869e6 tempest-ProjectReaderTests-1151784049 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:21 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-e096ed2c-cf1c-4074-a4f3-d3911b6869e6 tempest-ProjectReaderTests-1151784049 None] Deleted volume successfully. Jul 31 11:00:21 devstack sudo[108275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536.d4aef361-efde-41bf-8373-060ba024ea47 Jul 31 11:00:21 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:21 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e096ed2c-cf1c-4074-a4f3-d3911b6869e6 tempest-ProjectReaderTests-1151784049 None] Lock "cinder-0285ed7f-091e-40a6-8080-98165146b75b-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:21 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-383ed948-e575-4853-afbd-6f11683bfea3 tempest-ProjectReaderTests-1151784049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:00:21 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:21 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-383ed948-e575-4853-afbd-6f11683bfea3 tempest-ProjectReaderTests-1151784049 None] Flow 'volume_create_manager' (c318767c-8898-4a0c-93e4-5970fc71a4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:21 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-383ed948-e575-4853-afbd-6f11683bfea3 tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee44e3c6-4846-4221-8bb5-4a2fe1ed0507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-53f39f40-e00c-4fd9-b227-2ccd2a803dec tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536.d4aef361-efde-41bf-8373-060ba024ea47" returned: 0 in 0.443s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-383ed948-e575-4853-afbd-6f11683bfea3 tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee44e3c6-4846-4221-8bb5-4a2fe1ed0507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-627778745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4e4fba6-df80-4b0f-b8ec-b6d55d86e569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d2265effb3c4d76b2c4cf25b967bd34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:22Z,use_quota=True,user_id='dd6439e8099b41089fd7a876e7dcbb48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-383ed948-e575-4853-afbd-6f11683bfea3 tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02715d2d-562a-4572-b286-b02828dddba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-383ed948-e575-4853-afbd-6f11683bfea3 tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02715d2d-562a-4572-b286-b02828dddba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-383ed948-e575-4853-afbd-6f11683bfea3 tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6fa4848-8427-48b2-8599-2a37075d1565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-383ed948-e575-4853-afbd-6f11683bfea3 tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6fa4848-8427-48b2-8599-2a37075d1565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4e4fba6-df80-4b0f-b8ec-b6d55d86e569', 'volume_name': 'volume-e4e4fba6-df80-4b0f-b8ec-b6d55d86e569', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-383ed948-e575-4853-afbd-6f11683bfea3 tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (971e33a3-027e-4bad-bfe9-54b6c7da0e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-383ed948-e575-4853-afbd-6f11683bfea3 tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (971e33a3-027e-4bad-bfe9-54b6c7da0e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-383ed948-e575-4853-afbd-6f11683bfea3 tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff4bc184-eb21-44da-bfd5-3e405e56fd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:22 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-383ed948-e575-4853-afbd-6f11683bfea3 tempest-ProjectReaderTests-1151784049 None] Volume e4e4fba6-df80-4b0f-b8ec-b6d55d86e569: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4e4fba6-df80-4b0f-b8ec-b6d55d86e569', 'volume_size': 1} Jul 31 11:00:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-383ed948-e575-4853-afbd-6f11683bfea3 tempest-ProjectReaderTests-1151784049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-383ed948-e575-4853-afbd-6f11683bfea3 tempest-ProjectReaderTests-1151784049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:22 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-383ed948-e575-4853-afbd-6f11683bfea3 tempest-ProjectReaderTests-1151784049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-627778745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4e4fba6-df80-4b0f-b8ec-b6d55d86e569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d2265effb3c4d76b2c4cf25b967bd34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:22Z,use_quota=True,user_id='dd6439e8099b41089fd7a876e7dcbb48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:00:22 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-383ed948-e575-4853-afbd-6f11683bfea3 tempest-ProjectReaderTests-1151784049 None] Creating volume e4e4fba6-df80-4b0f-b8ec-b6d55d86e569 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:00:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-383ed948-e575-4853-afbd-6f11683bfea3 tempest-ProjectReaderTests-1151784049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-383ed948-e575-4853-afbd-6f11683bfea3 tempest-ProjectReaderTests-1151784049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:22 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-383ed948-e575-4853-afbd-6f11683bfea3 tempest-ProjectReaderTests-1151784049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:00:22 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-383ed948-e575-4853-afbd-6f11683bfea3 tempest-ProjectReaderTests-1151784049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:00:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-383ed948-e575-4853-afbd-6f11683bfea3 tempest-ProjectReaderTests-1151784049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:22 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-383ed948-e575-4853-afbd-6f11683bfea3 tempest-ProjectReaderTests-1151784049 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 11:00:22 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-383ed948-e575-4853-afbd-6f11683bfea3 tempest-ProjectReaderTests-1151784049 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 11:00:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-383ed948-e575-4853-afbd-6f11683bfea3 tempest-ProjectReaderTests-1151784049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e4e4fba6-df80-4b0f-b8ec-b6d55d86e569 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:22 devstack sudo[108278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e4e4fba6-df80-4b0f-b8ec-b6d55d86e569 1073741824 Jul 31 11:00:22 devstack sudo[108278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:22 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-53f39f40-e00c-4fd9-b227-2ccd2a803dec tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-d4aef361-efde-41bf-8373-060ba024ea47" released by "_delete_snapshot" :: held 2.321s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:22 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-53f39f40-e00c-4fd9-b227-2ccd2a803dec tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-c9865a84-e5a5-4d09-84e4-de518725a536" released by "delete_snapshot" :: held 2.410s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8f04a0ba-1301-43c7-adaf-0c2e3e7de561 tempest-ProjectReaderTests-655005113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:22 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-53f39f40-e00c-4fd9-b227-2ccd2a803dec tempest-ProjectMemberTests-1695234881 None] Created reservations ['707dd983-b3d3-40ec-83c1-9f01db4dc93c', '3ae2e492-4533-42a5-b1c2-948fb78da2b7', 'b65966d6-f6f5-40fb-a041-9deb3d7a063f', 'fd21e983-105d-4dc4-bed2-9c3db423f465'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:22 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-53f39f40-e00c-4fd9-b227-2ccd2a803dec tempest-ProjectMemberTests-1695234881 None] Delete snapshot completed successfully. Jul 31 11:00:22 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-53f39f40-e00c-4fd9-b227-2ccd2a803dec tempest-ProjectMemberTests-1695234881 None] Lock "cinder-d4aef361-efde-41bf-8373-060ba024ea47-delete_snapshot" released by "delete_snapshot" :: held 2.585s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:22 devstack sudo[108278]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-383ed948-e575-4853-afbd-6f11683bfea3 tempest-ProjectReaderTests-1151784049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e4e4fba6-df80-4b0f-b8ec-b6d55d86e569 1073741824" returned: 0 in 0.506s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-383ed948-e575-4853-afbd-6f11683bfea3 tempest-ProjectReaderTests-1151784049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e4e4fba6-df80-4b0f-b8ec-b6d55d86e569 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:22 devstack sudo[108284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e4e4fba6-df80-4b0f-b8ec-b6d55d86e569 Jul 31 11:00:22 devstack sudo[108284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:22 devstack sudo[108284]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-383ed948-e575-4853-afbd-6f11683bfea3 tempest-ProjectReaderTests-1151784049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e4e4fba6-df80-4b0f-b8ec-b6d55d86e569" returned: 0 in 0.273s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:22 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-383ed948-e575-4853-afbd-6f11683bfea3 tempest-ProjectReaderTests-1151784049 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:00:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-383ed948-e575-4853-afbd-6f11683bfea3 tempest-ProjectReaderTests-1151784049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8f04a0ba-1301-43c7-adaf-0c2e3e7de561 tempest-ProjectReaderTests-655005113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.729s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-383ed948-e575-4853-afbd-6f11683bfea3 tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff4bc184-eb21-44da-bfd5-3e405e56fd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4e4fba6-df80-4b0f-b8ec-b6d55d86e569', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:22 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-383ed948-e575-4853-afbd-6f11683bfea3 tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a88205b7-f7c3-4ef1-b21f-1a62c9168d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:22 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-8f04a0ba-1301-43c7-adaf-0c2e3e7de561 tempest-ProjectReaderTests-655005113 None] Creating offline snapshot a370160e-02b8-4daa-be2c-218cbdce420e of volume 631cde2c-d1d3-4353-934e-f75e69e94588 {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:00:22 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-55e7afcc-a4c7-4ec0-b272-e77b7028bd77 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-c9865a84-e5a5-4d09-84e4-de518725a536-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:23 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-383ed948-e575-4853-afbd-6f11683bfea3 tempest-ProjectReaderTests-1151784049 None] Volume volume-e4e4fba6-df80-4b0f-b8ec-b6d55d86e569 (e4e4fba6-df80-4b0f-b8ec-b6d55d86e569): created successfully Jul 31 11:00:23 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-383ed948-e575-4853-afbd-6f11683bfea3 tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a88205b7-f7c3-4ef1-b21f-1a62c9168d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:23 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-383ed948-e575-4853-afbd-6f11683bfea3 tempest-ProjectReaderTests-1151784049 None] Flow 'volume_create_manager' (c318767c-8898-4a0c-93e4-5970fc71a4c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:23 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38af0bc-58cb-42cc-ab1b-29aa2df71899]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8f04a0ba-1301-43c7-adaf-0c2e3e7de561 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:23 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-55e7afcc-a4c7-4ec0-b272-e77b7028bd77 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-c9865a84-e5a5-4d09-84e4-de518725a536-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:23 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-383ed948-e575-4853-afbd-6f11683bfea3 tempest-ProjectReaderTests-1151784049 None] Created volume successfully. Jul 31 11:00:23 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-55e7afcc-a4c7-4ec0-b272-e77b7028bd77 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-quobyte-c9865a84-e5a5-4d09-84e4-de518725a536" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:23 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-55e7afcc-a4c7-4ec0-b272-e77b7028bd77 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-c9865a84-e5a5-4d09-84e4-de518725a536" acquired by "delete_volume" :: waited 0.016s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:23 devstack sudo[108288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588 Jul 31 11:00:23 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:23 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c209a13-5938-41c0-ac08-3265b2bb4e18]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-55e7afcc-a4c7-4ec0-b272-e77b7028bd77 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:23 devstack sudo[108291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536 Jul 31 11:00:23 devstack sudo[108291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:23 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8f04a0ba-1301-43c7-adaf-0c2e3e7de561 tempest-ProjectReaderTests-655005113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588" returned: 0 in 0.395s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8f04a0ba-1301-43c7-adaf-0c2e3e7de561 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588.a370160e-02b8-4daa-be2c-218cbdce420e 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:23 devstack sudo[108296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588.a370160e-02b8-4daa-be2c-218cbdce420e 1G Jul 31 11:00:23 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:23 devstack sudo[108291]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-55e7afcc-a4c7-4ec0-b272-e77b7028bd77 tempest-ProjectMemberTests-1695234881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536" returned: 0 in 0.397s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-55e7afcc-a4c7-4ec0-b272-e77b7028bd77 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:23 devstack sudo[108301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536 Jul 31 11:00:23 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:23 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-55e7afcc-a4c7-4ec0-b272-e77b7028bd77 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-c9865a84-e5a5-4d09-84e4-de518725a536" returned: 0 in 0.275s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:23 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-55e7afcc-a4c7-4ec0-b272-e77b7028bd77 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-c9865a84-e5a5-4d09-84e4-de518725a536" released by "delete_volume" :: held 0.756s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:23 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8f04a0ba-1301-43c7-adaf-0c2e3e7de561 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588.a370160e-02b8-4daa-be2c-218cbdce420e 1G" returned: 0 in 0.503s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8f04a0ba-1301-43c7-adaf-0c2e3e7de561 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-631cde2c-d1d3-4353-934e-f75e69e94588 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588.a370160e-02b8-4daa-be2c-218cbdce420e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:23 devstack sudo[108307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-631cde2c-d1d3-4353-934e-f75e69e94588 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588.a370160e-02b8-4daa-be2c-218cbdce420e Jul 31 11:00:23 devstack sudo[108307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:23 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-55e7afcc-a4c7-4ec0-b272-e77b7028bd77 tempest-ProjectMemberTests-1695234881 None] Created reservations ['411e6edd-77ae-4e70-85ab-d259caf69a3e', 'a7232f13-14c5-40bd-882c-069c18cf6445', 'a70b9975-53cf-48e9-8f32-77cc9b7a67b3', '8b2ee52f-ac9f-4174-9222-480906cdf5d4'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-55e7afcc-a4c7-4ec0-b272-e77b7028bd77 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-55e7afcc-a4c7-4ec0-b272-e77b7028bd77 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:24 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-55e7afcc-a4c7-4ec0-b272-e77b7028bd77 tempest-ProjectMemberTests-1695234881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:00:24 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-55e7afcc-a4c7-4ec0-b272-e77b7028bd77 tempest-ProjectMemberTests-1695234881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:00:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-55e7afcc-a4c7-4ec0-b272-e77b7028bd77 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-55e7afcc-a4c7-4ec0-b272-e77b7028bd77 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:24 devstack sudo[108309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 11:00:24 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:24 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-38cb727b-a58e-499c-91d0-94494d6899b9 tempest-ProjectReaderTests-1151784049 None] Acquiring lock "cinder-e4e4fba6-df80-4b0f-b8ec-b6d55d86e569-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:24 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-38cb727b-a58e-499c-91d0-94494d6899b9 tempest-ProjectReaderTests-1151784049 None] Lock "cinder-e4e4fba6-df80-4b0f-b8ec-b6d55d86e569-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:24 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-38cb727b-a58e-499c-91d0-94494d6899b9 tempest-ProjectReaderTests-1151784049 None] Acquiring lock "cinder-quobyte-e4e4fba6-df80-4b0f-b8ec-b6d55d86e569" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:24 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-38cb727b-a58e-499c-91d0-94494d6899b9 tempest-ProjectReaderTests-1151784049 None] Lock "cinder-quobyte-e4e4fba6-df80-4b0f-b8ec-b6d55d86e569" acquired by "delete_volume" :: waited 0.020s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:24 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[729480f4-d6e3-44e5-8c8d-db83142552b7]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-38cb727b-a58e-499c-91d0-94494d6899b9 tempest-ProjectReaderTests-1151784049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e4e4fba6-df80-4b0f-b8ec-b6d55d86e569 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:24 devstack sudo[108307]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8f04a0ba-1301-43c7-adaf-0c2e3e7de561 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-631cde2c-d1d3-4353-934e-f75e69e94588 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588.a370160e-02b8-4daa-be2c-218cbdce420e" returned: 0 in 0.468s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:24 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-8f04a0ba-1301-43c7-adaf-0c2e3e7de561 tempest-ProjectReaderTests-655005113 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588.a370160e-02b8-4daa-be2c-218cbdce420e is being set with open permissions: ugo+rw Jul 31 11:00:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8f04a0ba-1301-43c7-adaf-0c2e3e7de561 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588.a370160e-02b8-4daa-be2c-218cbdce420e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:24 devstack sudo[108315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588.a370160e-02b8-4daa-be2c-218cbdce420e Jul 31 11:00:24 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:24 devstack sudo[108314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e4e4fba6-df80-4b0f-b8ec-b6d55d86e569 Jul 31 11:00:24 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:24 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-55e7afcc-a4c7-4ec0-b272-e77b7028bd77 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.519s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:24 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-55e7afcc-a4c7-4ec0-b272-e77b7028bd77 tempest-ProjectMemberTests-1695234881 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:24 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-55e7afcc-a4c7-4ec0-b272-e77b7028bd77 tempest-ProjectMemberTests-1695234881 None] Deleted volume successfully. Jul 31 11:00:24 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-55e7afcc-a4c7-4ec0-b272-e77b7028bd77 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-c9865a84-e5a5-4d09-84e4-de518725a536-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:24 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8f04a0ba-1301-43c7-adaf-0c2e3e7de561 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588.a370160e-02b8-4daa-be2c-218cbdce420e" returned: 0 in 0.412s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:24 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-38cb727b-a58e-499c-91d0-94494d6899b9 tempest-ProjectReaderTests-1151784049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e4e4fba6-df80-4b0f-b8ec-b6d55d86e569" returned: 0 in 0.548s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-38cb727b-a58e-499c-91d0-94494d6899b9 tempest-ProjectReaderTests-1151784049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e4e4fba6-df80-4b0f-b8ec-b6d55d86e569 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8f04a0ba-1301-43c7-adaf-0c2e3e7de561 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:24 devstack sudo[108323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e4e4fba6-df80-4b0f-b8ec-b6d55d86e569 Jul 31 11:00:24 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:24 devstack sudo[108324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588.info Jul 31 11:00:24 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:24 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7f99a9d-a14e-4d27-a5d3-2bc05eb16e38 tempest-ProjectMemberTests-1695234881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:00:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e7f99a9d-a14e-4d27-a5d3-2bc05eb16e38 tempest-ProjectMemberTests-1695234881 None] Flow 'volume_create_manager' (203fd2a9-9f67-4b87-9f04-c57f0c9ae88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e7f99a9d-a14e-4d27-a5d3-2bc05eb16e38 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d394172e-ec3a-41c5-9b41-e88a793febfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e7f99a9d-a14e-4d27-a5d3-2bc05eb16e38 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d394172e-ec3a-41c5-9b41-e88a793febfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1849597807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d5b8feb-6b41-4e1a-ade2-e6388feb6b22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b176847c446546949fa03ac443e36966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:25Z,use_quota=True,user_id='6d7378e77478417881535d0f0f80d4b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e7f99a9d-a14e-4d27-a5d3-2bc05eb16e38 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f707a1b8-a133-4485-922d-149972e0cabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e7f99a9d-a14e-4d27-a5d3-2bc05eb16e38 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f707a1b8-a133-4485-922d-149972e0cabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e7f99a9d-a14e-4d27-a5d3-2bc05eb16e38 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10e0c2ca-6c55-4b62-9023-91a22c67b242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e7f99a9d-a14e-4d27-a5d3-2bc05eb16e38 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10e0c2ca-6c55-4b62-9023-91a22c67b242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d5b8feb-6b41-4e1a-ade2-e6388feb6b22', 'volume_name': 'volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e7f99a9d-a14e-4d27-a5d3-2bc05eb16e38 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e8d0e1b-174d-4f47-9949-6b9878b3804a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e7f99a9d-a14e-4d27-a5d3-2bc05eb16e38 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e8d0e1b-174d-4f47-9949-6b9878b3804a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e7f99a9d-a14e-4d27-a5d3-2bc05eb16e38 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1428634e-6802-40c2-9f61-2ed300af4dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:25 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-e7f99a9d-a14e-4d27-a5d3-2bc05eb16e38 tempest-ProjectMemberTests-1695234881 None] Volume 5d5b8feb-6b41-4e1a-ade2-e6388feb6b22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22', 'volume_size': 1} Jul 31 11:00:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e7f99a9d-a14e-4d27-a5d3-2bc05eb16e38 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:25 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-38cb727b-a58e-499c-91d0-94494d6899b9 tempest-ProjectReaderTests-1151784049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-e4e4fba6-df80-4b0f-b8ec-b6d55d86e569" returned: 0 in 0.321s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:25 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8f04a0ba-1301-43c7-adaf-0c2e3e7de561 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588.info" returned: 0 in 0.301s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:25 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-8f04a0ba-1301-43c7-adaf-0c2e3e7de561 tempest-ProjectReaderTests-655005113 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588.info is being set with open permissions: ugo+rw Jul 31 11:00:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8f04a0ba-1301-43c7-adaf-0c2e3e7de561 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:25 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-38cb727b-a58e-499c-91d0-94494d6899b9 tempest-ProjectReaderTests-1151784049 None] Lock "cinder-quobyte-e4e4fba6-df80-4b0f-b8ec-b6d55d86e569" released by "delete_volume" :: held 0.932s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:25 devstack sudo[108329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588.info Jul 31 11:00:25 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:25 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-38cb727b-a58e-499c-91d0-94494d6899b9 tempest-ProjectReaderTests-1151784049 None] Created reservations ['187bf48a-906a-4783-bde2-e6f09cfc3402', '4ad78384-c047-48cf-9914-70414941809a', '0969621f-deb3-4c25-ab56-cd5c6da9b63f', '2698ebf9-7713-4fd6-be52-7cd8362ee1dc'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-38cb727b-a58e-499c-91d0-94494d6899b9 tempest-ProjectReaderTests-1151784049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-38cb727b-a58e-499c-91d0-94494d6899b9 tempest-ProjectReaderTests-1151784049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:25 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-38cb727b-a58e-499c-91d0-94494d6899b9 tempest-ProjectReaderTests-1151784049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:00:25 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-38cb727b-a58e-499c-91d0-94494d6899b9 tempest-ProjectReaderTests-1151784049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:00:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-38cb727b-a58e-499c-91d0-94494d6899b9 tempest-ProjectReaderTests-1151784049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-38cb727b-a58e-499c-91d0-94494d6899b9 tempest-ProjectReaderTests-1151784049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:25 devstack sudo[108331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 11:00:25 devstack sudo[108331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:25 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8f04a0ba-1301-43c7-adaf-0c2e3e7de561 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588.info" returned: 0 in 0.322s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8f04a0ba-1301-43c7-adaf-0c2e3e7de561 tempest-ProjectReaderTests-655005113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.579s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e7f99a9d-a14e-4d27-a5d3-2bc05eb16e38 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.420s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:25 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-e7f99a9d-a14e-4d27-a5d3-2bc05eb16e38 tempest-ProjectMemberTests-1695234881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1849597807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d5b8feb-6b41-4e1a-ade2-e6388feb6b22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b176847c446546949fa03ac443e36966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:25Z,use_quota=True,user_id='6d7378e77478417881535d0f0f80d4b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:00:25 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-e7f99a9d-a14e-4d27-a5d3-2bc05eb16e38 tempest-ProjectMemberTests-1695234881 None] Creating volume 5d5b8feb-6b41-4e1a-ade2-e6388feb6b22 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:00:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e7f99a9d-a14e-4d27-a5d3-2bc05eb16e38 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e7f99a9d-a14e-4d27-a5d3-2bc05eb16e38 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:25 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-e7f99a9d-a14e-4d27-a5d3-2bc05eb16e38 tempest-ProjectMemberTests-1695234881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:00:25 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-e7f99a9d-a14e-4d27-a5d3-2bc05eb16e38 tempest-ProjectMemberTests-1695234881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:00:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e7f99a9d-a14e-4d27-a5d3-2bc05eb16e38 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:25 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-e7f99a9d-a14e-4d27-a5d3-2bc05eb16e38 tempest-ProjectMemberTests-1695234881 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 11:00:25 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-e7f99a9d-a14e-4d27-a5d3-2bc05eb16e38 tempest-ProjectMemberTests-1695234881 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 11:00:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e7f99a9d-a14e-4d27-a5d3-2bc05eb16e38 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:25 devstack sudo[108334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22 1073741824 Jul 31 11:00:25 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:25 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-8f04a0ba-1301-43c7-adaf-0c2e3e7de561 tempest-ProjectReaderTests-655005113 None] Create snapshot completed successfully Jul 31 11:00:25 devstack sudo[108331]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-38cb727b-a58e-499c-91d0-94494d6899b9 tempest-ProjectReaderTests-1151784049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.348s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:25 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-38cb727b-a58e-499c-91d0-94494d6899b9 tempest-ProjectReaderTests-1151784049 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:25 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-38cb727b-a58e-499c-91d0-94494d6899b9 tempest-ProjectReaderTests-1151784049 None] Deleted volume successfully. Jul 31 11:00:25 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-38cb727b-a58e-499c-91d0-94494d6899b9 tempest-ProjectReaderTests-1151784049 None] Lock "cinder-e4e4fba6-df80-4b0f-b8ec-b6d55d86e569-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-2575582f-5f9e-4455-a23a-a6d314136c37 tempest-ProjectReaderTests-1151784049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2575582f-5f9e-4455-a23a-a6d314136c37 tempest-ProjectReaderTests-1151784049 None] Flow 'volume_create_manager' (8e1e9e5b-e1f4-4a9e-9a72-477aefd9546a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2575582f-5f9e-4455-a23a-a6d314136c37 tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbde464b-075c-4289-80d8-f2dddd041513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2575582f-5f9e-4455-a23a-a6d314136c37 tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbde464b-075c-4289-80d8-f2dddd041513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-735737341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=459eabab-2bc5-49ba-b8dc-db6516de2b4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d2265effb3c4d76b2c4cf25b967bd34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:26Z,use_quota=True,user_id='dd6439e8099b41089fd7a876e7dcbb48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2575582f-5f9e-4455-a23a-a6d314136c37 tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a903213-869b-4715-ba4f-39d9105aa401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2575582f-5f9e-4455-a23a-a6d314136c37 tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a903213-869b-4715-ba4f-39d9105aa401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2575582f-5f9e-4455-a23a-a6d314136c37 tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f1f96ca-fd8c-40ac-8244-2185b6266a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2575582f-5f9e-4455-a23a-a6d314136c37 tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f1f96ca-fd8c-40ac-8244-2185b6266a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '459eabab-2bc5-49ba-b8dc-db6516de2b4b', 'volume_name': 'volume-459eabab-2bc5-49ba-b8dc-db6516de2b4b', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:26 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2575582f-5f9e-4455-a23a-a6d314136c37 tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4c3c294-8615-49c8-adb6-639ab7661cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2575582f-5f9e-4455-a23a-a6d314136c37 tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4c3c294-8615-49c8-adb6-639ab7661cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2575582f-5f9e-4455-a23a-a6d314136c37 tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (036327d6-894e-451d-8ff0-3be623121111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:26 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-2575582f-5f9e-4455-a23a-a6d314136c37 tempest-ProjectReaderTests-1151784049 None] Volume 459eabab-2bc5-49ba-b8dc-db6516de2b4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-459eabab-2bc5-49ba-b8dc-db6516de2b4b', 'volume_size': 1} Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2575582f-5f9e-4455-a23a-a6d314136c37 tempest-ProjectReaderTests-1151784049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e7f99a9d-a14e-4d27-a5d3-2bc05eb16e38 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22 1073741824" returned: 0 in 0.624s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e7f99a9d-a14e-4d27-a5d3-2bc05eb16e38 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:26 devstack sudo[108342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22 Jul 31 11:00:26 devstack sudo[108342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d9896ce9-07ed-4e02-858e-90ddfa650eaf tempest-ProjectReaderTests-655005113 None] Acquiring lock "cinder-a370160e-02b8-4daa-be2c-218cbdce420e-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d9896ce9-07ed-4e02-858e-90ddfa650eaf tempest-ProjectReaderTests-655005113 None] Lock "cinder-a370160e-02b8-4daa-be2c-218cbdce420e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d9896ce9-07ed-4e02-858e-90ddfa650eaf tempest-ProjectReaderTests-655005113 None] Acquiring lock "cinder-quobyte-631cde2c-d1d3-4353-934e-f75e69e94588" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d9896ce9-07ed-4e02-858e-90ddfa650eaf tempest-ProjectReaderTests-655005113 None] Lock "cinder-quobyte-631cde2c-d1d3-4353-934e-f75e69e94588" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d9896ce9-07ed-4e02-858e-90ddfa650eaf tempest-ProjectReaderTests-655005113 None] Acquiring lock "cinder-quobyte-a370160e-02b8-4daa-be2c-218cbdce420e" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d9896ce9-07ed-4e02-858e-90ddfa650eaf tempest-ProjectReaderTests-655005113 None] Lock "cinder-quobyte-a370160e-02b8-4daa-be2c-218cbdce420e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:26 devstack sudo[108342]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-d9896ce9-07ed-4e02-858e-90ddfa650eaf tempest-ProjectReaderTests-655005113 None] Deleting offline snapshot a370160e-02b8-4daa-be2c-218cbdce420e of volume 631cde2c-d1d3-4353-934e-f75e69e94588 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-d9896ce9-07ed-4e02-858e-90ddfa650eaf tempest-ProjectReaderTests-655005113 None] snapshot_file for this snap is: volume-631cde2c-d1d3-4353-934e-f75e69e94588.a370160e-02b8-4daa-be2c-218cbdce420e {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e7f99a9d-a14e-4d27-a5d3-2bc05eb16e38 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22" returned: 0 in 0.389s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-e7f99a9d-a14e-4d27-a5d3-2bc05eb16e38 tempest-ProjectMemberTests-1695234881 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e7f99a9d-a14e-4d27-a5d3-2bc05eb16e38 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2575582f-5f9e-4455-a23a-a6d314136c37 tempest-ProjectReaderTests-1151784049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.437s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2575582f-5f9e-4455-a23a-a6d314136c37 tempest-ProjectReaderTests-1151784049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-735737341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=459eabab-2bc5-49ba-b8dc-db6516de2b4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d2265effb3c4d76b2c4cf25b967bd34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:26Z,use_quota=True,user_id='dd6439e8099b41089fd7a876e7dcbb48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-2575582f-5f9e-4455-a23a-a6d314136c37 tempest-ProjectReaderTests-1151784049 None] Creating volume 459eabab-2bc5-49ba-b8dc-db6516de2b4b {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2575582f-5f9e-4455-a23a-a6d314136c37 tempest-ProjectReaderTests-1151784049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2575582f-5f9e-4455-a23a-a6d314136c37 tempest-ProjectReaderTests-1151784049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2575582f-5f9e-4455-a23a-a6d314136c37 tempest-ProjectReaderTests-1151784049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2575582f-5f9e-4455-a23a-a6d314136c37 tempest-ProjectReaderTests-1151784049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2575582f-5f9e-4455-a23a-a6d314136c37 tempest-ProjectReaderTests-1151784049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2575582f-5f9e-4455-a23a-a6d314136c37 tempest-ProjectReaderTests-1151784049 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 11:00:26 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-2575582f-5f9e-4455-a23a-a6d314136c37 tempest-ProjectReaderTests-1151784049 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2575582f-5f9e-4455-a23a-a6d314136c37 tempest-ProjectReaderTests-1151784049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-459eabab-2bc5-49ba-b8dc-db6516de2b4b 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ad9c86-24b6-4672-a4f5-c39f802b7880]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d9896ce9-07ed-4e02-858e-90ddfa650eaf tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588.a370160e-02b8-4daa-be2c-218cbdce420e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:26 devstack sudo[108345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-459eabab-2bc5-49ba-b8dc-db6516de2b4b 1073741824 Jul 31 11:00:26 devstack sudo[108345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e7f99a9d-a14e-4d27-a5d3-2bc05eb16e38 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1428634e-6802-40c2-9f61-2ed300af4dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e7f99a9d-a14e-4d27-a5d3-2bc05eb16e38 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daccdeb4-ed28-4c83-97bf-8af027315ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:26 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-e7f99a9d-a14e-4d27-a5d3-2bc05eb16e38 tempest-ProjectMemberTests-1695234881 None] Volume volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22 (5d5b8feb-6b41-4e1a-ade2-e6388feb6b22): created successfully Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e7f99a9d-a14e-4d27-a5d3-2bc05eb16e38 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daccdeb4-ed28-4c83-97bf-8af027315ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-e7f99a9d-a14e-4d27-a5d3-2bc05eb16e38 tempest-ProjectMemberTests-1695234881 None] Flow 'volume_create_manager' (203fd2a9-9f67-4b87-9f04-c57f0c9ae88e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:26 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-e7f99a9d-a14e-4d27-a5d3-2bc05eb16e38 tempest-ProjectMemberTests-1695234881 None] Created volume successfully. Jul 31 11:00:26 devstack sudo[108346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588.a370160e-02b8-4daa-be2c-218cbdce420e Jul 31 11:00:26 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:27 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d9896ce9-07ed-4e02-858e-90ddfa650eaf tempest-ProjectReaderTests-655005113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588.a370160e-02b8-4daa-be2c-218cbdce420e" returned: 0 in 0.458s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:27 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-d9896ce9-07ed-4e02-858e-90ddfa650eaf tempest-ProjectReaderTests-655005113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-631cde2c-d1d3-4353-934e-f75e69e94588(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:00:27 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4a187f-33c5-4e9a-8d19-056e9e27b256]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d9896ce9-07ed-4e02-858e-90ddfa650eaf tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:27 devstack sudo[108345]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2575582f-5f9e-4455-a23a-a6d314136c37 tempest-ProjectReaderTests-1151784049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-459eabab-2bc5-49ba-b8dc-db6516de2b4b 1073741824" returned: 0 in 0.618s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2575582f-5f9e-4455-a23a-a6d314136c37 tempest-ProjectReaderTests-1151784049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-459eabab-2bc5-49ba-b8dc-db6516de2b4b {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:27 devstack sudo[108355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588 Jul 31 11:00:27 devstack sudo[108355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:27 devstack sudo[108356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-459eabab-2bc5-49ba-b8dc-db6516de2b4b Jul 31 11:00:27 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-fa2ad5af-32fc-41d7-a4dc-3a32bb2a316d tempest-ProjectMemberTests-1695234881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:27 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2575582f-5f9e-4455-a23a-a6d314136c37 tempest-ProjectReaderTests-1151784049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-459eabab-2bc5-49ba-b8dc-db6516de2b4b" returned: 0 in 0.380s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:27 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2575582f-5f9e-4455-a23a-a6d314136c37 tempest-ProjectReaderTests-1151784049 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:00:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2575582f-5f9e-4455-a23a-a6d314136c37 tempest-ProjectReaderTests-1151784049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:27 devstack sudo[108355]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-fa2ad5af-32fc-41d7-a4dc-3a32bb2a316d tempest-ProjectMemberTests-1695234881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.277s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d9896ce9-07ed-4e02-858e-90ddfa650eaf tempest-ProjectReaderTests-655005113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588" returned: 0 in 0.528s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d9896ce9-07ed-4e02-858e-90ddfa650eaf tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588.a370160e-02b8-4daa-be2c-218cbdce420e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2575582f-5f9e-4455-a23a-a6d314136c37 tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (036327d6-894e-451d-8ff0-3be623121111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-459eabab-2bc5-49ba-b8dc-db6516de2b4b', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2575582f-5f9e-4455-a23a-a6d314136c37 tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbbf0790-2e98-4b4f-9900-2ee334b5aa25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:27 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588.a370160e-02b8-4daa-be2c-218cbdce420e Jul 31 11:00:27 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:27 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-fa2ad5af-32fc-41d7-a4dc-3a32bb2a316d tempest-ProjectMemberTests-1695234881 None] Creating offline snapshot c8a1acdf-4a61-404e-919d-44611f6fdf94 of volume 5d5b8feb-6b41-4e1a-ade2-e6388feb6b22 {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:00:27 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-2575582f-5f9e-4455-a23a-a6d314136c37 tempest-ProjectReaderTests-1151784049 None] Volume volume-459eabab-2bc5-49ba-b8dc-db6516de2b4b (459eabab-2bc5-49ba-b8dc-db6516de2b4b): created successfully Jul 31 11:00:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2575582f-5f9e-4455-a23a-a6d314136c37 tempest-ProjectReaderTests-1151784049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbbf0790-2e98-4b4f-9900-2ee334b5aa25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:27 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-2575582f-5f9e-4455-a23a-a6d314136c37 tempest-ProjectReaderTests-1151784049 None] Flow 'volume_create_manager' (8e1e9e5b-e1f4-4a9e-9a72-477aefd9546a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:27 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbd37e2-bf05-4458-89fe-d14f75488fa6]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fa2ad5af-32fc-41d7-a4dc-3a32bb2a316d tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:27 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-2575582f-5f9e-4455-a23a-a6d314136c37 tempest-ProjectReaderTests-1151784049 None] Created volume successfully. Jul 31 11:00:27 devstack sudo[108365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22 Jul 31 11:00:27 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:28 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d9896ce9-07ed-4e02-858e-90ddfa650eaf tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588.a370160e-02b8-4daa-be2c-218cbdce420e" returned: 0 in 0.466s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d9896ce9-07ed-4e02-858e-90ddfa650eaf tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588.a370160e-02b8-4daa-be2c-218cbdce420e {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:28 devstack sudo[108374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588.a370160e-02b8-4daa-be2c-218cbdce420e Jul 31 11:00:28 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:28 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fa2ad5af-32fc-41d7-a4dc-3a32bb2a316d tempest-ProjectMemberTests-1695234881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22" returned: 0 in 0.450s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fa2ad5af-32fc-41d7-a4dc-3a32bb2a316d tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22.c8a1acdf-4a61-404e-919d-44611f6fdf94 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:28 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-c1f1cb44-01d4-4b95-95ac-823cea54d814 tempest-ProjectReaderTests-1151784049 None] Acquiring lock "cinder-459eabab-2bc5-49ba-b8dc-db6516de2b4b-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:28 devstack sudo[108376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22.c8a1acdf-4a61-404e-919d-44611f6fdf94 1G Jul 31 11:00:28 devstack sudo[108376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:28 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-c1f1cb44-01d4-4b95-95ac-823cea54d814 tempest-ProjectReaderTests-1151784049 None] Lock "cinder-459eabab-2bc5-49ba-b8dc-db6516de2b4b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:28 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-c1f1cb44-01d4-4b95-95ac-823cea54d814 tempest-ProjectReaderTests-1151784049 None] Acquiring lock "cinder-quobyte-459eabab-2bc5-49ba-b8dc-db6516de2b4b" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:28 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-c1f1cb44-01d4-4b95-95ac-823cea54d814 tempest-ProjectReaderTests-1151784049 None] Lock "cinder-quobyte-459eabab-2bc5-49ba-b8dc-db6516de2b4b" acquired by "delete_volume" :: waited 0.021s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:28 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[911d8515-4b9f-4c3e-ba09-f7cbd9ddf87d]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c1f1cb44-01d4-4b95-95ac-823cea54d814 tempest-ProjectReaderTests-1151784049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-459eabab-2bc5-49ba-b8dc-db6516de2b4b {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:28 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d9896ce9-07ed-4e02-858e-90ddfa650eaf tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588.a370160e-02b8-4daa-be2c-218cbdce420e" returned: 0 in 0.401s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:28 devstack sudo[108378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-459eabab-2bc5-49ba-b8dc-db6516de2b4b Jul 31 11:00:28 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:28 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d9896ce9-07ed-4e02-858e-90ddfa650eaf tempest-ProjectReaderTests-655005113 None] Lock "cinder-quobyte-a370160e-02b8-4daa-be2c-218cbdce420e" released by "_delete_snapshot" :: held 2.021s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:28 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d9896ce9-07ed-4e02-858e-90ddfa650eaf tempest-ProjectReaderTests-655005113 None] Lock "cinder-quobyte-631cde2c-d1d3-4353-934e-f75e69e94588" released by "delete_snapshot" :: held 2.058s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:28 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-d9896ce9-07ed-4e02-858e-90ddfa650eaf tempest-ProjectReaderTests-655005113 None] Created reservations ['5f979279-77ae-408b-a039-091b18613e00', '20d78fa5-85b5-4132-b50e-7919a24967bb', 'ec8e6ce3-c25c-454f-b021-796c3ea3f28c', 'b6c565da-dfb8-4dce-9335-afcda19ecc95'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:28 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-d9896ce9-07ed-4e02-858e-90ddfa650eaf tempest-ProjectReaderTests-655005113 None] Delete snapshot completed successfully. Jul 31 11:00:28 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d9896ce9-07ed-4e02-858e-90ddfa650eaf tempest-ProjectReaderTests-655005113 None] Lock "cinder-a370160e-02b8-4daa-be2c-218cbdce420e-delete_snapshot" released by "delete_snapshot" :: held 2.271s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:28 devstack sudo[108376]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fa2ad5af-32fc-41d7-a4dc-3a32bb2a316d tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22.c8a1acdf-4a61-404e-919d-44611f6fdf94 1G" returned: 0 in 0.626s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fa2ad5af-32fc-41d7-a4dc-3a32bb2a316d tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22.c8a1acdf-4a61-404e-919d-44611f6fdf94 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:28 devstack sudo[108387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22.c8a1acdf-4a61-404e-919d-44611f6fdf94 Jul 31 11:00:28 devstack sudo[108387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:28 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c1f1cb44-01d4-4b95-95ac-823cea54d814 tempest-ProjectReaderTests-1151784049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-459eabab-2bc5-49ba-b8dc-db6516de2b4b" returned: 0 in 0.508s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c1f1cb44-01d4-4b95-95ac-823cea54d814 tempest-ProjectReaderTests-1151784049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-459eabab-2bc5-49ba-b8dc-db6516de2b4b {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:28 devstack sudo[108391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-459eabab-2bc5-49ba-b8dc-db6516de2b4b Jul 31 11:00:28 devstack sudo[108391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:29 devstack sudo[108387]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fa2ad5af-32fc-41d7-a4dc-3a32bb2a316d tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22.c8a1acdf-4a61-404e-919d-44611f6fdf94" returned: 0 in 0.347s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:29 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-fa2ad5af-32fc-41d7-a4dc-3a32bb2a316d tempest-ProjectMemberTests-1695234881 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22.c8a1acdf-4a61-404e-919d-44611f6fdf94 is being set with open permissions: ugo+rw Jul 31 11:00:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fa2ad5af-32fc-41d7-a4dc-3a32bb2a316d tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22.c8a1acdf-4a61-404e-919d-44611f6fdf94 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:29 devstack sudo[108397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22.c8a1acdf-4a61-404e-919d-44611f6fdf94 Jul 31 11:00:29 devstack sudo[108397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:29 devstack sudo[108391]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c1f1cb44-01d4-4b95-95ac-823cea54d814 tempest-ProjectReaderTests-1151784049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-459eabab-2bc5-49ba-b8dc-db6516de2b4b" returned: 0 in 0.310s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:29 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-c1f1cb44-01d4-4b95-95ac-823cea54d814 tempest-ProjectReaderTests-1151784049 None] Lock "cinder-quobyte-459eabab-2bc5-49ba-b8dc-db6516de2b4b" released by "delete_volume" :: held 0.904s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:29 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-c1f1cb44-01d4-4b95-95ac-823cea54d814 tempest-ProjectReaderTests-1151784049 None] Created reservations ['5bef30cb-758f-4f34-8895-6f9626f270f8', '2fa5eb0e-18e3-4ee9-85ce-71b9edcb22ad', 'e2805c02-b4bc-43a0-a590-ff12b9539d59', 'e5dd5232-f01d-453d-ac9b-be2e68f005ee'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c1f1cb44-01d4-4b95-95ac-823cea54d814 tempest-ProjectReaderTests-1151784049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c1f1cb44-01d4-4b95-95ac-823cea54d814 tempest-ProjectReaderTests-1151784049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:29 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c1f1cb44-01d4-4b95-95ac-823cea54d814 tempest-ProjectReaderTests-1151784049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:00:29 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c1f1cb44-01d4-4b95-95ac-823cea54d814 tempest-ProjectReaderTests-1151784049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:00:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c1f1cb44-01d4-4b95-95ac-823cea54d814 tempest-ProjectReaderTests-1151784049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c1f1cb44-01d4-4b95-95ac-823cea54d814 tempest-ProjectReaderTests-1151784049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:29 devstack sudo[108399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 11:00:29 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:29 devstack sudo[108397]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fa2ad5af-32fc-41d7-a4dc-3a32bb2a316d tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22.c8a1acdf-4a61-404e-919d-44611f6fdf94" returned: 0 in 0.374s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fa2ad5af-32fc-41d7-a4dc-3a32bb2a316d tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:29 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22.info Jul 31 11:00:29 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:29 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c1f1cb44-01d4-4b95-95ac-823cea54d814 tempest-ProjectReaderTests-1151784049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.309s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:29 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-c1f1cb44-01d4-4b95-95ac-823cea54d814 tempest-ProjectReaderTests-1151784049 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:29 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-c1f1cb44-01d4-4b95-95ac-823cea54d814 tempest-ProjectReaderTests-1151784049 None] Deleted volume successfully. Jul 31 11:00:29 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ccf0e8d0-461b-450c-87ed-91424ed7fd96 tempest-ProjectReaderTests-655005113 None] Acquiring lock "cinder-631cde2c-d1d3-4353-934e-f75e69e94588-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:29 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ccf0e8d0-461b-450c-87ed-91424ed7fd96 tempest-ProjectReaderTests-655005113 None] Lock "cinder-631cde2c-d1d3-4353-934e-f75e69e94588-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:29 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-c1f1cb44-01d4-4b95-95ac-823cea54d814 tempest-ProjectReaderTests-1151784049 None] Lock "cinder-459eabab-2bc5-49ba-b8dc-db6516de2b4b-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:29 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ccf0e8d0-461b-450c-87ed-91424ed7fd96 tempest-ProjectReaderTests-655005113 None] Acquiring lock "cinder-quobyte-631cde2c-d1d3-4353-934e-f75e69e94588" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:29 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ccf0e8d0-461b-450c-87ed-91424ed7fd96 tempest-ProjectReaderTests-655005113 None] Lock "cinder-quobyte-631cde2c-d1d3-4353-934e-f75e69e94588" acquired by "delete_volume" :: waited 0.029s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:29 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:29 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30f1085-b154-4110-b2a4-546d1a0fcca9]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ccf0e8d0-461b-450c-87ed-91424ed7fd96 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fa2ad5af-32fc-41d7-a4dc-3a32bb2a316d tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22.info" returned: 0 in 0.391s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:29 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-fa2ad5af-32fc-41d7-a4dc-3a32bb2a316d tempest-ProjectMemberTests-1695234881 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22.info is being set with open permissions: ugo+rw Jul 31 11:00:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fa2ad5af-32fc-41d7-a4dc-3a32bb2a316d tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:29 devstack sudo[108407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22.info Jul 31 11:00:29 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:30 devstack sudo[108406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588 Jul 31 11:00:30 devstack sudo[108406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:30 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fa2ad5af-32fc-41d7-a4dc-3a32bb2a316d tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22.info" returned: 0 in 0.309s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-fa2ad5af-32fc-41d7-a4dc-3a32bb2a316d tempest-ProjectMemberTests-1695234881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.634s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:30 devstack sudo[108406]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ccf0e8d0-461b-450c-87ed-91424ed7fd96 tempest-ProjectReaderTests-655005113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588" returned: 0 in 0.419s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ccf0e8d0-461b-450c-87ed-91424ed7fd96 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:30 devstack sudo[108414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588 Jul 31 11:00:30 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:30 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-fa2ad5af-32fc-41d7-a4dc-3a32bb2a316d tempest-ProjectMemberTests-1695234881 None] Create snapshot completed successfully Jul 31 11:00:30 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-fef9e07f-7837-49de-b0f3-1c2ef6f97d4d tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-c8a1acdf-4a61-404e-919d-44611f6fdf94-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:30 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-fef9e07f-7837-49de-b0f3-1c2ef6f97d4d tempest-ProjectMemberTests-1695234881 None] Lock "cinder-c8a1acdf-4a61-404e-919d-44611f6fdf94-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:30 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-fef9e07f-7837-49de-b0f3-1c2ef6f97d4d tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-quobyte-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:30 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-fef9e07f-7837-49de-b0f3-1c2ef6f97d4d tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:30 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-fef9e07f-7837-49de-b0f3-1c2ef6f97d4d tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-quobyte-c8a1acdf-4a61-404e-919d-44611f6fdf94" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:30 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-fef9e07f-7837-49de-b0f3-1c2ef6f97d4d tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-c8a1acdf-4a61-404e-919d-44611f6fdf94" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:30 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-fef9e07f-7837-49de-b0f3-1c2ef6f97d4d tempest-ProjectMemberTests-1695234881 None] Deleting offline snapshot c8a1acdf-4a61-404e-919d-44611f6fdf94 of volume 5d5b8feb-6b41-4e1a-ade2-e6388feb6b22 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:00:30 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-fef9e07f-7837-49de-b0f3-1c2ef6f97d4d tempest-ProjectMemberTests-1695234881 None] snapshot_file for this snap is: volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22.c8a1acdf-4a61-404e-919d-44611f6fdf94 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:00:30 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1c67b0-e79a-49e5-a804-3d732e9bd738]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fef9e07f-7837-49de-b0f3-1c2ef6f97d4d tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22.c8a1acdf-4a61-404e-919d-44611f6fdf94 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:30 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ccf0e8d0-461b-450c-87ed-91424ed7fd96 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-631cde2c-d1d3-4353-934e-f75e69e94588" returned: 0 in 0.391s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:30 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ccf0e8d0-461b-450c-87ed-91424ed7fd96 tempest-ProjectReaderTests-655005113 None] Lock "cinder-quobyte-631cde2c-d1d3-4353-934e-f75e69e94588" released by "delete_volume" :: held 0.915s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:30 devstack sudo[108417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22.c8a1acdf-4a61-404e-919d-44611f6fdf94 Jul 31 11:00:30 devstack sudo[108417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:30 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-ccf0e8d0-461b-450c-87ed-91424ed7fd96 tempest-ProjectReaderTests-655005113 None] Created reservations ['63028fe4-2e92-458f-8af8-3d09787b89f7', '7dae4b01-e402-4cf6-b536-17637c1d5a61', '20f98c9b-3910-4c85-98c1-d52aa5af2a66', '4541e131-be65-46fd-a0a6-3c72ac9a4c95'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ccf0e8d0-461b-450c-87ed-91424ed7fd96 tempest-ProjectReaderTests-655005113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ccf0e8d0-461b-450c-87ed-91424ed7fd96 tempest-ProjectReaderTests-655005113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:31 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ccf0e8d0-461b-450c-87ed-91424ed7fd96 tempest-ProjectReaderTests-655005113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:00:31 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-ccf0e8d0-461b-450c-87ed-91424ed7fd96 tempest-ProjectReaderTests-655005113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:00:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-ccf0e8d0-461b-450c-87ed-91424ed7fd96 tempest-ProjectReaderTests-655005113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ccf0e8d0-461b-450c-87ed-91424ed7fd96 tempest-ProjectReaderTests-655005113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:31 devstack sudo[108419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 11:00:31 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:31 devstack sudo[108417]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fef9e07f-7837-49de-b0f3-1c2ef6f97d4d tempest-ProjectMemberTests-1695234881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22.c8a1acdf-4a61-404e-919d-44611f6fdf94" returned: 0 in 0.579s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:31 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-fef9e07f-7837-49de-b0f3-1c2ef6f97d4d tempest-ProjectMemberTests-1695234881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:00:31 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[82089208-7df3-4658-818e-9f4d7d4d7b72]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fef9e07f-7837-49de-b0f3-1c2ef6f97d4d tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:31 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-ccf0e8d0-461b-450c-87ed-91424ed7fd96 tempest-ProjectReaderTests-655005113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.345s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:31 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-ccf0e8d0-461b-450c-87ed-91424ed7fd96 tempest-ProjectReaderTests-655005113 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:31 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-ccf0e8d0-461b-450c-87ed-91424ed7fd96 tempest-ProjectReaderTests-655005113 None] Deleted volume successfully. Jul 31 11:00:31 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-ccf0e8d0-461b-450c-87ed-91424ed7fd96 tempest-ProjectReaderTests-655005113 None] Lock "cinder-631cde2c-d1d3-4353-934e-f75e69e94588-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:31 devstack sudo[108424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22 Jul 31 11:00:31 devstack sudo[108424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:31 devstack sudo[108424]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fef9e07f-7837-49de-b0f3-1c2ef6f97d4d tempest-ProjectMemberTests-1695234881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22" returned: 0 in 0.567s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fef9e07f-7837-49de-b0f3-1c2ef6f97d4d tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22.c8a1acdf-4a61-404e-919d-44611f6fdf94 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:31 devstack sudo[108430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22.c8a1acdf-4a61-404e-919d-44611f6fdf94 Jul 31 11:00:31 devstack sudo[108430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:32 devstack sudo[108430]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fef9e07f-7837-49de-b0f3-1c2ef6f97d4d tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22.c8a1acdf-4a61-404e-919d-44611f6fdf94" returned: 0 in 0.479s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fef9e07f-7837-49de-b0f3-1c2ef6f97d4d tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22.c8a1acdf-4a61-404e-919d-44611f6fdf94 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:32 devstack sudo[108436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22.c8a1acdf-4a61-404e-919d-44611f6fdf94 Jul 31 11:00:32 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:32 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fef9e07f-7837-49de-b0f3-1c2ef6f97d4d tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22.c8a1acdf-4a61-404e-919d-44611f6fdf94" returned: 0 in 0.299s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:32 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-fef9e07f-7837-49de-b0f3-1c2ef6f97d4d tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-c8a1acdf-4a61-404e-919d-44611f6fdf94" released by "_delete_snapshot" :: held 2.065s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:32 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-fef9e07f-7837-49de-b0f3-1c2ef6f97d4d tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22" released by "delete_snapshot" :: held 2.096s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:32 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-fef9e07f-7837-49de-b0f3-1c2ef6f97d4d tempest-ProjectMemberTests-1695234881 None] Created reservations ['9eb683dc-949c-40ef-b2f5-d10475a89bad', 'dd8fa7fc-e94f-4330-a57f-268244cf7568', '4a7cb701-1851-429c-a113-9a66b2dd8b8f', '1322c1f5-6ba6-459e-939c-ac66540ecaa3'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:32 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-fef9e07f-7837-49de-b0f3-1c2ef6f97d4d tempest-ProjectMemberTests-1695234881 None] Delete snapshot completed successfully. Jul 31 11:00:32 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-fef9e07f-7837-49de-b0f3-1c2ef6f97d4d tempest-ProjectMemberTests-1695234881 None] Lock "cinder-c8a1acdf-4a61-404e-919d-44611f6fdf94-delete_snapshot" released by "delete_snapshot" :: held 2.265s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:33 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-44c5ca5e-d069-4875-83b3-da3524d8b60e tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:34 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-44c5ca5e-d069-4875-83b3-da3524d8b60e tempest-ProjectMemberTests-1695234881 None] Lock "cinder-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:34 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-44c5ca5e-d069-4875-83b3-da3524d8b60e tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-quobyte-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:34 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-44c5ca5e-d069-4875-83b3-da3524d8b60e tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22" acquired by "delete_volume" :: waited 0.021s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:34 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fd23d7-4e9e-4dc4-a04c-f2b4b2f3437b]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-44c5ca5e-d069-4875-83b3-da3524d8b60e tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:34 devstack sudo[108440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22 Jul 31 11:00:34 devstack sudo[108440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:34 devstack sudo[108440]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-44c5ca5e-d069-4875-83b3-da3524d8b60e tempest-ProjectMemberTests-1695234881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22" returned: 0 in 0.398s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-44c5ca5e-d069-4875-83b3-da3524d8b60e tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:34 devstack sudo[108445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22 Jul 31 11:00:34 devstack sudo[108445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:34 devstack sudo[108445]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-44c5ca5e-d069-4875-83b3-da3524d8b60e tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22" returned: 0 in 0.283s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:34 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-44c5ca5e-d069-4875-83b3-da3524d8b60e tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22" released by "delete_volume" :: held 0.741s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:34 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-44c5ca5e-d069-4875-83b3-da3524d8b60e tempest-ProjectMemberTests-1695234881 None] Created reservations ['e1007aa9-68e3-429c-a1ce-c82f87c62033', '27448911-a6df-4aea-bfd6-20d30b7ce3a3', 'acdd80e5-d310-4a39-a1e4-fdf65662b606', 'd8d79cd3-e067-4e5f-967d-c143ac185079'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-44c5ca5e-d069-4875-83b3-da3524d8b60e tempest-ProjectMemberTests-1695234881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-44c5ca5e-d069-4875-83b3-da3524d8b60e tempest-ProjectMemberTests-1695234881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:34 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-44c5ca5e-d069-4875-83b3-da3524d8b60e tempest-ProjectMemberTests-1695234881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:00:34 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-44c5ca5e-d069-4875-83b3-da3524d8b60e tempest-ProjectMemberTests-1695234881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:00:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-44c5ca5e-d069-4875-83b3-da3524d8b60e tempest-ProjectMemberTests-1695234881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-44c5ca5e-d069-4875-83b3-da3524d8b60e tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:35 devstack sudo[108448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 11:00:35 devstack sudo[108448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:35 devstack sudo[108448]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-44c5ca5e-d069-4875-83b3-da3524d8b60e tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.393s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:35 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-44c5ca5e-d069-4875-83b3-da3524d8b60e tempest-ProjectMemberTests-1695234881 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:35 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-44c5ca5e-d069-4875-83b3-da3524d8b60e tempest-ProjectMemberTests-1695234881 None] Deleted volume successfully. Jul 31 11:00:35 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-44c5ca5e-d069-4875-83b3-da3524d8b60e tempest-ProjectMemberTests-1695234881 None] Lock "cinder-5d5b8feb-6b41-4e1a-ade2-e6388feb6b22-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:35 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-4884e239-0e15-4217-98f9-91e364ffb0f8 tempest-ProjectMemberTests-1695234881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:00:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4884e239-0e15-4217-98f9-91e364ffb0f8 tempest-ProjectMemberTests-1695234881 None] Flow 'volume_create_manager' (a88d1824-a640-48f1-8e8c-36dd13e298bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4884e239-0e15-4217-98f9-91e364ffb0f8 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0987ff3-63a7-45c8-89a2-3e075dc4b49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4884e239-0e15-4217-98f9-91e364ffb0f8 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0987ff3-63a7-45c8-89a2-3e075dc4b49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1388165948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f36a6e0-57ed-446e-ab4d-51499447a0f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b176847c446546949fa03ac443e36966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:36Z,use_quota=True,user_id='6d7378e77478417881535d0f0f80d4b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4884e239-0e15-4217-98f9-91e364ffb0f8 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e110436-4b7c-4e4d-a429-89c40bed9ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4884e239-0e15-4217-98f9-91e364ffb0f8 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e110436-4b7c-4e4d-a429-89c40bed9ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4884e239-0e15-4217-98f9-91e364ffb0f8 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51d59f89-b6d0-4957-bdb4-3391b584fee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4884e239-0e15-4217-98f9-91e364ffb0f8 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51d59f89-b6d0-4957-bdb4-3391b584fee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f36a6e0-57ed-446e-ab4d-51499447a0f9', 'volume_name': 'volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4884e239-0e15-4217-98f9-91e364ffb0f8 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c44a896e-3238-4deb-bcbb-2985c7a42124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4884e239-0e15-4217-98f9-91e364ffb0f8 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c44a896e-3238-4deb-bcbb-2985c7a42124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4884e239-0e15-4217-98f9-91e364ffb0f8 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6a4dab6-0db6-49c2-b5d1-8c3e455c986c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:35 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-4884e239-0e15-4217-98f9-91e364ffb0f8 tempest-ProjectMemberTests-1695234881 None] Volume 3f36a6e0-57ed-446e-ab4d-51499447a0f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9', 'volume_size': 1} Jul 31 11:00:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4884e239-0e15-4217-98f9-91e364ffb0f8 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4884e239-0e15-4217-98f9-91e364ffb0f8 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:35 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4884e239-0e15-4217-98f9-91e364ffb0f8 tempest-ProjectMemberTests-1695234881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1388165948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f36a6e0-57ed-446e-ab4d-51499447a0f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b176847c446546949fa03ac443e36966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:36Z,use_quota=True,user_id='6d7378e77478417881535d0f0f80d4b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:00:35 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-4884e239-0e15-4217-98f9-91e364ffb0f8 tempest-ProjectMemberTests-1695234881 None] Creating volume 3f36a6e0-57ed-446e-ab4d-51499447a0f9 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:00:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4884e239-0e15-4217-98f9-91e364ffb0f8 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4884e239-0e15-4217-98f9-91e364ffb0f8 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:35 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4884e239-0e15-4217-98f9-91e364ffb0f8 tempest-ProjectMemberTests-1695234881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:00:35 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4884e239-0e15-4217-98f9-91e364ffb0f8 tempest-ProjectMemberTests-1695234881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:00:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4884e239-0e15-4217-98f9-91e364ffb0f8 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:35 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4884e239-0e15-4217-98f9-91e364ffb0f8 tempest-ProjectMemberTests-1695234881 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 11:00:35 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-4884e239-0e15-4217-98f9-91e364ffb0f8 tempest-ProjectMemberTests-1695234881 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 11:00:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4884e239-0e15-4217-98f9-91e364ffb0f8 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:35 devstack sudo[108451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9 1073741824 Jul 31 11:00:35 devstack sudo[108451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:36 devstack sudo[108451]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4884e239-0e15-4217-98f9-91e364ffb0f8 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9 1073741824" returned: 0 in 0.569s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4884e239-0e15-4217-98f9-91e364ffb0f8 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:36 devstack sudo[108459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9 Jul 31 11:00:36 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:36 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-4884e239-0e15-4217-98f9-91e364ffb0f8 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9" returned: 0 in 0.343s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:36 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-4884e239-0e15-4217-98f9-91e364ffb0f8 tempest-ProjectMemberTests-1695234881 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:00:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-4884e239-0e15-4217-98f9-91e364ffb0f8 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4884e239-0e15-4217-98f9-91e364ffb0f8 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6a4dab6-0db6-49c2-b5d1-8c3e455c986c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4884e239-0e15-4217-98f9-91e364ffb0f8 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (265e9df2-d8bf-4319-b6b6-92419929cb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:36 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-4884e239-0e15-4217-98f9-91e364ffb0f8 tempest-ProjectMemberTests-1695234881 None] Volume volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9 (3f36a6e0-57ed-446e-ab4d-51499447a0f9): created successfully Jul 31 11:00:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4884e239-0e15-4217-98f9-91e364ffb0f8 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (265e9df2-d8bf-4319-b6b6-92419929cb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:36 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-4884e239-0e15-4217-98f9-91e364ffb0f8 tempest-ProjectMemberTests-1695234881 None] Flow 'volume_create_manager' (a88d1824-a640-48f1-8e8c-36dd13e298bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:36 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-4884e239-0e15-4217-98f9-91e364ffb0f8 tempest-ProjectMemberTests-1695234881 None] Created volume successfully. Jul 31 11:00:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-419ec4fa-b14e-497d-9d8d-45f58e9a5703 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-419ec4fa-b14e-497d-9d8d-45f58e9a5703 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:38 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-419ec4fa-b14e-497d-9d8d-45f58e9a5703 tempest-ProjectMemberTests-1695234881 None] Creating offline snapshot 85e3926b-0df3-4275-8d65-25a6b426203a of volume 3f36a6e0-57ed-446e-ab4d-51499447a0f9 {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:00:38 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[9004da14-c7d0-4d56-8afd-aa7864c22f78]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-419ec4fa-b14e-497d-9d8d-45f58e9a5703 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:38 devstack sudo[108463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9 Jul 31 11:00:38 devstack sudo[108463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:38 devstack sudo[108463]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-419ec4fa-b14e-497d-9d8d-45f58e9a5703 tempest-ProjectMemberTests-1695234881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9" returned: 0 in 0.399s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-419ec4fa-b14e-497d-9d8d-45f58e9a5703 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9.85e3926b-0df3-4275-8d65-25a6b426203a 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:38 devstack sudo[108469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9.85e3926b-0df3-4275-8d65-25a6b426203a 1G Jul 31 11:00:38 devstack sudo[108469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:38 devstack sudo[108469]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-419ec4fa-b14e-497d-9d8d-45f58e9a5703 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9.85e3926b-0df3-4275-8d65-25a6b426203a 1G" returned: 0 in 0.401s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:38 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-419ec4fa-b14e-497d-9d8d-45f58e9a5703 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9.85e3926b-0df3-4275-8d65-25a6b426203a {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:39 devstack sudo[108475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9.85e3926b-0df3-4275-8d65-25a6b426203a Jul 31 11:00:39 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:39 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-419ec4fa-b14e-497d-9d8d-45f58e9a5703 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9.85e3926b-0df3-4275-8d65-25a6b426203a" returned: 0 in 0.306s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:39 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-419ec4fa-b14e-497d-9d8d-45f58e9a5703 tempest-ProjectMemberTests-1695234881 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9.85e3926b-0df3-4275-8d65-25a6b426203a is being set with open permissions: ugo+rw Jul 31 11:00:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-419ec4fa-b14e-497d-9d8d-45f58e9a5703 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9.85e3926b-0df3-4275-8d65-25a6b426203a {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:39 devstack sudo[108480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9.85e3926b-0df3-4275-8d65-25a6b426203a Jul 31 11:00:39 devstack sudo[108480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:39 devstack sudo[108480]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-419ec4fa-b14e-497d-9d8d-45f58e9a5703 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9.85e3926b-0df3-4275-8d65-25a6b426203a" returned: 0 in 0.308s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-419ec4fa-b14e-497d-9d8d-45f58e9a5703 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:39 devstack sudo[108483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9.info Jul 31 11:00:39 devstack sudo[108483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:39 devstack sudo[108483]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-419ec4fa-b14e-497d-9d8d-45f58e9a5703 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9.info" returned: 0 in 0.271s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:39 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-419ec4fa-b14e-497d-9d8d-45f58e9a5703 tempest-ProjectMemberTests-1695234881 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9.info is being set with open permissions: ugo+rw Jul 31 11:00:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-419ec4fa-b14e-497d-9d8d-45f58e9a5703 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:39 devstack sudo[108486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9.info Jul 31 11:00:39 devstack sudo[108486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:40 devstack sudo[108486]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-419ec4fa-b14e-497d-9d8d-45f58e9a5703 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9.info" returned: 0 in 0.257s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-419ec4fa-b14e-497d-9d8d-45f58e9a5703 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.035s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:40 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-419ec4fa-b14e-497d-9d8d-45f58e9a5703 tempest-ProjectMemberTests-1695234881 None] Create snapshot completed successfully Jul 31 11:00:41 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1b9d27c5-08ee-4fe9-b4c9-739d0a0ef8bb tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-85e3926b-0df3-4275-8d65-25a6b426203a-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:41 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1b9d27c5-08ee-4fe9-b4c9-739d0a0ef8bb tempest-ProjectMemberTests-1695234881 None] Lock "cinder-85e3926b-0df3-4275-8d65-25a6b426203a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:41 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1b9d27c5-08ee-4fe9-b4c9-739d0a0ef8bb tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-quobyte-3f36a6e0-57ed-446e-ab4d-51499447a0f9" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:41 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1b9d27c5-08ee-4fe9-b4c9-739d0a0ef8bb tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-3f36a6e0-57ed-446e-ab4d-51499447a0f9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:41 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1b9d27c5-08ee-4fe9-b4c9-739d0a0ef8bb tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-quobyte-85e3926b-0df3-4275-8d65-25a6b426203a" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:41 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1b9d27c5-08ee-4fe9-b4c9-739d0a0ef8bb tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-85e3926b-0df3-4275-8d65-25a6b426203a" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:41 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-1b9d27c5-08ee-4fe9-b4c9-739d0a0ef8bb tempest-ProjectMemberTests-1695234881 None] Deleting offline snapshot 85e3926b-0df3-4275-8d65-25a6b426203a of volume 3f36a6e0-57ed-446e-ab4d-51499447a0f9 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:00:41 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-1b9d27c5-08ee-4fe9-b4c9-739d0a0ef8bb tempest-ProjectMemberTests-1695234881 None] snapshot_file for this snap is: volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9.85e3926b-0df3-4275-8d65-25a6b426203a {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:00:41 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a8a2ac-c4d4-4c7d-9a1f-7f10be289a4b]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1b9d27c5-08ee-4fe9-b4c9-739d0a0ef8bb tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9.85e3926b-0df3-4275-8d65-25a6b426203a {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:41 devstack sudo[108489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9.85e3926b-0df3-4275-8d65-25a6b426203a Jul 31 11:00:41 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:41 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1b9d27c5-08ee-4fe9-b4c9-739d0a0ef8bb tempest-ProjectMemberTests-1695234881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9.85e3926b-0df3-4275-8d65-25a6b426203a" returned: 0 in 0.415s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:41 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-1b9d27c5-08ee-4fe9-b4c9-739d0a0ef8bb tempest-ProjectMemberTests-1695234881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:00:41 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[6573fd3f-530b-4a44-b2a8-6b81cb7cdba1]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1b9d27c5-08ee-4fe9-b4c9-739d0a0ef8bb tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:42 devstack sudo[108494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9 Jul 31 11:00:42 devstack sudo[108494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:42 devstack sudo[108494]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1b9d27c5-08ee-4fe9-b4c9-739d0a0ef8bb tempest-ProjectMemberTests-1695234881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9" returned: 0 in 0.410s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1b9d27c5-08ee-4fe9-b4c9-739d0a0ef8bb tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9.85e3926b-0df3-4275-8d65-25a6b426203a {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:42 devstack sudo[108499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9.85e3926b-0df3-4275-8d65-25a6b426203a Jul 31 11:00:42 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:42 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1b9d27c5-08ee-4fe9-b4c9-739d0a0ef8bb tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9.85e3926b-0df3-4275-8d65-25a6b426203a" returned: 0 in 0.417s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1b9d27c5-08ee-4fe9-b4c9-739d0a0ef8bb tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9.85e3926b-0df3-4275-8d65-25a6b426203a {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:42 devstack sudo[108504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9.85e3926b-0df3-4275-8d65-25a6b426203a Jul 31 11:00:42 devstack sudo[108504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:43 devstack sudo[108504]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1b9d27c5-08ee-4fe9-b4c9-739d0a0ef8bb tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9.85e3926b-0df3-4275-8d65-25a6b426203a" returned: 0 in 0.264s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:43 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1b9d27c5-08ee-4fe9-b4c9-739d0a0ef8bb tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-85e3926b-0df3-4275-8d65-25a6b426203a" released by "_delete_snapshot" :: held 1.647s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:43 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1b9d27c5-08ee-4fe9-b4c9-739d0a0ef8bb tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-3f36a6e0-57ed-446e-ab4d-51499447a0f9" released by "delete_snapshot" :: held 1.680s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:43 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-1b9d27c5-08ee-4fe9-b4c9-739d0a0ef8bb tempest-ProjectMemberTests-1695234881 None] Created reservations ['f4589815-365e-4e6c-97c9-e30d92205e80', 'a7c1f69b-163b-4acf-bb94-e0c2662b8295', '33121d66-afe5-41a3-99c9-85fb0782d8c0', 'a64972f7-bb85-4397-afdd-abdf113e5620'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:43 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-1b9d27c5-08ee-4fe9-b4c9-739d0a0ef8bb tempest-ProjectMemberTests-1695234881 None] Delete snapshot completed successfully. Jul 31 11:00:43 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1b9d27c5-08ee-4fe9-b4c9-739d0a0ef8bb tempest-ProjectMemberTests-1695234881 None] Lock "cinder-85e3926b-0df3-4275-8d65-25a6b426203a-delete_snapshot" released by "delete_snapshot" :: held 1.890s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:43 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6768538a-7242-4337-9d50-06f8e186fd80 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-3f36a6e0-57ed-446e-ab4d-51499447a0f9-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:43 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6768538a-7242-4337-9d50-06f8e186fd80 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-3f36a6e0-57ed-446e-ab4d-51499447a0f9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:43 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6768538a-7242-4337-9d50-06f8e186fd80 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-quobyte-3f36a6e0-57ed-446e-ab4d-51499447a0f9" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:43 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6768538a-7242-4337-9d50-06f8e186fd80 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-3f36a6e0-57ed-446e-ab4d-51499447a0f9" acquired by "delete_volume" :: waited 0.021s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:43 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fa5b3d-c5eb-4090-bd44-4ebd9de09c75]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:43 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6768538a-7242-4337-9d50-06f8e186fd80 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:43 devstack sudo[108507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9 Jul 31 11:00:43 devstack sudo[108507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:44 devstack sudo[108507]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6768538a-7242-4337-9d50-06f8e186fd80 tempest-ProjectMemberTests-1695234881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9" returned: 0 in 0.386s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6768538a-7242-4337-9d50-06f8e186fd80 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:44 devstack sudo[108513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9 Jul 31 11:00:44 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:44 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6768538a-7242-4337-9d50-06f8e186fd80 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-3f36a6e0-57ed-446e-ab4d-51499447a0f9" returned: 0 in 0.249s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:44 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6768538a-7242-4337-9d50-06f8e186fd80 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-3f36a6e0-57ed-446e-ab4d-51499447a0f9" released by "delete_volume" :: held 0.718s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:44 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-6768538a-7242-4337-9d50-06f8e186fd80 tempest-ProjectMemberTests-1695234881 None] Created reservations ['7027f9f6-55c6-4dbd-82fe-84bd8d524958', 'cec93229-2f4b-4dfd-b652-d6084bdfb852', 'b0d94f14-e031-4958-a08e-0fdb863396ff', 'fdc4e124-5968-4f3f-81aa-d700ac840d83'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6768538a-7242-4337-9d50-06f8e186fd80 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6768538a-7242-4337-9d50-06f8e186fd80 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:44 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-6768538a-7242-4337-9d50-06f8e186fd80 tempest-ProjectMemberTests-1695234881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:00:44 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-6768538a-7242-4337-9d50-06f8e186fd80 tempest-ProjectMemberTests-1695234881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:00:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-6768538a-7242-4337-9d50-06f8e186fd80 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6768538a-7242-4337-9d50-06f8e186fd80 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:44 devstack sudo[108516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 11:00:44 devstack sudo[108516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:44 devstack sudo[108516]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:44 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-6768538a-7242-4337-9d50-06f8e186fd80 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.284s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:44 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-6768538a-7242-4337-9d50-06f8e186fd80 tempest-ProjectMemberTests-1695234881 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:44 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-6768538a-7242-4337-9d50-06f8e186fd80 tempest-ProjectMemberTests-1695234881 None] Deleted volume successfully. Jul 31 11:00:44 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-6768538a-7242-4337-9d50-06f8e186fd80 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-3f36a6e0-57ed-446e-ab4d-51499447a0f9-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:45 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-904cd449-1dd2-40ac-b057-f4c20c9f0125 tempest-ProjectMemberTests-1695234881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:00:45 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-904cd449-1dd2-40ac-b057-f4c20c9f0125 tempest-ProjectMemberTests-1695234881 None] Flow 'volume_create_manager' (690a11a8-c1dd-48ce-984b-72fc99026f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:45 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-904cd449-1dd2-40ac-b057-f4c20c9f0125 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e14c525-b193-4dbe-9209-abef01c6726a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:45 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-904cd449-1dd2-40ac-b057-f4c20c9f0125 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e14c525-b193-4dbe-9209-abef01c6726a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-961063095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dfe1195-1d99-4533-a4c0-34a9a94a24bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b176847c446546949fa03ac443e36966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:45Z,use_quota=True,user_id='6d7378e77478417881535d0f0f80d4b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:45 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-904cd449-1dd2-40ac-b057-f4c20c9f0125 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba4fe993-cd5b-4592-8185-34146d0fd728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:45 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-904cd449-1dd2-40ac-b057-f4c20c9f0125 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba4fe993-cd5b-4592-8185-34146d0fd728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:45 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-904cd449-1dd2-40ac-b057-f4c20c9f0125 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf0dca5b-51f0-4f4c-b4c8-7454cfceac56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:45 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-904cd449-1dd2-40ac-b057-f4c20c9f0125 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf0dca5b-51f0-4f4c-b4c8-7454cfceac56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dfe1195-1d99-4533-a4c0-34a9a94a24bb', 'volume_name': 'volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:45 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-904cd449-1dd2-40ac-b057-f4c20c9f0125 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a02d4371-2f78-4ade-ab2a-098a2ee1ec70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:45 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-904cd449-1dd2-40ac-b057-f4c20c9f0125 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a02d4371-2f78-4ade-ab2a-098a2ee1ec70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:45 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-904cd449-1dd2-40ac-b057-f4c20c9f0125 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (467f9750-cbeb-4a02-a1aa-021cdaa0d9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:45 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-904cd449-1dd2-40ac-b057-f4c20c9f0125 tempest-ProjectMemberTests-1695234881 None] Volume 9dfe1195-1d99-4533-a4c0-34a9a94a24bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb', 'volume_size': 1} Jul 31 11:00:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-904cd449-1dd2-40ac-b057-f4c20c9f0125 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-904cd449-1dd2-40ac-b057-f4c20c9f0125 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-904cd449-1dd2-40ac-b057-f4c20c9f0125 tempest-ProjectMemberTests-1695234881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-961063095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dfe1195-1d99-4533-a4c0-34a9a94a24bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b176847c446546949fa03ac443e36966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:45Z,use_quota=True,user_id='6d7378e77478417881535d0f0f80d4b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:00:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-904cd449-1dd2-40ac-b057-f4c20c9f0125 tempest-ProjectMemberTests-1695234881 None] Creating volume 9dfe1195-1d99-4533-a4c0-34a9a94a24bb {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:00:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-904cd449-1dd2-40ac-b057-f4c20c9f0125 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-904cd449-1dd2-40ac-b057-f4c20c9f0125 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-904cd449-1dd2-40ac-b057-f4c20c9f0125 tempest-ProjectMemberTests-1695234881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:00:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-904cd449-1dd2-40ac-b057-f4c20c9f0125 tempest-ProjectMemberTests-1695234881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:00:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-904cd449-1dd2-40ac-b057-f4c20c9f0125 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-904cd449-1dd2-40ac-b057-f4c20c9f0125 tempest-ProjectMemberTests-1695234881 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 11:00:45 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-904cd449-1dd2-40ac-b057-f4c20c9f0125 tempest-ProjectMemberTests-1695234881 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 11:00:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-904cd449-1dd2-40ac-b057-f4c20c9f0125 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:45 devstack sudo[108519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb 1073741824 Jul 31 11:00:45 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:45 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:00:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:00:46 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:46 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:00:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-904cd449-1dd2-40ac-b057-f4c20c9f0125 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb 1073741824" returned: 0 in 0.631s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:46 devstack sudo[108525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 11:00:46 devstack sudo[108525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-904cd449-1dd2-40ac-b057-f4c20c9f0125 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:46 devstack sudo[108527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb Jul 31 11:00:46 devstack sudo[108527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:46 devstack sudo[108525]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.272s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:46 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:46 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager._thread_info {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:00:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread count: 28 {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 11:00:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread info: [<_MainThread(MainThread, started 134005426110592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 11:00:46 devstack sudo[108527]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-904cd449-1dd2-40ac-b057-f4c20c9f0125 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb" returned: 0 in 0.303s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:46 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-904cd449-1dd2-40ac-b057-f4c20c9f0125 tempest-ProjectMemberTests-1695234881 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:00:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-904cd449-1dd2-40ac-b057-f4c20c9f0125 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-904cd449-1dd2-40ac-b057-f4c20c9f0125 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (467f9750-cbeb-4a02-a1aa-021cdaa0d9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-904cd449-1dd2-40ac-b057-f4c20c9f0125 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (956b7da2-a32a-4d0a-84b8-85dd658fe896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:46 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-904cd449-1dd2-40ac-b057-f4c20c9f0125 tempest-ProjectMemberTests-1695234881 None] Volume volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb (9dfe1195-1d99-4533-a4c0-34a9a94a24bb): created successfully Jul 31 11:00:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-904cd449-1dd2-40ac-b057-f4c20c9f0125 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (956b7da2-a32a-4d0a-84b8-85dd658fe896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-904cd449-1dd2-40ac-b057-f4c20c9f0125 tempest-ProjectMemberTests-1695234881 None] Flow 'volume_create_manager' (690a11a8-c1dd-48ce-984b-72fc99026f48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:46 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-904cd449-1dd2-40ac-b057-f4c20c9f0125 tempest-ProjectMemberTests-1695234881 None] Created volume successfully. Jul 31 11:00:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3d659be0-40d0-4b35-8856-48643a62b32b tempest-ProjectMemberTests-1695234881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3d659be0-40d0-4b35-8856-48643a62b32b tempest-ProjectMemberTests-1695234881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:47 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-3d659be0-40d0-4b35-8856-48643a62b32b tempest-ProjectMemberTests-1695234881 None] Creating offline snapshot 9c15e6dd-a2a4-480c-947e-291db2745081 of volume 9dfe1195-1d99-4533-a4c0-34a9a94a24bb {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:00:47 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bab95f-325b-4413-a1b6-83dadd1b7059]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:47 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3d659be0-40d0-4b35-8856-48643a62b32b tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:47 devstack sudo[108531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb Jul 31 11:00:47 devstack sudo[108531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:48 devstack sudo[108531]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3d659be0-40d0-4b35-8856-48643a62b32b tempest-ProjectMemberTests-1695234881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb" returned: 0 in 0.395s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3d659be0-40d0-4b35-8856-48643a62b32b tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb.9c15e6dd-a2a4-480c-947e-291db2745081 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:48 devstack sudo[108537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb.9c15e6dd-a2a4-480c-947e-291db2745081 1G Jul 31 11:00:48 devstack sudo[108537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:48 devstack sudo[108537]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3d659be0-40d0-4b35-8856-48643a62b32b tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb.9c15e6dd-a2a4-480c-947e-291db2745081 1G" returned: 0 in 0.440s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3d659be0-40d0-4b35-8856-48643a62b32b tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb.9c15e6dd-a2a4-480c-947e-291db2745081 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:48 devstack sudo[108542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb.9c15e6dd-a2a4-480c-947e-291db2745081 Jul 31 11:00:48 devstack sudo[108542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:48 devstack sudo[108542]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3d659be0-40d0-4b35-8856-48643a62b32b tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb.9c15e6dd-a2a4-480c-947e-291db2745081" returned: 0 in 0.301s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:48 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-3d659be0-40d0-4b35-8856-48643a62b32b tempest-ProjectMemberTests-1695234881 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb.9c15e6dd-a2a4-480c-947e-291db2745081 is being set with open permissions: ugo+rw Jul 31 11:00:48 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3d659be0-40d0-4b35-8856-48643a62b32b tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb.9c15e6dd-a2a4-480c-947e-291db2745081 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:48 devstack sudo[108547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb.9c15e6dd-a2a4-480c-947e-291db2745081 Jul 31 11:00:48 devstack sudo[108547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:49 devstack sudo[108547]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3d659be0-40d0-4b35-8856-48643a62b32b tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb.9c15e6dd-a2a4-480c-947e-291db2745081" returned: 0 in 0.262s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3d659be0-40d0-4b35-8856-48643a62b32b tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:49 devstack sudo[108550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb.info Jul 31 11:00:49 devstack sudo[108550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:49 devstack sudo[108550]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3d659be0-40d0-4b35-8856-48643a62b32b tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb.info" returned: 0 in 0.253s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:49 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-3d659be0-40d0-4b35-8856-48643a62b32b tempest-ProjectMemberTests-1695234881 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb.info is being set with open permissions: ugo+rw Jul 31 11:00:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3d659be0-40d0-4b35-8856-48643a62b32b tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:49 devstack sudo[108553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb.info Jul 31 11:00:49 devstack sudo[108553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:49 devstack sudo[108553]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-3d659be0-40d0-4b35-8856-48643a62b32b tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb.info" returned: 0 in 0.257s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-3d659be0-40d0-4b35-8856-48643a62b32b tempest-ProjectMemberTests-1695234881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.990s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:49 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-3d659be0-40d0-4b35-8856-48643a62b32b tempest-ProjectMemberTests-1695234881 None] Create snapshot completed successfully Jul 31 11:00:49 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2ba0df1c-69a2-493e-bc3a-e9a5c5db88f0 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-9c15e6dd-a2a4-480c-947e-291db2745081-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:49 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2ba0df1c-69a2-493e-bc3a-e9a5c5db88f0 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-9c15e6dd-a2a4-480c-947e-291db2745081-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:49 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2ba0df1c-69a2-493e-bc3a-e9a5c5db88f0 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-quobyte-9dfe1195-1d99-4533-a4c0-34a9a94a24bb" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:49 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2ba0df1c-69a2-493e-bc3a-e9a5c5db88f0 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-9dfe1195-1d99-4533-a4c0-34a9a94a24bb" acquired by "delete_snapshot" :: waited 0.023s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:49 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2ba0df1c-69a2-493e-bc3a-e9a5c5db88f0 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-quobyte-9c15e6dd-a2a4-480c-947e-291db2745081" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:49 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2ba0df1c-69a2-493e-bc3a-e9a5c5db88f0 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-9c15e6dd-a2a4-480c-947e-291db2745081" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-2ba0df1c-69a2-493e-bc3a-e9a5c5db88f0 tempest-ProjectMemberTests-1695234881 None] Deleting offline snapshot 9c15e6dd-a2a4-480c-947e-291db2745081 of volume 9dfe1195-1d99-4533-a4c0-34a9a94a24bb {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:00:49 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-2ba0df1c-69a2-493e-bc3a-e9a5c5db88f0 tempest-ProjectMemberTests-1695234881 None] snapshot_file for this snap is: volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb.9c15e6dd-a2a4-480c-947e-291db2745081 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:00:49 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[9838012b-fc51-4f84-98e2-6e7cfb94d237]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:49 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2ba0df1c-69a2-493e-bc3a-e9a5c5db88f0 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb.9c15e6dd-a2a4-480c-947e-291db2745081 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:49 devstack sudo[108557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb.9c15e6dd-a2a4-480c-947e-291db2745081 Jul 31 11:00:49 devstack sudo[108557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:50 devstack sudo[108557]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2ba0df1c-69a2-493e-bc3a-e9a5c5db88f0 tempest-ProjectMemberTests-1695234881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb.9c15e6dd-a2a4-480c-947e-291db2745081" returned: 0 in 0.397s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:50 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-2ba0df1c-69a2-493e-bc3a-e9a5c5db88f0 tempest-ProjectMemberTests-1695234881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:00:50 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e36d00c-7767-4e63-94ae-617ccfc1329b]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2ba0df1c-69a2-493e-bc3a-e9a5c5db88f0 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:50 devstack sudo[108562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb Jul 31 11:00:50 devstack sudo[108562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:50 devstack sudo[108562]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2ba0df1c-69a2-493e-bc3a-e9a5c5db88f0 tempest-ProjectMemberTests-1695234881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb" returned: 0 in 0.464s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:50 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2ba0df1c-69a2-493e-bc3a-e9a5c5db88f0 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb.9c15e6dd-a2a4-480c-947e-291db2745081 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:50 devstack sudo[108567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb.9c15e6dd-a2a4-480c-947e-291db2745081 Jul 31 11:00:50 devstack sudo[108567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:51 devstack sudo[108567]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2ba0df1c-69a2-493e-bc3a-e9a5c5db88f0 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb.9c15e6dd-a2a4-480c-947e-291db2745081" returned: 0 in 0.378s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2ba0df1c-69a2-493e-bc3a-e9a5c5db88f0 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb.9c15e6dd-a2a4-480c-947e-291db2745081 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:51 devstack sudo[108572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb.9c15e6dd-a2a4-480c-947e-291db2745081 Jul 31 11:00:51 devstack sudo[108572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:51 devstack sudo[108572]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:51 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2ba0df1c-69a2-493e-bc3a-e9a5c5db88f0 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb.9c15e6dd-a2a4-480c-947e-291db2745081" returned: 0 in 0.317s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:51 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2ba0df1c-69a2-493e-bc3a-e9a5c5db88f0 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-9c15e6dd-a2a4-480c-947e-291db2745081" released by "_delete_snapshot" :: held 1.722s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:51 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2ba0df1c-69a2-493e-bc3a-e9a5c5db88f0 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-9dfe1195-1d99-4533-a4c0-34a9a94a24bb" released by "delete_snapshot" :: held 1.748s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:51 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-2ba0df1c-69a2-493e-bc3a-e9a5c5db88f0 tempest-ProjectMemberTests-1695234881 None] Created reservations ['00afd5cd-2d8c-4231-9355-ab14937c5186', 'c55bb45d-91f0-4a50-b7db-58e8963c34b1', '52b6cbb7-8055-4174-a0b4-5452c958814d', '06dfa080-6049-4109-bc92-b977446bd308'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:51 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-2ba0df1c-69a2-493e-bc3a-e9a5c5db88f0 tempest-ProjectMemberTests-1695234881 None] Delete snapshot completed successfully. Jul 31 11:00:51 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2ba0df1c-69a2-493e-bc3a-e9a5c5db88f0 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-9c15e6dd-a2a4-480c-947e-291db2745081-delete_snapshot" released by "delete_snapshot" :: held 1.934s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:51 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e033175e-69d1-45d0-a0dc-a88fc899ad14 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-9dfe1195-1d99-4533-a4c0-34a9a94a24bb-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:51 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e033175e-69d1-45d0-a0dc-a88fc899ad14 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-9dfe1195-1d99-4533-a4c0-34a9a94a24bb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:52 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e033175e-69d1-45d0-a0dc-a88fc899ad14 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-quobyte-9dfe1195-1d99-4533-a4c0-34a9a94a24bb" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:52 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e033175e-69d1-45d0-a0dc-a88fc899ad14 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-9dfe1195-1d99-4533-a4c0-34a9a94a24bb" acquired by "delete_volume" :: waited 0.024s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:52 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[9610656e-698c-4ba5-891c-36f9bdfa2dd1]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e033175e-69d1-45d0-a0dc-a88fc899ad14 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:52 devstack sudo[108575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb Jul 31 11:00:52 devstack sudo[108575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:52 devstack sudo[108575]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e033175e-69d1-45d0-a0dc-a88fc899ad14 tempest-ProjectMemberTests-1695234881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb" returned: 0 in 0.442s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e033175e-69d1-45d0-a0dc-a88fc899ad14 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:52 devstack sudo[108580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb Jul 31 11:00:52 devstack sudo[108580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:52 devstack sudo[108580]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e033175e-69d1-45d0-a0dc-a88fc899ad14 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9dfe1195-1d99-4533-a4c0-34a9a94a24bb" returned: 0 in 0.307s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:52 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e033175e-69d1-45d0-a0dc-a88fc899ad14 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-9dfe1195-1d99-4533-a4c0-34a9a94a24bb" released by "delete_volume" :: held 0.823s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:52 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-e033175e-69d1-45d0-a0dc-a88fc899ad14 tempest-ProjectMemberTests-1695234881 None] Created reservations ['a5230dde-74eb-4fe5-adda-f545dfdd7518', '9e6697ce-9c60-4ecd-96c4-86232c7a6651', '9b6267ac-542c-4a71-99eb-a8bafbe0d1bf', '4e08ac91-bff2-4516-9305-5c445783dc60'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:52 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e033175e-69d1-45d0-a0dc-a88fc899ad14 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e033175e-69d1-45d0-a0dc-a88fc899ad14 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:53 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-e033175e-69d1-45d0-a0dc-a88fc899ad14 tempest-ProjectMemberTests-1695234881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:00:53 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-e033175e-69d1-45d0-a0dc-a88fc899ad14 tempest-ProjectMemberTests-1695234881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:00:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-e033175e-69d1-45d0-a0dc-a88fc899ad14 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e033175e-69d1-45d0-a0dc-a88fc899ad14 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:53 devstack sudo[108583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 11:00:53 devstack sudo[108583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:53 devstack sudo[108583]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-e033175e-69d1-45d0-a0dc-a88fc899ad14 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.348s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:53 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-e033175e-69d1-45d0-a0dc-a88fc899ad14 tempest-ProjectMemberTests-1695234881 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:53 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-e033175e-69d1-45d0-a0dc-a88fc899ad14 tempest-ProjectMemberTests-1695234881 None] Deleted volume successfully. Jul 31 11:00:53 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-e033175e-69d1-45d0-a0dc-a88fc899ad14 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-9dfe1195-1d99-4533-a4c0-34a9a94a24bb-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:53 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-155a5015-da6c-49b9-bd2a-ad4953988e9d tempest-ProjectMemberTests-1695234881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:00:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-155a5015-da6c-49b9-bd2a-ad4953988e9d tempest-ProjectMemberTests-1695234881 None] Flow 'volume_create_manager' (0696e8a3-1dd5-4392-ad86-55e966050271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-155a5015-da6c-49b9-bd2a-ad4953988e9d tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a15bf44d-ae3c-4f6e-a142-821af5d85333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-155a5015-da6c-49b9-bd2a-ad4953988e9d tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a15bf44d-ae3c-4f6e-a142-821af5d85333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1156316256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf22a8d6-f88f-48af-8b35-ca5547af76e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b176847c446546949fa03ac443e36966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:54Z,use_quota=True,user_id='6d7378e77478417881535d0f0f80d4b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-155a5015-da6c-49b9-bd2a-ad4953988e9d tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8001c89-6084-45ac-bfb4-93ce3a1dead8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-155a5015-da6c-49b9-bd2a-ad4953988e9d tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8001c89-6084-45ac-bfb4-93ce3a1dead8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-155a5015-da6c-49b9-bd2a-ad4953988e9d tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ddc5ae-8a81-447b-b59e-4db3d939864c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-155a5015-da6c-49b9-bd2a-ad4953988e9d tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ddc5ae-8a81-447b-b59e-4db3d939864c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf22a8d6-f88f-48af-8b35-ca5547af76e4', 'volume_name': 'volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-155a5015-da6c-49b9-bd2a-ad4953988e9d tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a795681-a2a4-45a3-9378-83670eea7167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-155a5015-da6c-49b9-bd2a-ad4953988e9d tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a795681-a2a4-45a3-9378-83670eea7167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:53 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-155a5015-da6c-49b9-bd2a-ad4953988e9d tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fe98738-75e9-4ea0-b313-82c085b41499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:53 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-155a5015-da6c-49b9-bd2a-ad4953988e9d tempest-ProjectMemberTests-1695234881 None] Volume cf22a8d6-f88f-48af-8b35-ca5547af76e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4', 'volume_size': 1} Jul 31 11:00:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-155a5015-da6c-49b9-bd2a-ad4953988e9d tempest-ProjectMemberTests-1695234881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-155a5015-da6c-49b9-bd2a-ad4953988e9d tempest-ProjectMemberTests-1695234881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:53 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-155a5015-da6c-49b9-bd2a-ad4953988e9d tempest-ProjectMemberTests-1695234881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1156316256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf22a8d6-f88f-48af-8b35-ca5547af76e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b176847c446546949fa03ac443e36966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:54Z,use_quota=True,user_id='6d7378e77478417881535d0f0f80d4b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:00:53 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-155a5015-da6c-49b9-bd2a-ad4953988e9d tempest-ProjectMemberTests-1695234881 None] Creating volume cf22a8d6-f88f-48af-8b35-ca5547af76e4 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:00:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-155a5015-da6c-49b9-bd2a-ad4953988e9d tempest-ProjectMemberTests-1695234881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-155a5015-da6c-49b9-bd2a-ad4953988e9d tempest-ProjectMemberTests-1695234881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:53 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-155a5015-da6c-49b9-bd2a-ad4953988e9d tempest-ProjectMemberTests-1695234881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:00:53 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-155a5015-da6c-49b9-bd2a-ad4953988e9d tempest-ProjectMemberTests-1695234881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:00:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-155a5015-da6c-49b9-bd2a-ad4953988e9d tempest-ProjectMemberTests-1695234881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:53 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-155a5015-da6c-49b9-bd2a-ad4953988e9d tempest-ProjectMemberTests-1695234881 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 11:00:53 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-155a5015-da6c-49b9-bd2a-ad4953988e9d tempest-ProjectMemberTests-1695234881 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 11:00:53 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-155a5015-da6c-49b9-bd2a-ad4953988e9d tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:53 devstack sudo[108586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4 1073741824 Jul 31 11:00:53 devstack sudo[108586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:54 devstack sudo[108586]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-155a5015-da6c-49b9-bd2a-ad4953988e9d tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4 1073741824" returned: 0 in 0.481s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-155a5015-da6c-49b9-bd2a-ad4953988e9d tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:54 devstack sudo[108592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4 Jul 31 11:00:54 devstack sudo[108592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:54 devstack sudo[108592]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-155a5015-da6c-49b9-bd2a-ad4953988e9d tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4" returned: 0 in 0.284s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:54 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-155a5015-da6c-49b9-bd2a-ad4953988e9d tempest-ProjectMemberTests-1695234881 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:00:54 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-155a5015-da6c-49b9-bd2a-ad4953988e9d tempest-ProjectMemberTests-1695234881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:54 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-155a5015-da6c-49b9-bd2a-ad4953988e9d tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fe98738-75e9-4ea0-b313-82c085b41499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:54 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-155a5015-da6c-49b9-bd2a-ad4953988e9d tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9615f11-d51f-48a9-966e-df653c3c43b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:54 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-155a5015-da6c-49b9-bd2a-ad4953988e9d tempest-ProjectMemberTests-1695234881 None] Volume volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4 (cf22a8d6-f88f-48af-8b35-ca5547af76e4): created successfully Jul 31 11:00:54 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-155a5015-da6c-49b9-bd2a-ad4953988e9d tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9615f11-d51f-48a9-966e-df653c3c43b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:54 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-155a5015-da6c-49b9-bd2a-ad4953988e9d tempest-ProjectMemberTests-1695234881 None] Flow 'volume_create_manager' (0696e8a3-1dd5-4392-ad86-55e966050271) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:54 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-155a5015-da6c-49b9-bd2a-ad4953988e9d tempest-ProjectMemberTests-1695234881 None] Created volume successfully. Jul 31 11:00:56 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=177,cinder:UPDATE=259,cinder:DELETE=29,cinder:INSERT=75 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:00:56 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:DELETE=14,cinder:UPDATE=253,cinder:INSERT=64,cinder:SELECT=198 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:00:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9dad68dc-cb12-42ce-ab8e-875dc536899b tempest-ProjectMemberTests-1695234881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9dad68dc-cb12-42ce-ab8e-875dc536899b tempest-ProjectMemberTests-1695234881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:56 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-9dad68dc-cb12-42ce-ab8e-875dc536899b tempest-ProjectMemberTests-1695234881 None] Creating offline snapshot 2b4bc3f9-24c9-4fac-865c-4606b42ea20c of volume cf22a8d6-f88f-48af-8b35-ca5547af76e4 {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:00:56 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[8152b951-4198-47c7-b99d-cd72c57eff85]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9dad68dc-cb12-42ce-ab8e-875dc536899b tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:56 devstack sudo[108595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4 Jul 31 11:00:56 devstack sudo[108595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:56 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-c369aeee-a42b-46cd-802e-76dd60f7702e tempest-SnapshotDependencyTests-40370578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:00:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c369aeee-a42b-46cd-802e-76dd60f7702e tempest-SnapshotDependencyTests-40370578 None] Flow 'volume_create_manager' (442201ff-1525-4fb4-b9b8-4318eba5741a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c369aeee-a42b-46cd-802e-76dd60f7702e tempest-SnapshotDependencyTests-40370578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c343f315-47ae-4ca0-b90c-100c0526e913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c369aeee-a42b-46cd-802e-76dd60f7702e tempest-SnapshotDependencyTests-40370578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c343f315-47ae-4ca0-b90c-100c0526e913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-602878539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1346a4a8-7494-4f7c-a1ce-da9937d2d228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75df71663b67446c91237a459f7b1358',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:56Z,use_quota=True,user_id='430472cdb32d477f88f71b94811e9468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c369aeee-a42b-46cd-802e-76dd60f7702e tempest-SnapshotDependencyTests-40370578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f24917-ae76-44c9-94b8-a0cd07bbf0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c369aeee-a42b-46cd-802e-76dd60f7702e tempest-SnapshotDependencyTests-40370578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f24917-ae76-44c9-94b8-a0cd07bbf0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c369aeee-a42b-46cd-802e-76dd60f7702e tempest-SnapshotDependencyTests-40370578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58ed9ffa-08e5-4a1d-a7e5-1452785e4fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c369aeee-a42b-46cd-802e-76dd60f7702e tempest-SnapshotDependencyTests-40370578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58ed9ffa-08e5-4a1d-a7e5-1452785e4fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1346a4a8-7494-4f7c-a1ce-da9937d2d228', 'volume_name': 'volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c369aeee-a42b-46cd-802e-76dd60f7702e tempest-SnapshotDependencyTests-40370578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40154453-3d42-4d1d-b166-3093301ac7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c369aeee-a42b-46cd-802e-76dd60f7702e tempest-SnapshotDependencyTests-40370578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40154453-3d42-4d1d-b166-3093301ac7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:56 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c369aeee-a42b-46cd-802e-76dd60f7702e tempest-SnapshotDependencyTests-40370578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (279e1b32-6a31-4629-af41-b7f25a81c32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:56 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-c369aeee-a42b-46cd-802e-76dd60f7702e tempest-SnapshotDependencyTests-40370578 None] Volume 1346a4a8-7494-4f7c-a1ce-da9937d2d228: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228', 'volume_size': 1} Jul 31 11:00:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c369aeee-a42b-46cd-802e-76dd60f7702e tempest-SnapshotDependencyTests-40370578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:56 devstack sudo[108595]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9dad68dc-cb12-42ce-ab8e-875dc536899b tempest-ProjectMemberTests-1695234881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4" returned: 0 in 0.400s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9dad68dc-cb12-42ce-ab8e-875dc536899b tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4.2b4bc3f9-24c9-4fac-865c-4606b42ea20c 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:56 devstack sudo[108600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4.2b4bc3f9-24c9-4fac-865c-4606b42ea20c 1G Jul 31 11:00:56 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:56 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9dad68dc-cb12-42ce-ab8e-875dc536899b tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4.2b4bc3f9-24c9-4fac-865c-4606b42ea20c 1G" returned: 0 in 0.396s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:56 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9dad68dc-cb12-42ce-ab8e-875dc536899b tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4.2b4bc3f9-24c9-4fac-865c-4606b42ea20c {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:57 devstack sudo[108605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4.2b4bc3f9-24c9-4fac-865c-4606b42ea20c Jul 31 11:00:57 devstack sudo[108605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:57 devstack sudo[108605]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9dad68dc-cb12-42ce-ab8e-875dc536899b tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4.2b4bc3f9-24c9-4fac-865c-4606b42ea20c" returned: 0 in 0.287s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:57 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-9dad68dc-cb12-42ce-ab8e-875dc536899b tempest-ProjectMemberTests-1695234881 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4.2b4bc3f9-24c9-4fac-865c-4606b42ea20c is being set with open permissions: ugo+rw Jul 31 11:00:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9dad68dc-cb12-42ce-ab8e-875dc536899b tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4.2b4bc3f9-24c9-4fac-865c-4606b42ea20c {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:57 devstack sudo[108610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4.2b4bc3f9-24c9-4fac-865c-4606b42ea20c Jul 31 11:00:57 devstack sudo[108610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:57 devstack sudo[108610]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9dad68dc-cb12-42ce-ab8e-875dc536899b tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4.2b4bc3f9-24c9-4fac-865c-4606b42ea20c" returned: 0 in 0.250s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9dad68dc-cb12-42ce-ab8e-875dc536899b tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:57 devstack sudo[108613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4.info Jul 31 11:00:57 devstack sudo[108613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:57 devstack sudo[108613]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9dad68dc-cb12-42ce-ab8e-875dc536899b tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4.info" returned: 0 in 0.252s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:57 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-9dad68dc-cb12-42ce-ab8e-875dc536899b tempest-ProjectMemberTests-1695234881 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4.info is being set with open permissions: ugo+rw Jul 31 11:00:57 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9dad68dc-cb12-42ce-ab8e-875dc536899b tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:57 devstack sudo[108616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4.info Jul 31 11:00:57 devstack sudo[108616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:58 devstack sudo[108616]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9dad68dc-cb12-42ce-ab8e-875dc536899b tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4.info" returned: 0 in 0.249s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9dad68dc-cb12-42ce-ab8e-875dc536899b tempest-ProjectMemberTests-1695234881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.922s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c369aeee-a42b-46cd-802e-76dd60f7702e tempest-SnapshotDependencyTests-40370578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.599s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:58 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c369aeee-a42b-46cd-802e-76dd60f7702e tempest-SnapshotDependencyTests-40370578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-602878539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1346a4a8-7494-4f7c-a1ce-da9937d2d228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75df71663b67446c91237a459f7b1358',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:56Z,use_quota=True,user_id='430472cdb32d477f88f71b94811e9468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:00:58 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-c369aeee-a42b-46cd-802e-76dd60f7702e tempest-SnapshotDependencyTests-40370578 None] Creating volume 1346a4a8-7494-4f7c-a1ce-da9937d2d228 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:00:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c369aeee-a42b-46cd-802e-76dd60f7702e tempest-SnapshotDependencyTests-40370578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c369aeee-a42b-46cd-802e-76dd60f7702e tempest-SnapshotDependencyTests-40370578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:58 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c369aeee-a42b-46cd-802e-76dd60f7702e tempest-SnapshotDependencyTests-40370578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:00:58 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c369aeee-a42b-46cd-802e-76dd60f7702e tempest-SnapshotDependencyTests-40370578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:00:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c369aeee-a42b-46cd-802e-76dd60f7702e tempest-SnapshotDependencyTests-40370578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:58 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c369aeee-a42b-46cd-802e-76dd60f7702e tempest-SnapshotDependencyTests-40370578 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 11:00:58 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-c369aeee-a42b-46cd-802e-76dd60f7702e tempest-SnapshotDependencyTests-40370578 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 11:00:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c369aeee-a42b-46cd-802e-76dd60f7702e tempest-SnapshotDependencyTests-40370578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:58 devstack sudo[108620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228 1073741824 Jul 31 11:00:58 devstack sudo[108620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:58 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-9dad68dc-cb12-42ce-ab8e-875dc536899b tempest-ProjectMemberTests-1695234881 None] Create snapshot completed successfully Jul 31 11:00:58 devstack sudo[108620]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c369aeee-a42b-46cd-802e-76dd60f7702e tempest-SnapshotDependencyTests-40370578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228 1073741824" returned: 0 in 0.478s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c369aeee-a42b-46cd-802e-76dd60f7702e tempest-SnapshotDependencyTests-40370578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:58 devstack sudo[108625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228 Jul 31 11:00:58 devstack sudo[108625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:58 devstack sudo[108625]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c369aeee-a42b-46cd-802e-76dd60f7702e tempest-SnapshotDependencyTests-40370578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228" returned: 0 in 0.260s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:58 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-c369aeee-a42b-46cd-802e-76dd60f7702e tempest-SnapshotDependencyTests-40370578 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:00:58 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-c369aeee-a42b-46cd-802e-76dd60f7702e tempest-SnapshotDependencyTests-40370578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c369aeee-a42b-46cd-802e-76dd60f7702e tempest-SnapshotDependencyTests-40370578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (279e1b32-6a31-4629-af41-b7f25a81c32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c369aeee-a42b-46cd-802e-76dd60f7702e tempest-SnapshotDependencyTests-40370578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dd55a26-d036-4893-aaf0-997c6e768239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:58 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-c369aeee-a42b-46cd-802e-76dd60f7702e tempest-SnapshotDependencyTests-40370578 None] Volume volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228 (1346a4a8-7494-4f7c-a1ce-da9937d2d228): created successfully Jul 31 11:00:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c369aeee-a42b-46cd-802e-76dd60f7702e tempest-SnapshotDependencyTests-40370578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dd55a26-d036-4893-aaf0-997c6e768239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:58 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-c369aeee-a42b-46cd-802e-76dd60f7702e tempest-SnapshotDependencyTests-40370578 None] Flow 'volume_create_manager' (442201ff-1525-4fb4-b9b8-4318eba5741a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:58 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-c369aeee-a42b-46cd-802e-76dd60f7702e tempest-SnapshotDependencyTests-40370578 None] Created volume successfully. Jul 31 11:00:59 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-47e36600-ddbd-4c3e-af0f-93175b1fe012 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-2b4bc3f9-24c9-4fac-865c-4606b42ea20c-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:59 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-47e36600-ddbd-4c3e-af0f-93175b1fe012 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-2b4bc3f9-24c9-4fac-865c-4606b42ea20c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:59 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-47e36600-ddbd-4c3e-af0f-93175b1fe012 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-quobyte-cf22a8d6-f88f-48af-8b35-ca5547af76e4" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:59 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-47e36600-ddbd-4c3e-af0f-93175b1fe012 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-cf22a8d6-f88f-48af-8b35-ca5547af76e4" acquired by "delete_snapshot" :: waited 0.014s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:59 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-47e36600-ddbd-4c3e-af0f-93175b1fe012 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-quobyte-2b4bc3f9-24c9-4fac-865c-4606b42ea20c" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:59 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-47e36600-ddbd-4c3e-af0f-93175b1fe012 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-2b4bc3f9-24c9-4fac-865c-4606b42ea20c" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:59 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-47e36600-ddbd-4c3e-af0f-93175b1fe012 tempest-ProjectMemberTests-1695234881 None] Deleting offline snapshot 2b4bc3f9-24c9-4fac-865c-4606b42ea20c of volume cf22a8d6-f88f-48af-8b35-ca5547af76e4 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:00:59 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-47e36600-ddbd-4c3e-af0f-93175b1fe012 tempest-ProjectMemberTests-1695234881 None] snapshot_file for this snap is: volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4.2b4bc3f9-24c9-4fac-865c-4606b42ea20c {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:00:59 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e0ad49-2e41-45b5-847e-091a9c4d2703]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-47e36600-ddbd-4c3e-af0f-93175b1fe012 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4.2b4bc3f9-24c9-4fac-865c-4606b42ea20c {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:59 devstack sudo[108628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4.2b4bc3f9-24c9-4fac-865c-4606b42ea20c Jul 31 11:00:59 devstack sudo[108628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:59 devstack sudo[108628]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-47e36600-ddbd-4c3e-af0f-93175b1fe012 tempest-ProjectMemberTests-1695234881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4.2b4bc3f9-24c9-4fac-865c-4606b42ea20c" returned: 0 in 0.375s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:59 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-47e36600-ddbd-4c3e-af0f-93175b1fe012 tempest-ProjectMemberTests-1695234881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:00:59 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae62491f-90e2-4ac9-995b-48b9523f22bd]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-47e36600-ddbd-4c3e-af0f-93175b1fe012 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-46c337c9-59dd-4711-9e07-2e3f128413b5 tempest-SnapshotDependencyTests-40370578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-46c337c9-59dd-4711-9e07-2e3f128413b5 tempest-SnapshotDependencyTests-40370578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:59 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-46c337c9-59dd-4711-9e07-2e3f128413b5 tempest-SnapshotDependencyTests-40370578 None] Creating offline snapshot d5d7c5ef-c769-48f6-a541-5cfee50ce453 of volume 1346a4a8-7494-4f7c-a1ce-da9937d2d228 {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:00:59 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd92dcb-f8e7-483a-ae11-14228fb48b72]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:59 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-46c337c9-59dd-4711-9e07-2e3f128413b5 tempest-SnapshotDependencyTests-40370578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:59 devstack sudo[108633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4 Jul 31 11:00:59 devstack sudo[108633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:59 devstack sudo[108634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228 Jul 31 11:00:59 devstack sudo[108634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:00 devstack sudo[108633]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-47e36600-ddbd-4c3e-af0f-93175b1fe012 tempest-ProjectMemberTests-1695234881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4" returned: 0 in 0.412s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-47e36600-ddbd-4c3e-af0f-93175b1fe012 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4.2b4bc3f9-24c9-4fac-865c-4606b42ea20c {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:00 devstack sudo[108644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4.2b4bc3f9-24c9-4fac-865c-4606b42ea20c Jul 31 11:01:00 devstack sudo[108644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:00 devstack sudo[108634]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-46c337c9-59dd-4711-9e07-2e3f128413b5 tempest-SnapshotDependencyTests-40370578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228" returned: 0 in 0.367s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-46c337c9-59dd-4711-9e07-2e3f128413b5 tempest-SnapshotDependencyTests-40370578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228.d5d7c5ef-c769-48f6-a541-5cfee50ce453 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:00 devstack sudo[108646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228.d5d7c5ef-c769-48f6-a541-5cfee50ce453 1G Jul 31 11:01:00 devstack sudo[108646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:00 devstack sudo[108644]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-47e36600-ddbd-4c3e-af0f-93175b1fe012 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4.2b4bc3f9-24c9-4fac-865c-4606b42ea20c" returned: 0 in 0.358s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-47e36600-ddbd-4c3e-af0f-93175b1fe012 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4.2b4bc3f9-24c9-4fac-865c-4606b42ea20c {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:00 devstack sudo[108655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4.2b4bc3f9-24c9-4fac-865c-4606b42ea20c Jul 31 11:01:00 devstack sudo[108655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:00 devstack sudo[108646]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-46c337c9-59dd-4711-9e07-2e3f128413b5 tempest-SnapshotDependencyTests-40370578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228.d5d7c5ef-c769-48f6-a541-5cfee50ce453 1G" returned: 0 in 0.437s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-46c337c9-59dd-4711-9e07-2e3f128413b5 tempest-SnapshotDependencyTests-40370578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228.d5d7c5ef-c769-48f6-a541-5cfee50ce453 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:00 devstack sudo[108658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228.d5d7c5ef-c769-48f6-a541-5cfee50ce453 Jul 31 11:01:00 devstack sudo[108658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:00 devstack sudo[108655]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-47e36600-ddbd-4c3e-af0f-93175b1fe012 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4.2b4bc3f9-24c9-4fac-865c-4606b42ea20c" returned: 0 in 0.272s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:00 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-47e36600-ddbd-4c3e-af0f-93175b1fe012 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-2b4bc3f9-24c9-4fac-865c-4606b42ea20c" released by "_delete_snapshot" :: held 1.541s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:00 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-47e36600-ddbd-4c3e-af0f-93175b1fe012 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-cf22a8d6-f88f-48af-8b35-ca5547af76e4" released by "delete_snapshot" :: held 1.576s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:00 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-47e36600-ddbd-4c3e-af0f-93175b1fe012 tempest-ProjectMemberTests-1695234881 None] Created reservations ['4882be44-5f43-46aa-8107-23cc4b8a3860', '6266d352-6d1a-4985-bafd-8272fb76e5f9', '2d4cf97f-460d-48a3-945b-9fc22226bcad', 'f1d264e2-4827-4ce3-9f09-b38a0e2a4c69'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:01:00 devstack sudo[108658]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-46c337c9-59dd-4711-9e07-2e3f128413b5 tempest-SnapshotDependencyTests-40370578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228.d5d7c5ef-c769-48f6-a541-5cfee50ce453" returned: 0 in 0.325s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:00 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-46c337c9-59dd-4711-9e07-2e3f128413b5 tempest-SnapshotDependencyTests-40370578 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228.d5d7c5ef-c769-48f6-a541-5cfee50ce453 is being set with open permissions: ugo+rw Jul 31 11:01:00 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-46c337c9-59dd-4711-9e07-2e3f128413b5 tempest-SnapshotDependencyTests-40370578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228.d5d7c5ef-c769-48f6-a541-5cfee50ce453 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:01 devstack sudo[108664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228.d5d7c5ef-c769-48f6-a541-5cfee50ce453 Jul 31 11:01:01 devstack sudo[108664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:01 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-47e36600-ddbd-4c3e-af0f-93175b1fe012 tempest-ProjectMemberTests-1695234881 None] Delete snapshot completed successfully. Jul 31 11:01:01 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-47e36600-ddbd-4c3e-af0f-93175b1fe012 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-2b4bc3f9-24c9-4fac-865c-4606b42ea20c-delete_snapshot" released by "delete_snapshot" :: held 1.766s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:01 devstack sudo[108664]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-46c337c9-59dd-4711-9e07-2e3f128413b5 tempest-SnapshotDependencyTests-40370578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228.d5d7c5ef-c769-48f6-a541-5cfee50ce453" returned: 0 in 0.246s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-46c337c9-59dd-4711-9e07-2e3f128413b5 tempest-SnapshotDependencyTests-40370578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:01 devstack sudo[108667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228.info Jul 31 11:01:01 devstack sudo[108667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:01 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9b1fedf4-1bb8-4a92-995c-eed24595f483 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-cf22a8d6-f88f-48af-8b35-ca5547af76e4-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:01 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9b1fedf4-1bb8-4a92-995c-eed24595f483 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-cf22a8d6-f88f-48af-8b35-ca5547af76e4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:01 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9b1fedf4-1bb8-4a92-995c-eed24595f483 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-quobyte-cf22a8d6-f88f-48af-8b35-ca5547af76e4" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:01 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9b1fedf4-1bb8-4a92-995c-eed24595f483 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-cf22a8d6-f88f-48af-8b35-ca5547af76e4" acquired by "delete_volume" :: waited 0.021s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:01 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[027d9aed-70a1-4ed0-a73b-a18ed1681226]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:01 devstack sudo[108667]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9b1fedf4-1bb8-4a92-995c-eed24595f483 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-46c337c9-59dd-4711-9e07-2e3f128413b5 tempest-SnapshotDependencyTests-40370578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228.info" returned: 0 in 0.309s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:01 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-46c337c9-59dd-4711-9e07-2e3f128413b5 tempest-SnapshotDependencyTests-40370578 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228.info is being set with open permissions: ugo+rw Jul 31 11:01:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-46c337c9-59dd-4711-9e07-2e3f128413b5 tempest-SnapshotDependencyTests-40370578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:01 devstack sudo[108671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228.info Jul 31 11:01:01 devstack sudo[108671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:01 devstack sudo[108670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4 Jul 31 11:01:01 devstack sudo[108670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:01 devstack sudo[108671]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-46c337c9-59dd-4711-9e07-2e3f128413b5 tempest-SnapshotDependencyTests-40370578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228.info" returned: 0 in 0.266s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-46c337c9-59dd-4711-9e07-2e3f128413b5 tempest-SnapshotDependencyTests-40370578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.055s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:01 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-46c337c9-59dd-4711-9e07-2e3f128413b5 tempest-SnapshotDependencyTests-40370578 None] Create snapshot completed successfully Jul 31 11:01:01 devstack sudo[108670]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9b1fedf4-1bb8-4a92-995c-eed24595f483 tempest-ProjectMemberTests-1695234881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4" returned: 0 in 0.426s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:01 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9b1fedf4-1bb8-4a92-995c-eed24595f483 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:02 devstack sudo[108678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4 Jul 31 11:01:02 devstack sudo[108678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:02 devstack sudo[108678]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9b1fedf4-1bb8-4a92-995c-eed24595f483 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-cf22a8d6-f88f-48af-8b35-ca5547af76e4" returned: 0 in 0.256s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:02 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9b1fedf4-1bb8-4a92-995c-eed24595f483 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-cf22a8d6-f88f-48af-8b35-ca5547af76e4" released by "delete_volume" :: held 0.749s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:02 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-9b1fedf4-1bb8-4a92-995c-eed24595f483 tempest-ProjectMemberTests-1695234881 None] Created reservations ['6c83177f-c0a1-4fd4-9928-92be547c1a62', '508a9a13-55d7-4b98-a55d-73653ae4a071', '64db0706-7d45-4d1e-a861-10b7a5ba6cfc', '1a7d714b-d84b-495d-81f8-b1cee9b94c66'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:01:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9b1fedf4-1bb8-4a92-995c-eed24595f483 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9b1fedf4-1bb8-4a92-995c-eed24595f483 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:02 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-9b1fedf4-1bb8-4a92-995c-eed24595f483 tempest-ProjectMemberTests-1695234881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:01:02 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-9b1fedf4-1bb8-4a92-995c-eed24595f483 tempest-ProjectMemberTests-1695234881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:01:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-9b1fedf4-1bb8-4a92-995c-eed24595f483 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9b1fedf4-1bb8-4a92-995c-eed24595f483 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:02 devstack sudo[108681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 11:01:02 devstack sudo[108681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:02 devstack sudo[108681]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:02 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-9b1fedf4-1bb8-4a92-995c-eed24595f483 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.287s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:02 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-9b1fedf4-1bb8-4a92-995c-eed24595f483 tempest-ProjectMemberTests-1695234881 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:01:02 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-9b1fedf4-1bb8-4a92-995c-eed24595f483 tempest-ProjectMemberTests-1695234881 None] Deleted volume successfully. Jul 31 11:01:02 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-9b1fedf4-1bb8-4a92-995c-eed24595f483 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-cf22a8d6-f88f-48af-8b35-ca5547af76e4-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:03 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-b66b0824-194f-4f6e-81ee-776778d77f4b tempest-ProjectMemberTests-1695234881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:01:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b66b0824-194f-4f6e-81ee-776778d77f4b tempest-ProjectMemberTests-1695234881 None] Flow 'volume_create_manager' (58f0f32b-cc23-4c4c-9530-3497b79aec54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b66b0824-194f-4f6e-81ee-776778d77f4b tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e79a0a73-2417-4251-a06b-deafab86e418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b66b0824-194f-4f6e-81ee-776778d77f4b tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e79a0a73-2417-4251-a06b-deafab86e418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-783793737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beebd68e-b4a0-498a-b836-a43227b7fa20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b176847c446546949fa03ac443e36966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:01:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:01:03Z,use_quota=True,user_id='6d7378e77478417881535d0f0f80d4b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b66b0824-194f-4f6e-81ee-776778d77f4b tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db0ec70a-459a-4403-b997-ee4e1c7256d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b66b0824-194f-4f6e-81ee-776778d77f4b tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db0ec70a-459a-4403-b997-ee4e1c7256d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b66b0824-194f-4f6e-81ee-776778d77f4b tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b86791-c0c6-4ae3-ad55-bb0a723eb757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b66b0824-194f-4f6e-81ee-776778d77f4b tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b86791-c0c6-4ae3-ad55-bb0a723eb757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beebd68e-b4a0-498a-b836-a43227b7fa20', 'volume_name': 'volume-beebd68e-b4a0-498a-b836-a43227b7fa20', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b66b0824-194f-4f6e-81ee-776778d77f4b tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca4c3a8b-b943-430f-afc0-95f97bfacb71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b66b0824-194f-4f6e-81ee-776778d77f4b tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca4c3a8b-b943-430f-afc0-95f97bfacb71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b66b0824-194f-4f6e-81ee-776778d77f4b tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de19f4a9-4e11-4bf3-8cf6-1db027e0f011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:03 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-b66b0824-194f-4f6e-81ee-776778d77f4b tempest-ProjectMemberTests-1695234881 None] Volume beebd68e-b4a0-498a-b836-a43227b7fa20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beebd68e-b4a0-498a-b836-a43227b7fa20', 'volume_size': 1} Jul 31 11:01:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b66b0824-194f-4f6e-81ee-776778d77f4b tempest-ProjectMemberTests-1695234881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b66b0824-194f-4f6e-81ee-776778d77f4b tempest-ProjectMemberTests-1695234881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:03 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-b66b0824-194f-4f6e-81ee-776778d77f4b tempest-ProjectMemberTests-1695234881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-783793737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beebd68e-b4a0-498a-b836-a43227b7fa20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b176847c446546949fa03ac443e36966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:01:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:01:03Z,use_quota=True,user_id='6d7378e77478417881535d0f0f80d4b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:01:03 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-b66b0824-194f-4f6e-81ee-776778d77f4b tempest-ProjectMemberTests-1695234881 None] Creating volume beebd68e-b4a0-498a-b836-a43227b7fa20 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:01:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b66b0824-194f-4f6e-81ee-776778d77f4b tempest-ProjectMemberTests-1695234881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b66b0824-194f-4f6e-81ee-776778d77f4b tempest-ProjectMemberTests-1695234881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:03 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-b66b0824-194f-4f6e-81ee-776778d77f4b tempest-ProjectMemberTests-1695234881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:01:03 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-b66b0824-194f-4f6e-81ee-776778d77f4b tempest-ProjectMemberTests-1695234881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:01:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b66b0824-194f-4f6e-81ee-776778d77f4b tempest-ProjectMemberTests-1695234881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:03 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-b66b0824-194f-4f6e-81ee-776778d77f4b tempest-ProjectMemberTests-1695234881 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 11:01:03 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-b66b0824-194f-4f6e-81ee-776778d77f4b tempest-ProjectMemberTests-1695234881 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 11:01:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b66b0824-194f-4f6e-81ee-776778d77f4b tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:03 devstack sudo[108684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20 1073741824 Jul 31 11:01:03 devstack sudo[108684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:03 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:01:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Flow 'volume_create_manager' (3e616b59-942b-44d1-8049-78010b06b7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7cfa6ff-cd06-45c8-a6d9-e356ffdacbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7cfa6ff-cd06-45c8-a6d9-e356ffdacbee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2446f9c5-777d-4b08-b250-ec08b17953a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75df71663b67446c91237a459f7b1358',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d5d7c5ef-c769-48f6-a541-5cfee50ce453,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:01:04Z,use_quota=True,user_id='430472cdb32d477f88f71b94811e9468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (726a0f85-8290-4a31-b80a-38a20ba1737a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (726a0f85-8290-4a31-b80a-38a20ba1737a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31959942-12ac-4ccc-afe2-2c6f7a653ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31959942-12ac-4ccc-afe2-2c6f7a653ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2446f9c5-777d-4b08-b250-ec08b17953a1', 'volume_name': 'volume-2446f9c5-777d-4b08-b250-ec08b17953a1', 'volume_size': 1, 'snapshot_id': 'd5d7c5ef-c769-48f6-a541-5cfee50ce453'}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cdd0926-cf66-4d91-b0b8-a28e2e8cd55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cdd0926-cf66-4d91-b0b8-a28e2e8cd55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:03 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28c8134-3fb1-4721-a545-7a417b831816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:03 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Volume 2446f9c5-777d-4b08-b250-ec08b17953a1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2446f9c5-777d-4b08-b250-ec08b17953a1', 'volume_size': 1, 'snapshot_id': 'd5d7c5ef-c769-48f6-a541-5cfee50ce453'} Jul 31 11:01:03 devstack sudo[108684]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b66b0824-194f-4f6e-81ee-776778d77f4b tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20 1073741824" returned: 0 in 0.512s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:03 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b66b0824-194f-4f6e-81ee-776778d77f4b tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:03 devstack sudo[108690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20 Jul 31 11:01:03 devstack sudo[108690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:04 devstack sudo[108690]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-b66b0824-194f-4f6e-81ee-776778d77f4b tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20" returned: 0 in 0.258s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-b66b0824-194f-4f6e-81ee-776778d77f4b tempest-ProjectMemberTests-1695234881 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:01:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-b66b0824-194f-4f6e-81ee-776778d77f4b tempest-ProjectMemberTests-1695234881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.295s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:04 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Acquiring lock "cinder-quobyte-d5d7c5ef-c769-48f6-a541-5cfee50ce453-2446f9c5-777d-4b08-b250-ec08b17953a1" by "_create_volume_from_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:04 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b66b0824-194f-4f6e-81ee-776778d77f4b tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de19f4a9-4e11-4bf3-8cf6-1db027e0f011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beebd68e-b4a0-498a-b836-a43227b7fa20', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:04 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b66b0824-194f-4f6e-81ee-776778d77f4b tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a5cbc7a-de9b-4789-953c-6594ebe34ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:04 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Lock "cinder-quobyte-d5d7c5ef-c769-48f6-a541-5cfee50ce453-2446f9c5-777d-4b08-b250-ec08b17953a1" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Creating volume 2446f9c5-777d-4b08-b250-ec08b17953a1 from snapshot d5d7c5ef-c769-48f6-a541-5cfee50ce453 {{(pid=89090) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 11:01:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:01:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:01:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 11:01:04 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Acquiring lock "cinder-quobyte-2446f9c5-777d-4b08-b250-ec08b17953a1" by "_copy_volume_from_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:04 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-b66b0824-194f-4f6e-81ee-776778d77f4b tempest-ProjectMemberTests-1695234881 None] Volume volume-beebd68e-b4a0-498a-b836-a43227b7fa20 (beebd68e-b4a0-498a-b836-a43227b7fa20): created successfully Jul 31 11:01:04 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b66b0824-194f-4f6e-81ee-776778d77f4b tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a5cbc7a-de9b-4789-953c-6594ebe34ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:04 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-b66b0824-194f-4f6e-81ee-776778d77f4b tempest-ProjectMemberTests-1695234881 None] Flow 'volume_create_manager' (58f0f32b-cc23-4c4c-9530-3497b79aec54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:04 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Lock "cinder-quobyte-2446f9c5-777d-4b08-b250-ec08b17953a1" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] snapshot: d5d7c5ef-c769-48f6-a541-5cfee50ce453, volume: 2446f9c5-777d-4b08-b250-ec08b17953a1, {{(pid=89090) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 11:01:04 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-b66b0824-194f-4f6e-81ee-776778d77f4b tempest-ProjectMemberTests-1695234881 None] Created volume successfully. Jul 31 11:01:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:01:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:01:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:04 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[d111d3a4-aae9-42e9-94ed-31f4c728b7f9]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228.d5d7c5ef-c769-48f6-a541-5cfee50ce453 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:04 devstack sudo[108693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228.d5d7c5ef-c769-48f6-a541-5cfee50ce453 Jul 31 11:01:04 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:04 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228.d5d7c5ef-c769-48f6-a541-5cfee50ce453" returned: 0 in 0.359s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:01:04 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cced1f2-1f71-4c62-9fc7-4757e3816031]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:04 devstack sudo[108698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228 Jul 31 11:01:04 devstack sudo[108698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:04 devstack sudo[108698]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228" returned: 0 in 0.364s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228 {{(pid=89090) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 11:01:04 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Creating direct copy from snapshot {{(pid=89090) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 11:01:04 devstack cinder-volume[89090]: DEBUG cinder.utils [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Path /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-2446f9c5-777d-4b08-b250-ec08b17953a1 not found in is_blk_device check {{(pid=89090) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 11:01:04 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-2446f9c5-777d-4b08-b250-ec08b17953a1 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:04 devstack sudo[108703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-2446f9c5-777d-4b08-b250-ec08b17953a1 Jul 31 11:01:04 devstack sudo[108703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:05 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-1816fec0-4cd7-4829-a364-237c4f7452cb tempest-ProjectMemberTests-1695234881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:09 devstack sudo[108703]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-2446f9c5-777d-4b08-b250-ec08b17953a1" returned: 0 in 4.178s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:09 devstack cinder-volume[89090]: DEBUG cinder.image.image_utils [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Image conversion details: src /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228, size 1024.00 MB, duration 4.18 sec, destination /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-2446f9c5-777d-4b08-b250-ec08b17953a1 {{(pid=89090) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 11:01:09 devstack cinder-volume[89090]: INFO cinder.image.image_utils [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Converted 1024.00 MB image at 245.06 MB/s Jul 31 11:01:09 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-2446f9c5-777d-4b08-b250-ec08b17953a1 is being set with open permissions: ugo+rw Jul 31 11:01:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-2446f9c5-777d-4b08-b250-ec08b17953a1 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:09 devstack sudo[108718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-2446f9c5-777d-4b08-b250-ec08b17953a1 Jul 31 11:01:09 devstack sudo[108718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:09 devstack sudo[108718]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-2446f9c5-777d-4b08-b250-ec08b17953a1" returned: 0 in 0.235s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:09 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Lock "cinder-quobyte-2446f9c5-777d-4b08-b250-ec08b17953a1" released by "_copy_volume_from_snapshot" :: held 5.226s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:09 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Lock "cinder-quobyte-d5d7c5ef-c769-48f6-a541-5cfee50ce453-2446f9c5-777d-4b08-b250-ec08b17953a1" released by "_create_volume_from_snapshot" :: held 5.309s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.342s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-1816fec0-4cd7-4829-a364-237c4f7452cb tempest-ProjectMemberTests-1695234881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.958s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:09 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-1816fec0-4cd7-4829-a364-237c4f7452cb tempest-ProjectMemberTests-1695234881 None] Creating offline snapshot 5c31de87-cb78-47ce-8643-4e4ef3e51bf8 of volume beebd68e-b4a0-498a-b836-a43227b7fa20 {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:01:09 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28c8134-3fb1-4721-a545-7a417b831816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2446f9c5-777d-4b08-b250-ec08b17953a1', 'volume_size': 1, 'snapshot_id': 'd5d7c5ef-c769-48f6-a541-5cfee50ce453'}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:09 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2052b31-19cf-480f-aedf-24e0a2632a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:09 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[984d2bce-03ee-41ab-99e3-a899bab3f875]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1816fec0-4cd7-4829-a364-237c4f7452cb tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:09 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Volume volume-2446f9c5-777d-4b08-b250-ec08b17953a1 (2446f9c5-777d-4b08-b250-ec08b17953a1): created successfully Jul 31 11:01:09 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2052b31-19cf-480f-aedf-24e0a2632a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:09 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Flow 'volume_create_manager' (3e616b59-942b-44d1-8049-78010b06b7b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:09 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-17e7261f-dd04-4662-ab65-396dadc800f2 tempest-SnapshotDependencyTests-40370578 None] Created volume successfully. Jul 31 11:01:09 devstack sudo[108721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20 Jul 31 11:01:09 devstack sudo[108721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:09 devstack sudo[108721]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1816fec0-4cd7-4829-a364-237c4f7452cb tempest-ProjectMemberTests-1695234881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20" returned: 0 in 0.374s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:09 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1816fec0-4cd7-4829-a364-237c4f7452cb tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20.5c31de87-cb78-47ce-8643-4e4ef3e51bf8 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:09 devstack sudo[108726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20.5c31de87-cb78-47ce-8643-4e4ef3e51bf8 1G Jul 31 11:01:09 devstack sudo[108726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:10 devstack sudo[108726]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1816fec0-4cd7-4829-a364-237c4f7452cb tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20.5c31de87-cb78-47ce-8643-4e4ef3e51bf8 1G" returned: 0 in 0.382s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1816fec0-4cd7-4829-a364-237c4f7452cb tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beebd68e-b4a0-498a-b836-a43227b7fa20 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20.5c31de87-cb78-47ce-8643-4e4ef3e51bf8 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:10 devstack sudo[108731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beebd68e-b4a0-498a-b836-a43227b7fa20 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20.5c31de87-cb78-47ce-8643-4e4ef3e51bf8 Jul 31 11:01:10 devstack sudo[108731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:10 devstack sudo[108731]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1816fec0-4cd7-4829-a364-237c4f7452cb tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beebd68e-b4a0-498a-b836-a43227b7fa20 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20.5c31de87-cb78-47ce-8643-4e4ef3e51bf8" returned: 0 in 0.313s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:10 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-1816fec0-4cd7-4829-a364-237c4f7452cb tempest-ProjectMemberTests-1695234881 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20.5c31de87-cb78-47ce-8643-4e4ef3e51bf8 is being set with open permissions: ugo+rw Jul 31 11:01:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1816fec0-4cd7-4829-a364-237c4f7452cb tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20.5c31de87-cb78-47ce-8643-4e4ef3e51bf8 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:10 devstack sudo[108738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20.5c31de87-cb78-47ce-8643-4e4ef3e51bf8 Jul 31 11:01:10 devstack sudo[108738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-04038733-a60d-42ce-8250-45e2962d72ef tempest-SnapshotDependencyTests-40370578 None] Acquiring lock "cinder-d5d7c5ef-c769-48f6-a541-5cfee50ce453-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-04038733-a60d-42ce-8250-45e2962d72ef tempest-SnapshotDependencyTests-40370578 None] Lock "cinder-d5d7c5ef-c769-48f6-a541-5cfee50ce453-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-04038733-a60d-42ce-8250-45e2962d72ef tempest-SnapshotDependencyTests-40370578 None] Acquiring lock "cinder-quobyte-1346a4a8-7494-4f7c-a1ce-da9937d2d228" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-04038733-a60d-42ce-8250-45e2962d72ef tempest-SnapshotDependencyTests-40370578 None] Lock "cinder-quobyte-1346a4a8-7494-4f7c-a1ce-da9937d2d228" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-04038733-a60d-42ce-8250-45e2962d72ef tempest-SnapshotDependencyTests-40370578 None] Acquiring lock "cinder-quobyte-d5d7c5ef-c769-48f6-a541-5cfee50ce453" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:10 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-04038733-a60d-42ce-8250-45e2962d72ef tempest-SnapshotDependencyTests-40370578 None] Lock "cinder-quobyte-d5d7c5ef-c769-48f6-a541-5cfee50ce453" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:10 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-04038733-a60d-42ce-8250-45e2962d72ef tempest-SnapshotDependencyTests-40370578 None] Deleting offline snapshot d5d7c5ef-c769-48f6-a541-5cfee50ce453 of volume 1346a4a8-7494-4f7c-a1ce-da9937d2d228 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:01:10 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-04038733-a60d-42ce-8250-45e2962d72ef tempest-SnapshotDependencyTests-40370578 None] snapshot_file for this snap is: volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228.d5d7c5ef-c769-48f6-a541-5cfee50ce453 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:01:10 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9a675f-c9d2-4543-87fc-3b43a7f0ed29]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-04038733-a60d-42ce-8250-45e2962d72ef tempest-SnapshotDependencyTests-40370578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228.d5d7c5ef-c769-48f6-a541-5cfee50ce453 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:10 devstack sudo[108738]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1816fec0-4cd7-4829-a364-237c4f7452cb tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20.5c31de87-cb78-47ce-8643-4e4ef3e51bf8" returned: 0 in 0.279s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:10 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1816fec0-4cd7-4829-a364-237c4f7452cb tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:10 devstack sudo[108742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20.info Jul 31 11:01:10 devstack sudo[108742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:10 devstack sudo[108741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228.d5d7c5ef-c769-48f6-a541-5cfee50ce453 Jul 31 11:01:10 devstack sudo[108741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:11 devstack sudo[108742]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1816fec0-4cd7-4829-a364-237c4f7452cb tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20.info" returned: 0 in 0.267s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:11 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-1816fec0-4cd7-4829-a364-237c4f7452cb tempest-ProjectMemberTests-1695234881 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20.info is being set with open permissions: ugo+rw Jul 31 11:01:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1816fec0-4cd7-4829-a364-237c4f7452cb tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:11 devstack sudo[108748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20.info Jul 31 11:01:11 devstack sudo[108748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:11 devstack sudo[108741]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-04038733-a60d-42ce-8250-45e2962d72ef tempest-SnapshotDependencyTests-40370578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228.d5d7c5ef-c769-48f6-a541-5cfee50ce453" returned: 0 in 0.378s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:11 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-04038733-a60d-42ce-8250-45e2962d72ef tempest-SnapshotDependencyTests-40370578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:01:11 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a9a97e-d4b5-4af0-ae8e-fb681b245062]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-04038733-a60d-42ce-8250-45e2962d72ef tempest-SnapshotDependencyTests-40370578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:11 devstack sudo[108751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228 Jul 31 11:01:11 devstack sudo[108751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:11 devstack sudo[108748]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1816fec0-4cd7-4829-a364-237c4f7452cb tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20.info" returned: 0 in 0.249s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-1816fec0-4cd7-4829-a364-237c4f7452cb tempest-ProjectMemberTests-1695234881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.965s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:11 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-1816fec0-4cd7-4829-a364-237c4f7452cb tempest-ProjectMemberTests-1695234881 None] Create snapshot completed successfully Jul 31 11:01:11 devstack sudo[108751]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-04038733-a60d-42ce-8250-45e2962d72ef tempest-SnapshotDependencyTests-40370578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228" returned: 0 in 0.558s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-04038733-a60d-42ce-8250-45e2962d72ef tempest-SnapshotDependencyTests-40370578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228.d5d7c5ef-c769-48f6-a541-5cfee50ce453 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:11 devstack sudo[108793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228.d5d7c5ef-c769-48f6-a541-5cfee50ce453 Jul 31 11:01:11 devstack sudo[108793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:11 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-04c7a0b6-1350-441c-bf0c-6148e9b4406e tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-5c31de87-cb78-47ce-8643-4e4ef3e51bf8-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:11 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-04c7a0b6-1350-441c-bf0c-6148e9b4406e tempest-ProjectMemberTests-1695234881 None] Lock "cinder-5c31de87-cb78-47ce-8643-4e4ef3e51bf8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:11 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-04c7a0b6-1350-441c-bf0c-6148e9b4406e tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-quobyte-beebd68e-b4a0-498a-b836-a43227b7fa20" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:11 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-04c7a0b6-1350-441c-bf0c-6148e9b4406e tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-beebd68e-b4a0-498a-b836-a43227b7fa20" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:11 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-04c7a0b6-1350-441c-bf0c-6148e9b4406e tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-quobyte-5c31de87-cb78-47ce-8643-4e4ef3e51bf8" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:11 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-04c7a0b6-1350-441c-bf0c-6148e9b4406e tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-5c31de87-cb78-47ce-8643-4e4ef3e51bf8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:11 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-04c7a0b6-1350-441c-bf0c-6148e9b4406e tempest-ProjectMemberTests-1695234881 None] Deleting offline snapshot 5c31de87-cb78-47ce-8643-4e4ef3e51bf8 of volume beebd68e-b4a0-498a-b836-a43227b7fa20 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:01:11 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-04c7a0b6-1350-441c-bf0c-6148e9b4406e tempest-ProjectMemberTests-1695234881 None] snapshot_file for this snap is: volume-beebd68e-b4a0-498a-b836-a43227b7fa20.5c31de87-cb78-47ce-8643-4e4ef3e51bf8 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:01:11 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[0201c153-527d-48e2-bf3a-1dbc7e83bd94]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:11 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-04c7a0b6-1350-441c-bf0c-6148e9b4406e tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20.5c31de87-cb78-47ce-8643-4e4ef3e51bf8 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:12 devstack sudo[108798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20.5c31de87-cb78-47ce-8643-4e4ef3e51bf8 Jul 31 11:01:12 devstack sudo[108798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:12 devstack sudo[108793]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-04038733-a60d-42ce-8250-45e2962d72ef tempest-SnapshotDependencyTests-40370578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228.d5d7c5ef-c769-48f6-a541-5cfee50ce453" returned: 0 in 0.353s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-04038733-a60d-42ce-8250-45e2962d72ef tempest-SnapshotDependencyTests-40370578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228.d5d7c5ef-c769-48f6-a541-5cfee50ce453 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:12 devstack sudo[108806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228.d5d7c5ef-c769-48f6-a541-5cfee50ce453 Jul 31 11:01:12 devstack sudo[108806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:12 devstack sudo[108798]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-04c7a0b6-1350-441c-bf0c-6148e9b4406e tempest-ProjectMemberTests-1695234881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20.5c31de87-cb78-47ce-8643-4e4ef3e51bf8" returned: 0 in 0.355s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:12 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-04c7a0b6-1350-441c-bf0c-6148e9b4406e tempest-ProjectMemberTests-1695234881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-beebd68e-b4a0-498a-b836-a43227b7fa20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:01:12 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cb3184-03be-4916-8a5c-c7ee489e2de6]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-04c7a0b6-1350-441c-bf0c-6148e9b4406e tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:12 devstack sudo[108806]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-04038733-a60d-42ce-8250-45e2962d72ef tempest-SnapshotDependencyTests-40370578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228.d5d7c5ef-c769-48f6-a541-5cfee50ce453" returned: 0 in 0.241s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:12 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-04038733-a60d-42ce-8250-45e2962d72ef tempest-SnapshotDependencyTests-40370578 None] Lock "cinder-quobyte-d5d7c5ef-c769-48f6-a541-5cfee50ce453" released by "_delete_snapshot" :: held 1.628s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:12 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-04038733-a60d-42ce-8250-45e2962d72ef tempest-SnapshotDependencyTests-40370578 None] Lock "cinder-quobyte-1346a4a8-7494-4f7c-a1ce-da9937d2d228" released by "delete_snapshot" :: held 1.650s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:12 devstack sudo[108812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20 Jul 31 11:01:12 devstack sudo[108812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:12 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-04038733-a60d-42ce-8250-45e2962d72ef tempest-SnapshotDependencyTests-40370578 None] Created reservations ['7cc9817c-c847-4f5c-bbdc-fb6ebd193864', '7be10032-ced9-4625-9719-25b7d2e7f680', 'c8caad9c-bd31-423c-b018-77653eb91b2f', '5d590f5c-fcca-4206-bb0f-2d627f910a5d'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:01:12 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-04038733-a60d-42ce-8250-45e2962d72ef tempest-SnapshotDependencyTests-40370578 None] Delete snapshot completed successfully. Jul 31 11:01:12 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-04038733-a60d-42ce-8250-45e2962d72ef tempest-SnapshotDependencyTests-40370578 None] Lock "cinder-d5d7c5ef-c769-48f6-a541-5cfee50ce453-delete_snapshot" released by "delete_snapshot" :: held 1.806s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:12 devstack sudo[108812]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-04c7a0b6-1350-441c-bf0c-6148e9b4406e tempest-ProjectMemberTests-1695234881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20" returned: 0 in 0.391s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-04c7a0b6-1350-441c-bf0c-6148e9b4406e tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20.5c31de87-cb78-47ce-8643-4e4ef3e51bf8 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:12 devstack sudo[108817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20.5c31de87-cb78-47ce-8643-4e4ef3e51bf8 Jul 31 11:01:12 devstack sudo[108817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:12 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d6651124-0594-42df-9a2c-29b4880ab411 tempest-SnapshotDependencyTests-40370578 None] Acquiring lock "cinder-1346a4a8-7494-4f7c-a1ce-da9937d2d228-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:12 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d6651124-0594-42df-9a2c-29b4880ab411 tempest-SnapshotDependencyTests-40370578 None] Lock "cinder-1346a4a8-7494-4f7c-a1ce-da9937d2d228-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:12 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d6651124-0594-42df-9a2c-29b4880ab411 tempest-SnapshotDependencyTests-40370578 None] Acquiring lock "cinder-quobyte-1346a4a8-7494-4f7c-a1ce-da9937d2d228" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:12 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d6651124-0594-42df-9a2c-29b4880ab411 tempest-SnapshotDependencyTests-40370578 None] Lock "cinder-quobyte-1346a4a8-7494-4f7c-a1ce-da9937d2d228" acquired by "delete_volume" :: waited 0.019s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:12 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[501389ea-2561-47e4-a8ac-d2fbd13463fa]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:12 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d6651124-0594-42df-9a2c-29b4880ab411 tempest-SnapshotDependencyTests-40370578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:13 devstack sudo[108817]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-04c7a0b6-1350-441c-bf0c-6148e9b4406e tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20.5c31de87-cb78-47ce-8643-4e4ef3e51bf8" returned: 0 in 0.367s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-04c7a0b6-1350-441c-bf0c-6148e9b4406e tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20.5c31de87-cb78-47ce-8643-4e4ef3e51bf8 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:13 devstack sudo[108822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228 Jul 31 11:01:13 devstack sudo[108822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:13 devstack sudo[108824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20.5c31de87-cb78-47ce-8643-4e4ef3e51bf8 Jul 31 11:01:13 devstack sudo[108824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:13 devstack sudo[108824]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-04c7a0b6-1350-441c-bf0c-6148e9b4406e tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20.5c31de87-cb78-47ce-8643-4e4ef3e51bf8" returned: 0 in 0.314s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:13 devstack sudo[108822]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d6651124-0594-42df-9a2c-29b4880ab411 tempest-SnapshotDependencyTests-40370578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228" returned: 0 in 0.431s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d6651124-0594-42df-9a2c-29b4880ab411 tempest-SnapshotDependencyTests-40370578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:13 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-04c7a0b6-1350-441c-bf0c-6148e9b4406e tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-5c31de87-cb78-47ce-8643-4e4ef3e51bf8" released by "_delete_snapshot" :: held 1.533s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:13 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-04c7a0b6-1350-441c-bf0c-6148e9b4406e tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-beebd68e-b4a0-498a-b836-a43227b7fa20" released by "delete_snapshot" :: held 1.566s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:13 devstack sudo[108832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228 Jul 31 11:01:13 devstack sudo[108832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:13 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-04c7a0b6-1350-441c-bf0c-6148e9b4406e tempest-ProjectMemberTests-1695234881 None] Created reservations ['a9b1b889-8466-4e58-b7c3-7c58b23f307d', '076f2b76-b3aa-47bb-8190-951aac38c3bb', '7727cde8-fc0f-4768-ba11-465c41b8d91c', 'c0c1197f-5ca5-4dfa-b717-694c57be4c0e'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:01:13 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-04c7a0b6-1350-441c-bf0c-6148e9b4406e tempest-ProjectMemberTests-1695234881 None] Delete snapshot completed successfully. Jul 31 11:01:13 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-04c7a0b6-1350-441c-bf0c-6148e9b4406e tempest-ProjectMemberTests-1695234881 None] Lock "cinder-5c31de87-cb78-47ce-8643-4e4ef3e51bf8-delete_snapshot" released by "delete_snapshot" :: held 1.749s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:13 devstack sudo[108832]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d6651124-0594-42df-9a2c-29b4880ab411 tempest-SnapshotDependencyTests-40370578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-1346a4a8-7494-4f7c-a1ce-da9937d2d228" returned: 0 in 0.295s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:13 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d6651124-0594-42df-9a2c-29b4880ab411 tempest-SnapshotDependencyTests-40370578 None] Lock "cinder-quobyte-1346a4a8-7494-4f7c-a1ce-da9937d2d228" released by "delete_volume" :: held 0.780s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:13 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-d6651124-0594-42df-9a2c-29b4880ab411 tempest-SnapshotDependencyTests-40370578 None] Created reservations ['8ad77e4c-d878-415c-8b11-b8a5685ed936', '1072022a-4e76-4fd0-9aeb-358978086c24', '0f12f1b8-2031-437a-96f8-ee1a3ed39181', 'dd79af07-24a8-43e1-9d53-4f7501abcb5c'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:01:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d6651124-0594-42df-9a2c-29b4880ab411 tempest-SnapshotDependencyTests-40370578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d6651124-0594-42df-9a2c-29b4880ab411 tempest-SnapshotDependencyTests-40370578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:13 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d6651124-0594-42df-9a2c-29b4880ab411 tempest-SnapshotDependencyTests-40370578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:01:13 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-d6651124-0594-42df-9a2c-29b4880ab411 tempest-SnapshotDependencyTests-40370578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:01:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-d6651124-0594-42df-9a2c-29b4880ab411 tempest-SnapshotDependencyTests-40370578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:13 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d6651124-0594-42df-9a2c-29b4880ab411 tempest-SnapshotDependencyTests-40370578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:13 devstack sudo[108835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 11:01:13 devstack sudo[108835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:14 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f1721281-d66f-4062-9613-a0e150aab2b2 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-beebd68e-b4a0-498a-b836-a43227b7fa20-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:14 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-22531eee-5c82-4d28-a38b-f602546d5d41 tempest-SnapshotDependencyTests-40370578 None] Acquiring lock "cinder-2446f9c5-777d-4b08-b250-ec08b17953a1-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:14 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f1721281-d66f-4062-9613-a0e150aab2b2 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-beebd68e-b4a0-498a-b836-a43227b7fa20-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:14 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-22531eee-5c82-4d28-a38b-f602546d5d41 tempest-SnapshotDependencyTests-40370578 None] Lock "cinder-2446f9c5-777d-4b08-b250-ec08b17953a1-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:14 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f1721281-d66f-4062-9613-a0e150aab2b2 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-quobyte-beebd68e-b4a0-498a-b836-a43227b7fa20" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:14 devstack sudo[108835]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d6651124-0594-42df-9a2c-29b4880ab411 tempest-SnapshotDependencyTests-40370578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.304s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:14 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-d6651124-0594-42df-9a2c-29b4880ab411 tempest-SnapshotDependencyTests-40370578 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:01:14 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-d6651124-0594-42df-9a2c-29b4880ab411 tempest-SnapshotDependencyTests-40370578 None] Deleted volume successfully. Jul 31 11:01:14 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f1721281-d66f-4062-9613-a0e150aab2b2 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-beebd68e-b4a0-498a-b836-a43227b7fa20" acquired by "delete_volume" :: waited 0.029s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:14 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-22531eee-5c82-4d28-a38b-f602546d5d41 tempest-SnapshotDependencyTests-40370578 None] Acquiring lock "cinder-quobyte-2446f9c5-777d-4b08-b250-ec08b17953a1" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:14 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d6651124-0594-42df-9a2c-29b4880ab411 tempest-SnapshotDependencyTests-40370578 None] Lock "cinder-1346a4a8-7494-4f7c-a1ce-da9937d2d228-delete_volume" released by "delete_volume" :: held 1.327s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:14 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cad273-9b5a-460b-a72c-710918a16561]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f1721281-d66f-4062-9613-a0e150aab2b2 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:14 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-22531eee-5c82-4d28-a38b-f602546d5d41 tempest-SnapshotDependencyTests-40370578 None] Lock "cinder-quobyte-2446f9c5-777d-4b08-b250-ec08b17953a1" acquired by "delete_volume" :: waited 0.027s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:14 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c0909e-bf74-4896-b218-5dc829f09a36]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-22531eee-5c82-4d28-a38b-f602546d5d41 tempest-SnapshotDependencyTests-40370578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-2446f9c5-777d-4b08-b250-ec08b17953a1 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:14 devstack sudo[108838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20 Jul 31 11:01:14 devstack sudo[108838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:14 devstack sudo[108839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-2446f9c5-777d-4b08-b250-ec08b17953a1 Jul 31 11:01:14 devstack sudo[108839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:14 devstack sudo[108838]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f1721281-d66f-4062-9613-a0e150aab2b2 tempest-ProjectMemberTests-1695234881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20" returned: 0 in 0.390s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f1721281-d66f-4062-9613-a0e150aab2b2 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:14 devstack sudo[108848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20 Jul 31 11:01:14 devstack sudo[108848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:14 devstack sudo[108839]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-22531eee-5c82-4d28-a38b-f602546d5d41 tempest-SnapshotDependencyTests-40370578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-2446f9c5-777d-4b08-b250-ec08b17953a1" returned: 0 in 0.406s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-22531eee-5c82-4d28-a38b-f602546d5d41 tempest-SnapshotDependencyTests-40370578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-2446f9c5-777d-4b08-b250-ec08b17953a1 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:14 devstack sudo[108850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-2446f9c5-777d-4b08-b250-ec08b17953a1 Jul 31 11:01:14 devstack sudo[108850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:14 devstack sudo[108848]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f1721281-d66f-4062-9613-a0e150aab2b2 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-beebd68e-b4a0-498a-b836-a43227b7fa20" returned: 0 in 0.281s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:14 devstack sudo[108850]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:14 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f1721281-d66f-4062-9613-a0e150aab2b2 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-beebd68e-b4a0-498a-b836-a43227b7fa20" released by "delete_volume" :: held 0.740s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:14 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-22531eee-5c82-4d28-a38b-f602546d5d41 tempest-SnapshotDependencyTests-40370578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-2446f9c5-777d-4b08-b250-ec08b17953a1" returned: 0 in 0.252s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:14 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-22531eee-5c82-4d28-a38b-f602546d5d41 tempest-SnapshotDependencyTests-40370578 None] Lock "cinder-quobyte-2446f9c5-777d-4b08-b250-ec08b17953a1" released by "delete_volume" :: held 0.703s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:14 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-f1721281-d66f-4062-9613-a0e150aab2b2 tempest-ProjectMemberTests-1695234881 None] Created reservations ['13357c44-3495-4a9c-95cb-94a306a305cd', '875a14d7-5f14-4c98-baaa-5a64e0324ae2', 'a480f064-56fa-40fc-b379-c29d3bb45cca', '4c683d9d-22f7-42fc-a92f-0b8a345c3872'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:01:14 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-22531eee-5c82-4d28-a38b-f602546d5d41 tempest-SnapshotDependencyTests-40370578 None] Created reservations ['18e973a4-767e-4acf-b360-b016abc845b0', '937b4eb4-0caf-4755-9dbc-7f3d78905a15', '114e88a8-f46b-4e3c-93f7-fe8a5d81baa9', 'bcab4b8c-71dd-4037-ae7a-2aea90b76892'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:01:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f1721281-d66f-4062-9613-a0e150aab2b2 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f1721281-d66f-4062-9613-a0e150aab2b2 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:15 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f1721281-d66f-4062-9613-a0e150aab2b2 tempest-ProjectMemberTests-1695234881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:01:15 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f1721281-d66f-4062-9613-a0e150aab2b2 tempest-ProjectMemberTests-1695234881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:01:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f1721281-d66f-4062-9613-a0e150aab2b2 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f1721281-d66f-4062-9613-a0e150aab2b2 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:15 devstack sudo[108854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 11:01:15 devstack sudo[108854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-22531eee-5c82-4d28-a38b-f602546d5d41 tempest-SnapshotDependencyTests-40370578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-22531eee-5c82-4d28-a38b-f602546d5d41 tempest-SnapshotDependencyTests-40370578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:15 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-22531eee-5c82-4d28-a38b-f602546d5d41 tempest-SnapshotDependencyTests-40370578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:01:15 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-22531eee-5c82-4d28-a38b-f602546d5d41 tempest-SnapshotDependencyTests-40370578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:01:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-22531eee-5c82-4d28-a38b-f602546d5d41 tempest-SnapshotDependencyTests-40370578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-22531eee-5c82-4d28-a38b-f602546d5d41 tempest-SnapshotDependencyTests-40370578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:15 devstack sudo[108856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 11:01:15 devstack sudo[108856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:15 devstack sudo[108854]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f1721281-d66f-4062-9613-a0e150aab2b2 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.339s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:15 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-f1721281-d66f-4062-9613-a0e150aab2b2 tempest-ProjectMemberTests-1695234881 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:01:15 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-f1721281-d66f-4062-9613-a0e150aab2b2 tempest-ProjectMemberTests-1695234881 None] Deleted volume successfully. Jul 31 11:01:15 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f1721281-d66f-4062-9613-a0e150aab2b2 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-beebd68e-b4a0-498a-b836-a43227b7fa20-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:15 devstack sudo[108856]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-22531eee-5c82-4d28-a38b-f602546d5d41 tempest-SnapshotDependencyTests-40370578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.361s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:15 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-22531eee-5c82-4d28-a38b-f602546d5d41 tempest-SnapshotDependencyTests-40370578 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:01:15 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-22531eee-5c82-4d28-a38b-f602546d5d41 tempest-SnapshotDependencyTests-40370578 None] Deleted volume successfully. Jul 31 11:01:15 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-22531eee-5c82-4d28-a38b-f602546d5d41 tempest-SnapshotDependencyTests-40370578 None] Lock "cinder-2446f9c5-777d-4b08-b250-ec08b17953a1-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:15 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc962448-deb4-47c1-84ad-e900c22593b9 tempest-ProjectMemberTests-1695234881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:01:15 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bc962448-deb4-47c1-84ad-e900c22593b9 tempest-ProjectMemberTests-1695234881 None] Flow 'volume_create_manager' (fa43bf07-d1ef-4138-b8a9-5ef37f24b1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:15 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bc962448-deb4-47c1-84ad-e900c22593b9 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2632888-8b54-4a89-b1db-3002c43d4fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:15 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bc962448-deb4-47c1-84ad-e900c22593b9 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2632888-8b54-4a89-b1db-3002c43d4fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-854842776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18cb44d7-1bf3-4a3b-9f6f-eff86988b077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b176847c446546949fa03ac443e36966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:01:16Z,use_quota=True,user_id='6d7378e77478417881535d0f0f80d4b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:15 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bc962448-deb4-47c1-84ad-e900c22593b9 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26683ccb-7fdb-4093-9786-b54dfec73077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:15 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bc962448-deb4-47c1-84ad-e900c22593b9 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26683ccb-7fdb-4093-9786-b54dfec73077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:15 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bc962448-deb4-47c1-84ad-e900c22593b9 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18efce0b-d139-4570-9292-95cc06d051b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:15 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bc962448-deb4-47c1-84ad-e900c22593b9 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18efce0b-d139-4570-9292-95cc06d051b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18cb44d7-1bf3-4a3b-9f6f-eff86988b077', 'volume_name': 'volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:15 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bc962448-deb4-47c1-84ad-e900c22593b9 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47c4745e-68aa-47b7-8e66-7aee25e3d491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:15 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bc962448-deb4-47c1-84ad-e900c22593b9 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47c4745e-68aa-47b7-8e66-7aee25e3d491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:15 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bc962448-deb4-47c1-84ad-e900c22593b9 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ccd885c-63fd-429f-add0-57865bda8ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:15 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-bc962448-deb4-47c1-84ad-e900c22593b9 tempest-ProjectMemberTests-1695234881 None] Volume 18cb44d7-1bf3-4a3b-9f6f-eff86988b077: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077', 'volume_size': 1} Jul 31 11:01:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-bc962448-deb4-47c1-84ad-e900c22593b9 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-bc962448-deb4-47c1-84ad-e900c22593b9 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:15 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-bc962448-deb4-47c1-84ad-e900c22593b9 tempest-ProjectMemberTests-1695234881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-854842776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18cb44d7-1bf3-4a3b-9f6f-eff86988b077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b176847c446546949fa03ac443e36966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:01:16Z,use_quota=True,user_id='6d7378e77478417881535d0f0f80d4b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:01:15 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-bc962448-deb4-47c1-84ad-e900c22593b9 tempest-ProjectMemberTests-1695234881 None] Creating volume 18cb44d7-1bf3-4a3b-9f6f-eff86988b077 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:01:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-bc962448-deb4-47c1-84ad-e900c22593b9 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-bc962448-deb4-47c1-84ad-e900c22593b9 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:15 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-bc962448-deb4-47c1-84ad-e900c22593b9 tempest-ProjectMemberTests-1695234881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:01:15 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-bc962448-deb4-47c1-84ad-e900c22593b9 tempest-ProjectMemberTests-1695234881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:01:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-bc962448-deb4-47c1-84ad-e900c22593b9 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:15 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-bc962448-deb4-47c1-84ad-e900c22593b9 tempest-ProjectMemberTests-1695234881 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 11:01:15 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-bc962448-deb4-47c1-84ad-e900c22593b9 tempest-ProjectMemberTests-1695234881 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 11:01:15 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bc962448-deb4-47c1-84ad-e900c22593b9 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:15 devstack sudo[108860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077 1073741824 Jul 31 11:01:15 devstack sudo[108860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:16 devstack sudo[108860]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bc962448-deb4-47c1-84ad-e900c22593b9 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077 1073741824" returned: 0 in 0.520s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bc962448-deb4-47c1-84ad-e900c22593b9 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:16 devstack sudo[108865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077 Jul 31 11:01:16 devstack sudo[108865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:16 devstack sudo[108865]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-bc962448-deb4-47c1-84ad-e900c22593b9 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077" returned: 0 in 0.277s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:16 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-bc962448-deb4-47c1-84ad-e900c22593b9 tempest-ProjectMemberTests-1695234881 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:01:16 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-bc962448-deb4-47c1-84ad-e900c22593b9 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bc962448-deb4-47c1-84ad-e900c22593b9 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ccd885c-63fd-429f-add0-57865bda8ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bc962448-deb4-47c1-84ad-e900c22593b9 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a6e13b-84ac-4159-996a-a02708e5c363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:16 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-bc962448-deb4-47c1-84ad-e900c22593b9 tempest-ProjectMemberTests-1695234881 None] Volume volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077 (18cb44d7-1bf3-4a3b-9f6f-eff86988b077): created successfully Jul 31 11:01:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bc962448-deb4-47c1-84ad-e900c22593b9 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a6e13b-84ac-4159-996a-a02708e5c363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:16 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-bc962448-deb4-47c1-84ad-e900c22593b9 tempest-ProjectMemberTests-1695234881 None] Flow 'volume_create_manager' (fa43bf07-d1ef-4138-b8a9-5ef37f24b1a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:16 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-bc962448-deb4-47c1-84ad-e900c22593b9 tempest-ProjectMemberTests-1695234881 None] Created volume successfully. Jul 31 11:01:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-446b29df-63b0-4a41-a3dd-477fe04f694e tempest-ProjectMemberTests-1695234881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-446b29df-63b0-4a41-a3dd-477fe04f694e tempest-ProjectMemberTests-1695234881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:18 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-446b29df-63b0-4a41-a3dd-477fe04f694e tempest-ProjectMemberTests-1695234881 None] Creating offline snapshot 90642b46-f494-49b2-b8be-7b3d3efc7835 of volume 18cb44d7-1bf3-4a3b-9f6f-eff86988b077 {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:01:18 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbabc88b-f8d6-4d1d-8247-0e8f021c6da1]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-446b29df-63b0-4a41-a3dd-477fe04f694e tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:18 devstack sudo[108870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077 Jul 31 11:01:18 devstack sudo[108870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:18 devstack sudo[108870]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-446b29df-63b0-4a41-a3dd-477fe04f694e tempest-ProjectMemberTests-1695234881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077" returned: 0 in 0.451s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:18 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-446b29df-63b0-4a41-a3dd-477fe04f694e tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077.90642b46-f494-49b2-b8be-7b3d3efc7835 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:18 devstack sudo[108875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077.90642b46-f494-49b2-b8be-7b3d3efc7835 1G Jul 31 11:01:18 devstack sudo[108875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:19 devstack sudo[108875]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-446b29df-63b0-4a41-a3dd-477fe04f694e tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077.90642b46-f494-49b2-b8be-7b3d3efc7835 1G" returned: 0 in 0.479s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-446b29df-63b0-4a41-a3dd-477fe04f694e tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077.90642b46-f494-49b2-b8be-7b3d3efc7835 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:19 devstack sudo[108882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077.90642b46-f494-49b2-b8be-7b3d3efc7835 Jul 31 11:01:19 devstack sudo[108882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:19 devstack sudo[108882]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-446b29df-63b0-4a41-a3dd-477fe04f694e tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077.90642b46-f494-49b2-b8be-7b3d3efc7835" returned: 0 in 0.321s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:19 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-446b29df-63b0-4a41-a3dd-477fe04f694e tempest-ProjectMemberTests-1695234881 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077.90642b46-f494-49b2-b8be-7b3d3efc7835 is being set with open permissions: ugo+rw Jul 31 11:01:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-446b29df-63b0-4a41-a3dd-477fe04f694e tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077.90642b46-f494-49b2-b8be-7b3d3efc7835 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:19 devstack sudo[108888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077.90642b46-f494-49b2-b8be-7b3d3efc7835 Jul 31 11:01:19 devstack sudo[108888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:19 devstack sudo[108888]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-446b29df-63b0-4a41-a3dd-477fe04f694e tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077.90642b46-f494-49b2-b8be-7b3d3efc7835" returned: 0 in 0.270s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-446b29df-63b0-4a41-a3dd-477fe04f694e tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:19 devstack sudo[108891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077.info Jul 31 11:01:19 devstack sudo[108891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:19 devstack sudo[108891]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-446b29df-63b0-4a41-a3dd-477fe04f694e tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077.info" returned: 0 in 0.304s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:19 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-446b29df-63b0-4a41-a3dd-477fe04f694e tempest-ProjectMemberTests-1695234881 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077.info is being set with open permissions: ugo+rw Jul 31 11:01:19 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-446b29df-63b0-4a41-a3dd-477fe04f694e tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:20 devstack sudo[108894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077.info Jul 31 11:01:20 devstack sudo[108894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:20 devstack sudo[108894]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-446b29df-63b0-4a41-a3dd-477fe04f694e tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077.info" returned: 0 in 0.304s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:20 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-446b29df-63b0-4a41-a3dd-477fe04f694e tempest-ProjectMemberTests-1695234881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.223s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:20 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-446b29df-63b0-4a41-a3dd-477fe04f694e tempest-ProjectMemberTests-1695234881 None] Create snapshot completed successfully Jul 31 11:01:21 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d0faeaa0-f3a4-43b7-9264-9687b0c86719 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-90642b46-f494-49b2-b8be-7b3d3efc7835-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:21 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d0faeaa0-f3a4-43b7-9264-9687b0c86719 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-90642b46-f494-49b2-b8be-7b3d3efc7835-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:21 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d0faeaa0-f3a4-43b7-9264-9687b0c86719 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-quobyte-18cb44d7-1bf3-4a3b-9f6f-eff86988b077" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:21 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d0faeaa0-f3a4-43b7-9264-9687b0c86719 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-18cb44d7-1bf3-4a3b-9f6f-eff86988b077" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:21 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d0faeaa0-f3a4-43b7-9264-9687b0c86719 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-quobyte-90642b46-f494-49b2-b8be-7b3d3efc7835" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:21 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d0faeaa0-f3a4-43b7-9264-9687b0c86719 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-90642b46-f494-49b2-b8be-7b3d3efc7835" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:21 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-d0faeaa0-f3a4-43b7-9264-9687b0c86719 tempest-ProjectMemberTests-1695234881 None] Deleting offline snapshot 90642b46-f494-49b2-b8be-7b3d3efc7835 of volume 18cb44d7-1bf3-4a3b-9f6f-eff86988b077 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:01:21 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-d0faeaa0-f3a4-43b7-9264-9687b0c86719 tempest-ProjectMemberTests-1695234881 None] snapshot_file for this snap is: volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077.90642b46-f494-49b2-b8be-7b3d3efc7835 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:01:21 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2fce25-030a-4dcf-91d1-7f65d3a4e575]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0faeaa0-f3a4-43b7-9264-9687b0c86719 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077.90642b46-f494-49b2-b8be-7b3d3efc7835 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:21 devstack sudo[108898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077.90642b46-f494-49b2-b8be-7b3d3efc7835 Jul 31 11:01:21 devstack sudo[108898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:21 devstack sudo[108898]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0faeaa0-f3a4-43b7-9264-9687b0c86719 tempest-ProjectMemberTests-1695234881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077.90642b46-f494-49b2-b8be-7b3d3efc7835" returned: 0 in 0.461s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:21 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-d0faeaa0-f3a4-43b7-9264-9687b0c86719 tempest-ProjectMemberTests-1695234881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:01:21 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc67200-ec4c-48a4-8caf-e09245d17506]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:21 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0faeaa0-f3a4-43b7-9264-9687b0c86719 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:22 devstack sudo[108903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077 Jul 31 11:01:22 devstack sudo[108903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:22 devstack sudo[108903]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0faeaa0-f3a4-43b7-9264-9687b0c86719 tempest-ProjectMemberTests-1695234881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077" returned: 0 in 0.459s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0faeaa0-f3a4-43b7-9264-9687b0c86719 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077.90642b46-f494-49b2-b8be-7b3d3efc7835 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:22 devstack sudo[108908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077.90642b46-f494-49b2-b8be-7b3d3efc7835 Jul 31 11:01:22 devstack sudo[108908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:22 devstack sudo[108908]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0faeaa0-f3a4-43b7-9264-9687b0c86719 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077.90642b46-f494-49b2-b8be-7b3d3efc7835" returned: 0 in 0.394s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:22 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0faeaa0-f3a4-43b7-9264-9687b0c86719 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077.90642b46-f494-49b2-b8be-7b3d3efc7835 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:22 devstack sudo[108914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077.90642b46-f494-49b2-b8be-7b3d3efc7835 Jul 31 11:01:22 devstack sudo[108914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:23 devstack sudo[108914]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-d0faeaa0-f3a4-43b7-9264-9687b0c86719 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077.90642b46-f494-49b2-b8be-7b3d3efc7835" returned: 0 in 0.319s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:23 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d0faeaa0-f3a4-43b7-9264-9687b0c86719 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-90642b46-f494-49b2-b8be-7b3d3efc7835" released by "_delete_snapshot" :: held 1.741s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:23 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d0faeaa0-f3a4-43b7-9264-9687b0c86719 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-18cb44d7-1bf3-4a3b-9f6f-eff86988b077" released by "delete_snapshot" :: held 1.767s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:23 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-d0faeaa0-f3a4-43b7-9264-9687b0c86719 tempest-ProjectMemberTests-1695234881 None] Created reservations ['a9a8723a-d27d-4608-ac64-a4574e6a94fa', '76149a5b-5603-4761-a427-4067bad59ecd', 'b622ed2c-3e07-4195-8b49-63a4ee74eed5', '4124c1eb-8915-41e2-a8f5-5efab1f17ee1'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:01:23 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-d0faeaa0-f3a4-43b7-9264-9687b0c86719 tempest-ProjectMemberTests-1695234881 None] Delete snapshot completed successfully. Jul 31 11:01:23 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-d0faeaa0-f3a4-43b7-9264-9687b0c86719 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-90642b46-f494-49b2-b8be-7b3d3efc7835-delete_snapshot" released by "delete_snapshot" :: held 1.931s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:23 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f61f44f4-32cc-417a-8456-be8c67c9aa2f tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-18cb44d7-1bf3-4a3b-9f6f-eff86988b077-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:23 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f61f44f4-32cc-417a-8456-be8c67c9aa2f tempest-ProjectMemberTests-1695234881 None] Lock "cinder-18cb44d7-1bf3-4a3b-9f6f-eff86988b077-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:23 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f61f44f4-32cc-417a-8456-be8c67c9aa2f tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-quobyte-18cb44d7-1bf3-4a3b-9f6f-eff86988b077" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:23 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f61f44f4-32cc-417a-8456-be8c67c9aa2f tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-18cb44d7-1bf3-4a3b-9f6f-eff86988b077" acquired by "delete_volume" :: waited 0.016s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:23 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[7672bfc0-70bb-4f19-9200-1b993d6f322f]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:23 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f61f44f4-32cc-417a-8456-be8c67c9aa2f tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:23 devstack sudo[108918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077 Jul 31 11:01:23 devstack sudo[108918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:24 devstack sudo[108918]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f61f44f4-32cc-417a-8456-be8c67c9aa2f tempest-ProjectMemberTests-1695234881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077" returned: 0 in 0.431s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f61f44f4-32cc-417a-8456-be8c67c9aa2f tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:24 devstack sudo[108923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077 Jul 31 11:01:24 devstack sudo[108923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:24 devstack sudo[108923]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f61f44f4-32cc-417a-8456-be8c67c9aa2f tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-18cb44d7-1bf3-4a3b-9f6f-eff86988b077" returned: 0 in 0.266s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:24 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f61f44f4-32cc-417a-8456-be8c67c9aa2f tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-18cb44d7-1bf3-4a3b-9f6f-eff86988b077" released by "delete_volume" :: held 0.769s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:24 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-f61f44f4-32cc-417a-8456-be8c67c9aa2f tempest-ProjectMemberTests-1695234881 None] Created reservations ['ee56cc72-8cd6-4454-bb32-0dc06ce641ab', '9c5607cc-54d7-47d8-80ce-12974c7c26ca', 'dfcd7f31-a450-41d1-a87e-d6447fcc8f1c', '18425aac-b56a-4204-9fa0-d9044730b8b1'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:01:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f61f44f4-32cc-417a-8456-be8c67c9aa2f tempest-ProjectMemberTests-1695234881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f61f44f4-32cc-417a-8456-be8c67c9aa2f tempest-ProjectMemberTests-1695234881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:24 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f61f44f4-32cc-417a-8456-be8c67c9aa2f tempest-ProjectMemberTests-1695234881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:01:24 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-f61f44f4-32cc-417a-8456-be8c67c9aa2f tempest-ProjectMemberTests-1695234881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:01:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-f61f44f4-32cc-417a-8456-be8c67c9aa2f tempest-ProjectMemberTests-1695234881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f61f44f4-32cc-417a-8456-be8c67c9aa2f tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:24 devstack sudo[108926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 11:01:24 devstack sudo[108926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:24 devstack sudo[108926]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:24 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-f61f44f4-32cc-417a-8456-be8c67c9aa2f tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.316s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:24 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-f61f44f4-32cc-417a-8456-be8c67c9aa2f tempest-ProjectMemberTests-1695234881 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:01:24 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-f61f44f4-32cc-417a-8456-be8c67c9aa2f tempest-ProjectMemberTests-1695234881 None] Deleted volume successfully. Jul 31 11:01:24 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-f61f44f4-32cc-417a-8456-be8c67c9aa2f tempest-ProjectMemberTests-1695234881 None] Lock "cinder-18cb44d7-1bf3-4a3b-9f6f-eff86988b077-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:25 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-af43c4d7-d059-4944-ab31-99c1202bacbb tempest-ProjectMemberTests-1695234881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:01:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-af43c4d7-d059-4944-ab31-99c1202bacbb tempest-ProjectMemberTests-1695234881 None] Flow 'volume_create_manager' (54385c65-1462-40ad-a315-51c396016ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-af43c4d7-d059-4944-ab31-99c1202bacbb tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e47f7a0-4c44-4eb4-b0e4-8645d08913ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-af43c4d7-d059-4944-ab31-99c1202bacbb tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e47f7a0-4c44-4eb4-b0e4-8645d08913ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-700777610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56f58334-df84-4a80-aacf-2ac2a1e3f433,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b176847c446546949fa03ac443e36966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:01:25Z,use_quota=True,user_id='6d7378e77478417881535d0f0f80d4b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-af43c4d7-d059-4944-ab31-99c1202bacbb tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae62d3ef-15f3-40a1-9119-6ae5fe97d688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-af43c4d7-d059-4944-ab31-99c1202bacbb tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae62d3ef-15f3-40a1-9119-6ae5fe97d688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-af43c4d7-d059-4944-ab31-99c1202bacbb tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62b8367b-209c-484f-95f7-c4da50d16e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-af43c4d7-d059-4944-ab31-99c1202bacbb tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62b8367b-209c-484f-95f7-c4da50d16e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56f58334-df84-4a80-aacf-2ac2a1e3f433', 'volume_name': 'volume-56f58334-df84-4a80-aacf-2ac2a1e3f433', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-af43c4d7-d059-4944-ab31-99c1202bacbb tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7b4185d-4e92-471d-9604-9682ddbdc6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-af43c4d7-d059-4944-ab31-99c1202bacbb tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7b4185d-4e92-471d-9604-9682ddbdc6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:25 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-af43c4d7-d059-4944-ab31-99c1202bacbb tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c5c94be-8d4e-4cce-bfbe-7cd2a69d35ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:25 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-af43c4d7-d059-4944-ab31-99c1202bacbb tempest-ProjectMemberTests-1695234881 None] Volume 56f58334-df84-4a80-aacf-2ac2a1e3f433: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56f58334-df84-4a80-aacf-2ac2a1e3f433', 'volume_size': 1} Jul 31 11:01:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-af43c4d7-d059-4944-ab31-99c1202bacbb tempest-ProjectMemberTests-1695234881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-af43c4d7-d059-4944-ab31-99c1202bacbb tempest-ProjectMemberTests-1695234881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:25 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-af43c4d7-d059-4944-ab31-99c1202bacbb tempest-ProjectMemberTests-1695234881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-700777610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56f58334-df84-4a80-aacf-2ac2a1e3f433,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b176847c446546949fa03ac443e36966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:01:25Z,use_quota=True,user_id='6d7378e77478417881535d0f0f80d4b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:01:25 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-af43c4d7-d059-4944-ab31-99c1202bacbb tempest-ProjectMemberTests-1695234881 None] Creating volume 56f58334-df84-4a80-aacf-2ac2a1e3f433 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:01:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-af43c4d7-d059-4944-ab31-99c1202bacbb tempest-ProjectMemberTests-1695234881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-af43c4d7-d059-4944-ab31-99c1202bacbb tempest-ProjectMemberTests-1695234881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:25 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-af43c4d7-d059-4944-ab31-99c1202bacbb tempest-ProjectMemberTests-1695234881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:01:25 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-af43c4d7-d059-4944-ab31-99c1202bacbb tempest-ProjectMemberTests-1695234881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:01:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-af43c4d7-d059-4944-ab31-99c1202bacbb tempest-ProjectMemberTests-1695234881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:25 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-af43c4d7-d059-4944-ab31-99c1202bacbb tempest-ProjectMemberTests-1695234881 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 11:01:25 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-af43c4d7-d059-4944-ab31-99c1202bacbb tempest-ProjectMemberTests-1695234881 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 11:01:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-af43c4d7-d059-4944-ab31-99c1202bacbb tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:25 devstack sudo[108929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433 1073741824 Jul 31 11:01:25 devstack sudo[108929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:25 devstack sudo[108929]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-af43c4d7-d059-4944-ab31-99c1202bacbb tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433 1073741824" returned: 0 in 0.477s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:25 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-af43c4d7-d059-4944-ab31-99c1202bacbb tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:25 devstack sudo[108935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433 Jul 31 11:01:25 devstack sudo[108935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:26 devstack sudo[108935]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-af43c4d7-d059-4944-ab31-99c1202bacbb tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433" returned: 0 in 0.280s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:26 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-af43c4d7-d059-4944-ab31-99c1202bacbb tempest-ProjectMemberTests-1695234881 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:01:26 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-af43c4d7-d059-4944-ab31-99c1202bacbb tempest-ProjectMemberTests-1695234881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-af43c4d7-d059-4944-ab31-99c1202bacbb tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c5c94be-8d4e-4cce-bfbe-7cd2a69d35ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56f58334-df84-4a80-aacf-2ac2a1e3f433', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-af43c4d7-d059-4944-ab31-99c1202bacbb tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e5a9da-79e3-4dac-a3f6-5bca342e2818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:26 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-af43c4d7-d059-4944-ab31-99c1202bacbb tempest-ProjectMemberTests-1695234881 None] Volume volume-56f58334-df84-4a80-aacf-2ac2a1e3f433 (56f58334-df84-4a80-aacf-2ac2a1e3f433): created successfully Jul 31 11:01:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-af43c4d7-d059-4944-ab31-99c1202bacbb tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e5a9da-79e3-4dac-a3f6-5bca342e2818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:26 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-af43c4d7-d059-4944-ab31-99c1202bacbb tempest-ProjectMemberTests-1695234881 None] Flow 'volume_create_manager' (54385c65-1462-40ad-a315-51c396016ac3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:26 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-af43c4d7-d059-4944-ab31-99c1202bacbb tempest-ProjectMemberTests-1695234881 None] Created volume successfully. Jul 31 11:01:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8c00c67d-2476-437c-a305-1eb1932d2261 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8c00c67d-2476-437c-a305-1eb1932d2261 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:27 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-8c00c67d-2476-437c-a305-1eb1932d2261 tempest-ProjectMemberTests-1695234881 None] Creating offline snapshot 5d7815b6-5456-47fc-b958-92c2e7f84fb5 of volume 56f58334-df84-4a80-aacf-2ac2a1e3f433 {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:01:27 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0cb06f-0009-44ef-8ca2-1f3b2c37fe31]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:27 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8c00c67d-2476-437c-a305-1eb1932d2261 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:27 devstack sudo[108938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433 Jul 31 11:01:27 devstack sudo[108938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:28 devstack sudo[108938]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8c00c67d-2476-437c-a305-1eb1932d2261 tempest-ProjectMemberTests-1695234881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433" returned: 0 in 0.401s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8c00c67d-2476-437c-a305-1eb1932d2261 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433.5d7815b6-5456-47fc-b958-92c2e7f84fb5 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:28 devstack sudo[108944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433.5d7815b6-5456-47fc-b958-92c2e7f84fb5 1G Jul 31 11:01:28 devstack sudo[108944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:28 devstack sudo[108944]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8c00c67d-2476-437c-a305-1eb1932d2261 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433.5d7815b6-5456-47fc-b958-92c2e7f84fb5 1G" returned: 0 in 0.436s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8c00c67d-2476-437c-a305-1eb1932d2261 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56f58334-df84-4a80-aacf-2ac2a1e3f433 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433.5d7815b6-5456-47fc-b958-92c2e7f84fb5 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:28 devstack sudo[108949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56f58334-df84-4a80-aacf-2ac2a1e3f433 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433.5d7815b6-5456-47fc-b958-92c2e7f84fb5 Jul 31 11:01:28 devstack sudo[108949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:28 devstack sudo[108949]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8c00c67d-2476-437c-a305-1eb1932d2261 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56f58334-df84-4a80-aacf-2ac2a1e3f433 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433.5d7815b6-5456-47fc-b958-92c2e7f84fb5" returned: 0 in 0.319s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:28 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-8c00c67d-2476-437c-a305-1eb1932d2261 tempest-ProjectMemberTests-1695234881 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433.5d7815b6-5456-47fc-b958-92c2e7f84fb5 is being set with open permissions: ugo+rw Jul 31 11:01:28 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8c00c67d-2476-437c-a305-1eb1932d2261 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433.5d7815b6-5456-47fc-b958-92c2e7f84fb5 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:28 devstack sudo[108954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433.5d7815b6-5456-47fc-b958-92c2e7f84fb5 Jul 31 11:01:28 devstack sudo[108954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:29 devstack sudo[108954]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8c00c67d-2476-437c-a305-1eb1932d2261 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433.5d7815b6-5456-47fc-b958-92c2e7f84fb5" returned: 0 in 0.272s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8c00c67d-2476-437c-a305-1eb1932d2261 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:29 devstack sudo[108957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433.info Jul 31 11:01:29 devstack sudo[108957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:29 devstack sudo[108957]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8c00c67d-2476-437c-a305-1eb1932d2261 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433.info" returned: 0 in 0.258s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:29 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-8c00c67d-2476-437c-a305-1eb1932d2261 tempest-ProjectMemberTests-1695234881 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433.info is being set with open permissions: ugo+rw Jul 31 11:01:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8c00c67d-2476-437c-a305-1eb1932d2261 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:29 devstack sudo[108960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433.info Jul 31 11:01:29 devstack sudo[108960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:29 devstack sudo[108960]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-8c00c67d-2476-437c-a305-1eb1932d2261 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433.info" returned: 0 in 0.275s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:29 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-8c00c67d-2476-437c-a305-1eb1932d2261 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.046s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:29 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-8c00c67d-2476-437c-a305-1eb1932d2261 tempest-ProjectMemberTests-1695234881 None] Create snapshot completed successfully Jul 31 11:01:30 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-c1c7b9b5-3d60-4fb5-b6e9-11679b576eb5 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-5d7815b6-5456-47fc-b958-92c2e7f84fb5-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:30 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-c1c7b9b5-3d60-4fb5-b6e9-11679b576eb5 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-5d7815b6-5456-47fc-b958-92c2e7f84fb5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:30 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-c1c7b9b5-3d60-4fb5-b6e9-11679b576eb5 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-quobyte-56f58334-df84-4a80-aacf-2ac2a1e3f433" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:30 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-c1c7b9b5-3d60-4fb5-b6e9-11679b576eb5 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-56f58334-df84-4a80-aacf-2ac2a1e3f433" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:30 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-c1c7b9b5-3d60-4fb5-b6e9-11679b576eb5 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-quobyte-5d7815b6-5456-47fc-b958-92c2e7f84fb5" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:30 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-c1c7b9b5-3d60-4fb5-b6e9-11679b576eb5 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-5d7815b6-5456-47fc-b958-92c2e7f84fb5" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:30 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-c1c7b9b5-3d60-4fb5-b6e9-11679b576eb5 tempest-ProjectMemberTests-1695234881 None] Deleting offline snapshot 5d7815b6-5456-47fc-b958-92c2e7f84fb5 of volume 56f58334-df84-4a80-aacf-2ac2a1e3f433 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:01:30 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-c1c7b9b5-3d60-4fb5-b6e9-11679b576eb5 tempest-ProjectMemberTests-1695234881 None] snapshot_file for this snap is: volume-56f58334-df84-4a80-aacf-2ac2a1e3f433.5d7815b6-5456-47fc-b958-92c2e7f84fb5 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:01:30 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7ee51a-2605-413e-b0ed-40d3370a1e9e]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:30 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c1c7b9b5-3d60-4fb5-b6e9-11679b576eb5 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433.5d7815b6-5456-47fc-b958-92c2e7f84fb5 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:31 devstack sudo[108963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433.5d7815b6-5456-47fc-b958-92c2e7f84fb5 Jul 31 11:01:31 devstack sudo[108963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:31 devstack sudo[108963]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c1c7b9b5-3d60-4fb5-b6e9-11679b576eb5 tempest-ProjectMemberTests-1695234881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433.5d7815b6-5456-47fc-b958-92c2e7f84fb5" returned: 0 in 0.401s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:31 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-c1c7b9b5-3d60-4fb5-b6e9-11679b576eb5 tempest-ProjectMemberTests-1695234881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56f58334-df84-4a80-aacf-2ac2a1e3f433(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:01:31 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[8559e89d-333f-4fb1-9851-f25d1032bc32]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c1c7b9b5-3d60-4fb5-b6e9-11679b576eb5 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:31 devstack sudo[108968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433 Jul 31 11:01:31 devstack sudo[108968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:31 devstack sudo[108968]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c1c7b9b5-3d60-4fb5-b6e9-11679b576eb5 tempest-ProjectMemberTests-1695234881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433" returned: 0 in 0.385s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:31 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c1c7b9b5-3d60-4fb5-b6e9-11679b576eb5 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433.5d7815b6-5456-47fc-b958-92c2e7f84fb5 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:31 devstack sudo[108973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433.5d7815b6-5456-47fc-b958-92c2e7f84fb5 Jul 31 11:01:31 devstack sudo[108973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:32 devstack sudo[108973]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c1c7b9b5-3d60-4fb5-b6e9-11679b576eb5 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433.5d7815b6-5456-47fc-b958-92c2e7f84fb5" returned: 0 in 0.392s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c1c7b9b5-3d60-4fb5-b6e9-11679b576eb5 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433.5d7815b6-5456-47fc-b958-92c2e7f84fb5 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:32 devstack sudo[108978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433.5d7815b6-5456-47fc-b958-92c2e7f84fb5 Jul 31 11:01:32 devstack sudo[108978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:32 devstack sudo[108978]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:32 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-c1c7b9b5-3d60-4fb5-b6e9-11679b576eb5 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433.5d7815b6-5456-47fc-b958-92c2e7f84fb5" returned: 0 in 0.241s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:32 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-c1c7b9b5-3d60-4fb5-b6e9-11679b576eb5 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-5d7815b6-5456-47fc-b958-92c2e7f84fb5" released by "_delete_snapshot" :: held 1.516s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:32 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-c1c7b9b5-3d60-4fb5-b6e9-11679b576eb5 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-56f58334-df84-4a80-aacf-2ac2a1e3f433" released by "delete_snapshot" :: held 1.548s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:32 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-c1c7b9b5-3d60-4fb5-b6e9-11679b576eb5 tempest-ProjectMemberTests-1695234881 None] Created reservations ['38a7077b-71e5-46a1-9fcf-870789fc1abd', 'bd8e55ce-1e46-43f8-9ffe-9626b287076c', 'dc79328c-421f-4b30-a3d1-e053f61fe8b0', '4dc907db-9df7-4a10-89da-5e8c03153d6a'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:01:32 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-c1c7b9b5-3d60-4fb5-b6e9-11679b576eb5 tempest-ProjectMemberTests-1695234881 None] Delete snapshot completed successfully. Jul 31 11:01:32 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-c1c7b9b5-3d60-4fb5-b6e9-11679b576eb5 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-5d7815b6-5456-47fc-b958-92c2e7f84fb5-delete_snapshot" released by "delete_snapshot" :: held 1.694s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:32 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2d55b3d3-44da-4a0a-b091-31182dae2287 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-56f58334-df84-4a80-aacf-2ac2a1e3f433-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:32 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2d55b3d3-44da-4a0a-b091-31182dae2287 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-56f58334-df84-4a80-aacf-2ac2a1e3f433-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:33 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2d55b3d3-44da-4a0a-b091-31182dae2287 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-quobyte-56f58334-df84-4a80-aacf-2ac2a1e3f433" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:33 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2d55b3d3-44da-4a0a-b091-31182dae2287 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-56f58334-df84-4a80-aacf-2ac2a1e3f433" acquired by "delete_volume" :: waited 0.016s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:33 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d24976-b725-4607-a107-24ede1b6aa90]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2d55b3d3-44da-4a0a-b091-31182dae2287 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:33 devstack sudo[108981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433 Jul 31 11:01:33 devstack sudo[108981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:33 devstack sudo[108981]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2d55b3d3-44da-4a0a-b091-31182dae2287 tempest-ProjectMemberTests-1695234881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433" returned: 0 in 0.370s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2d55b3d3-44da-4a0a-b091-31182dae2287 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:33 devstack sudo[108986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433 Jul 31 11:01:33 devstack sudo[108986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:33 devstack sudo[108986]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2d55b3d3-44da-4a0a-b091-31182dae2287 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-56f58334-df84-4a80-aacf-2ac2a1e3f433" returned: 0 in 0.258s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:33 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2d55b3d3-44da-4a0a-b091-31182dae2287 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-56f58334-df84-4a80-aacf-2ac2a1e3f433" released by "delete_volume" :: held 0.690s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:33 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-2d55b3d3-44da-4a0a-b091-31182dae2287 tempest-ProjectMemberTests-1695234881 None] Created reservations ['da1b9410-ff91-4b4c-8181-a5d3d2824242', '9ade54fc-e773-4ba8-af9e-7785318b68e1', 'e0d7a9c6-ebd7-4a7a-b180-b7a6e13378aa', '69000c4a-4307-4891-be58-ddf7f354289d'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:01:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2d55b3d3-44da-4a0a-b091-31182dae2287 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2d55b3d3-44da-4a0a-b091-31182dae2287 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:33 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2d55b3d3-44da-4a0a-b091-31182dae2287 tempest-ProjectMemberTests-1695234881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:01:33 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-2d55b3d3-44da-4a0a-b091-31182dae2287 tempest-ProjectMemberTests-1695234881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:01:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-2d55b3d3-44da-4a0a-b091-31182dae2287 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:33 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2d55b3d3-44da-4a0a-b091-31182dae2287 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:33 devstack sudo[108990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 11:01:33 devstack sudo[108990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:34 devstack sudo[108990]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-2d55b3d3-44da-4a0a-b091-31182dae2287 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.253s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:34 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-2d55b3d3-44da-4a0a-b091-31182dae2287 tempest-ProjectMemberTests-1695234881 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:01:34 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-2d55b3d3-44da-4a0a-b091-31182dae2287 tempest-ProjectMemberTests-1695234881 None] Deleted volume successfully. Jul 31 11:01:34 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-2d55b3d3-44da-4a0a-b091-31182dae2287 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-56f58334-df84-4a80-aacf-2ac2a1e3f433-delete_volume" released by "delete_volume" :: held 1.140s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:34 devstack cinder-volume[89090]: DEBUG cinder.volume.flows.manager.create_volume [None req-92959b3e-c0e8-4c05-9dae-8d2c5db5e8d7 tempest-ProjectMemberTests-1695234881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89090) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:01:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-92959b3e-c0e8-4c05-9dae-8d2c5db5e8d7 tempest-ProjectMemberTests-1695234881 None] Flow 'volume_create_manager' (61d9ca90-5288-4413-8f85-747c59ff23ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-92959b3e-c0e8-4c05-9dae-8d2c5db5e8d7 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53d712ae-18a4-4ada-8968-f35739808cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-92959b3e-c0e8-4c05-9dae-8d2c5db5e8d7 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53d712ae-18a4-4ada-8968-f35739808cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1877254337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d56e209-96ae-460b-a9ea-b08244e7a317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b176847c446546949fa03ac443e36966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:01:35Z,use_quota=True,user_id='6d7378e77478417881535d0f0f80d4b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-92959b3e-c0e8-4c05-9dae-8d2c5db5e8d7 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdf4b492-e0bb-48f4-a12f-85d4d9aa5fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-92959b3e-c0e8-4c05-9dae-8d2c5db5e8d7 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdf4b492-e0bb-48f4-a12f-85d4d9aa5fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-92959b3e-c0e8-4c05-9dae-8d2c5db5e8d7 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (310a3331-39c0-41ae-be54-c94b3e8024c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-92959b3e-c0e8-4c05-9dae-8d2c5db5e8d7 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (310a3331-39c0-41ae-be54-c94b3e8024c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d56e209-96ae-460b-a9ea-b08244e7a317', 'volume_name': 'volume-9d56e209-96ae-460b-a9ea-b08244e7a317', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-92959b3e-c0e8-4c05-9dae-8d2c5db5e8d7 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7326334a-d999-4144-87e8-7905313eac1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-92959b3e-c0e8-4c05-9dae-8d2c5db5e8d7 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7326334a-d999-4144-87e8-7905313eac1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:34 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-92959b3e-c0e8-4c05-9dae-8d2c5db5e8d7 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f682e421-dffb-49c6-a0cd-fafa49c5f05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:34 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-92959b3e-c0e8-4c05-9dae-8d2c5db5e8d7 tempest-ProjectMemberTests-1695234881 None] Volume 9d56e209-96ae-460b-a9ea-b08244e7a317: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d56e209-96ae-460b-a9ea-b08244e7a317', 'volume_size': 1} Jul 31 11:01:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-92959b3e-c0e8-4c05-9dae-8d2c5db5e8d7 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-92959b3e-c0e8-4c05-9dae-8d2c5db5e8d7 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:34 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-92959b3e-c0e8-4c05-9dae-8d2c5db5e8d7 tempest-ProjectMemberTests-1695234881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1877254337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d56e209-96ae-460b-a9ea-b08244e7a317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b176847c446546949fa03ac443e36966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:01:35Z,use_quota=True,user_id='6d7378e77478417881535d0f0f80d4b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523),volume_type_id=efbfa7ee-fa40-4e38-a4d9-6c2c9e4f6523)}" {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:01:34 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-92959b3e-c0e8-4c05-9dae-8d2c5db5e8d7 tempest-ProjectMemberTests-1695234881 None] Creating volume 9d56e209-96ae-460b-a9ea-b08244e7a317 {{(pid=89090) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:01:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-92959b3e-c0e8-4c05-9dae-8d2c5db5e8d7 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-92959b3e-c0e8-4c05-9dae-8d2c5db5e8d7 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:34 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-92959b3e-c0e8-4c05-9dae-8d2c5db5e8d7 tempest-ProjectMemberTests-1695234881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:01:34 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-92959b3e-c0e8-4c05-9dae-8d2c5db5e8d7 tempest-ProjectMemberTests-1695234881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:01:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-92959b3e-c0e8-4c05-9dae-8d2c5db5e8d7 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:34 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-92959b3e-c0e8-4c05-9dae-8d2c5db5e8d7 tempest-ProjectMemberTests-1695234881 None] Selected osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c as target Quobyte volume. {{(pid=89090) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 11:01:34 devstack cinder-volume[89090]: INFO cinder.volume.drivers.remotefs [None req-92959b3e-c0e8-4c05-9dae-8d2c5db5e8d7 tempest-ProjectMemberTests-1695234881 None] casted to osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c Jul 31 11:01:34 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-92959b3e-c0e8-4c05-9dae-8d2c5db5e8d7 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317 1073741824 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:34 devstack sudo[108993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317 1073741824 Jul 31 11:01:34 devstack sudo[108993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:35 devstack sudo[108993]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-92959b3e-c0e8-4c05-9dae-8d2c5db5e8d7 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317 1073741824" returned: 0 in 0.463s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-92959b3e-c0e8-4c05-9dae-8d2c5db5e8d7 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:35 devstack sudo[108998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317 Jul 31 11:01:35 devstack sudo[108998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:35 devstack sudo[108998]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-92959b3e-c0e8-4c05-9dae-8d2c5db5e8d7 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317" returned: 0 in 0.256s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:35 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-92959b3e-c0e8-4c05-9dae-8d2c5db5e8d7 tempest-ProjectMemberTests-1695234881 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'} {{(pid=89090) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:01:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-92959b3e-c0e8-4c05-9dae-8d2c5db5e8d7 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-92959b3e-c0e8-4c05-9dae-8d2c5db5e8d7 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f682e421-dffb-49c6-a0cd-fafa49c5f05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d56e209-96ae-460b-a9ea-b08244e7a317', 'volume_size': 1}' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-92959b3e-c0e8-4c05-9dae-8d2c5db5e8d7 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19cef192-c985-4940-a1f3-e6e7d3a37a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:35 devstack cinder-volume[89090]: INFO cinder.volume.flows.manager.create_volume [None req-92959b3e-c0e8-4c05-9dae-8d2c5db5e8d7 tempest-ProjectMemberTests-1695234881 None] Volume volume-9d56e209-96ae-460b-a9ea-b08244e7a317 (9d56e209-96ae-460b-a9ea-b08244e7a317): created successfully Jul 31 11:01:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-92959b3e-c0e8-4c05-9dae-8d2c5db5e8d7 tempest-ProjectMemberTests-1695234881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19cef192-c985-4940-a1f3-e6e7d3a37a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89090) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:35 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-92959b3e-c0e8-4c05-9dae-8d2c5db5e8d7 tempest-ProjectMemberTests-1695234881 None] Flow 'volume_create_manager' (61d9ca90-5288-4413-8f85-747c59ff23ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89090) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:35 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-92959b3e-c0e8-4c05-9dae-8d2c5db5e8d7 tempest-ProjectMemberTests-1695234881 None] Created volume successfully. Jul 31 11:01:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-99395452-c0cd-4e7e-91ba-cc74a6168bb9 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-99395452-c0cd-4e7e-91ba-cc74a6168bb9 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:35 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-99395452-c0cd-4e7e-91ba-cc74a6168bb9 tempest-ProjectMemberTests-1695234881 None] Creating offline snapshot 145128d3-1b50-46f3-a20a-f7b5c2c556b6 of volume 9d56e209-96ae-460b-a9ea-b08244e7a317 {{(pid=89090) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:01:35 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[e773c731-76c5-41ba-b7da-8f2bdacc44f3]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:35 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-99395452-c0cd-4e7e-91ba-cc74a6168bb9 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:36 devstack sudo[109001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317 Jul 31 11:01:36 devstack sudo[109001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:36 devstack sudo[109001]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-99395452-c0cd-4e7e-91ba-cc74a6168bb9 tempest-ProjectMemberTests-1695234881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317" returned: 0 in 0.429s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-99395452-c0cd-4e7e-91ba-cc74a6168bb9 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317.145128d3-1b50-46f3-a20a-f7b5c2c556b6 1G {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:36 devstack sudo[109006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317.145128d3-1b50-46f3-a20a-f7b5c2c556b6 1G Jul 31 11:01:36 devstack sudo[109006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:36 devstack sudo[109006]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-99395452-c0cd-4e7e-91ba-cc74a6168bb9 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317.145128d3-1b50-46f3-a20a-f7b5c2c556b6 1G" returned: 0 in 0.466s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:36 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-99395452-c0cd-4e7e-91ba-cc74a6168bb9 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d56e209-96ae-460b-a9ea-b08244e7a317 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317.145128d3-1b50-46f3-a20a-f7b5c2c556b6 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:36 devstack sudo[109014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d56e209-96ae-460b-a9ea-b08244e7a317 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317.145128d3-1b50-46f3-a20a-f7b5c2c556b6 Jul 31 11:01:36 devstack sudo[109014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:37 devstack sudo[109014]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-99395452-c0cd-4e7e-91ba-cc74a6168bb9 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d56e209-96ae-460b-a9ea-b08244e7a317 -F qcow2 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317.145128d3-1b50-46f3-a20a-f7b5c2c556b6" returned: 0 in 0.323s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:37 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-99395452-c0cd-4e7e-91ba-cc74a6168bb9 tempest-ProjectMemberTests-1695234881 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317.145128d3-1b50-46f3-a20a-f7b5c2c556b6 is being set with open permissions: ugo+rw Jul 31 11:01:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-99395452-c0cd-4e7e-91ba-cc74a6168bb9 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317.145128d3-1b50-46f3-a20a-f7b5c2c556b6 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:37 devstack sudo[109019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317.145128d3-1b50-46f3-a20a-f7b5c2c556b6 Jul 31 11:01:37 devstack sudo[109019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:37 devstack sudo[109019]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-99395452-c0cd-4e7e-91ba-cc74a6168bb9 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317.145128d3-1b50-46f3-a20a-f7b5c2c556b6" returned: 0 in 0.247s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-99395452-c0cd-4e7e-91ba-cc74a6168bb9 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:37 devstack sudo[109022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317.info Jul 31 11:01:37 devstack sudo[109022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:37 devstack sudo[109022]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-99395452-c0cd-4e7e-91ba-cc74a6168bb9 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317.info" returned: 0 in 0.258s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:37 devstack cinder-volume[89090]: WARNING cinder.volume.drivers.remotefs [None req-99395452-c0cd-4e7e-91ba-cc74a6168bb9 tempest-ProjectMemberTests-1695234881 None] /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317.info is being set with open permissions: ugo+rw Jul 31 11:01:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-99395452-c0cd-4e7e-91ba-cc74a6168bb9 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317.info {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:37 devstack sudo[109025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317.info Jul 31 11:01:37 devstack sudo[109025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:37 devstack sudo[109025]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-99395452-c0cd-4e7e-91ba-cc74a6168bb9 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317.info" returned: 0 in 0.266s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:37 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-99395452-c0cd-4e7e-91ba-cc74a6168bb9 tempest-ProjectMemberTests-1695234881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.083s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:37 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-99395452-c0cd-4e7e-91ba-cc74a6168bb9 tempest-ProjectMemberTests-1695234881 None] Create snapshot completed successfully Jul 31 11:01:39 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1619a6cf-8b21-4103-9c66-b9b5514b91c8 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-145128d3-1b50-46f3-a20a-f7b5c2c556b6-delete_snapshot" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:39 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1619a6cf-8b21-4103-9c66-b9b5514b91c8 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-145128d3-1b50-46f3-a20a-f7b5c2c556b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:39 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1619a6cf-8b21-4103-9c66-b9b5514b91c8 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-quobyte-9d56e209-96ae-460b-a9ea-b08244e7a317" by "delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:39 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1619a6cf-8b21-4103-9c66-b9b5514b91c8 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-9d56e209-96ae-460b-a9ea-b08244e7a317" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:39 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1619a6cf-8b21-4103-9c66-b9b5514b91c8 tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-quobyte-145128d3-1b50-46f3-a20a-f7b5c2c556b6" by "_delete_snapshot" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:39 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1619a6cf-8b21-4103-9c66-b9b5514b91c8 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-145128d3-1b50-46f3-a20a-f7b5c2c556b6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:39 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-1619a6cf-8b21-4103-9c66-b9b5514b91c8 tempest-ProjectMemberTests-1695234881 None] Deleting offline snapshot 145128d3-1b50-46f3-a20a-f7b5c2c556b6 of volume 9d56e209-96ae-460b-a9ea-b08244e7a317 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:01:39 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-1619a6cf-8b21-4103-9c66-b9b5514b91c8 tempest-ProjectMemberTests-1695234881 None] snapshot_file for this snap is: volume-9d56e209-96ae-460b-a9ea-b08244e7a317.145128d3-1b50-46f3-a20a-f7b5c2c556b6 {{(pid=89090) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:01:39 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[696fb409-a5f5-4ba3-a773-d08d19536766]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1619a6cf-8b21-4103-9c66-b9b5514b91c8 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317.145128d3-1b50-46f3-a20a-f7b5c2c556b6 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:39 devstack sudo[109029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317.145128d3-1b50-46f3-a20a-f7b5c2c556b6 Jul 31 11:01:39 devstack sudo[109029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:39 devstack sudo[109029]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1619a6cf-8b21-4103-9c66-b9b5514b91c8 tempest-ProjectMemberTests-1695234881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317.145128d3-1b50-46f3-a20a-f7b5c2c556b6" returned: 0 in 0.382s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:39 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.remotefs [None req-1619a6cf-8b21-4103-9c66-b9b5514b91c8 tempest-ProjectMemberTests-1695234881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d56e209-96ae-460b-a9ea-b08244e7a317(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89090) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:01:39 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[982dde2b-45bd-4877-9269-931eda43d307]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:39 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1619a6cf-8b21-4103-9c66-b9b5514b91c8 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:39 devstack sudo[109034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317 Jul 31 11:01:39 devstack sudo[109034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:40 devstack sudo[109034]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1619a6cf-8b21-4103-9c66-b9b5514b91c8 tempest-ProjectMemberTests-1695234881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317" returned: 0 in 0.397s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1619a6cf-8b21-4103-9c66-b9b5514b91c8 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317.145128d3-1b50-46f3-a20a-f7b5c2c556b6 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:40 devstack sudo[109039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317.145128d3-1b50-46f3-a20a-f7b5c2c556b6 Jul 31 11:01:40 devstack sudo[109039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:40 devstack sudo[109039]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1619a6cf-8b21-4103-9c66-b9b5514b91c8 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317.145128d3-1b50-46f3-a20a-f7b5c2c556b6" returned: 0 in 0.381s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1619a6cf-8b21-4103-9c66-b9b5514b91c8 tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317.145128d3-1b50-46f3-a20a-f7b5c2c556b6 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:40 devstack sudo[109044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317.145128d3-1b50-46f3-a20a-f7b5c2c556b6 Jul 31 11:01:40 devstack sudo[109044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:40 devstack sudo[109044]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:40 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-1619a6cf-8b21-4103-9c66-b9b5514b91c8 tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317.145128d3-1b50-46f3-a20a-f7b5c2c556b6" returned: 0 in 0.274s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:40 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1619a6cf-8b21-4103-9c66-b9b5514b91c8 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-145128d3-1b50-46f3-a20a-f7b5c2c556b6" released by "_delete_snapshot" :: held 1.532s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:40 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1619a6cf-8b21-4103-9c66-b9b5514b91c8 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-9d56e209-96ae-460b-a9ea-b08244e7a317" released by "delete_snapshot" :: held 1.559s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:40 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-1619a6cf-8b21-4103-9c66-b9b5514b91c8 tempest-ProjectMemberTests-1695234881 None] Created reservations ['79bbb1fd-d2b5-49ea-961e-05dc7960a6b1', '857f1fc4-c1d1-4f90-a9f1-2dc70f34129b', '0fa82a3e-5a87-47a9-84fa-024b4cc05dbd', '520f9ce0-964d-410c-97cc-89151c377935'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:01:40 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-1619a6cf-8b21-4103-9c66-b9b5514b91c8 tempest-ProjectMemberTests-1695234881 None] Delete snapshot completed successfully. Jul 31 11:01:40 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-1619a6cf-8b21-4103-9c66-b9b5514b91c8 tempest-ProjectMemberTests-1695234881 None] Lock "cinder-145128d3-1b50-46f3-a20a-f7b5c2c556b6-delete_snapshot" released by "delete_snapshot" :: held 1.725s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:41 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-fef03284-b379-498a-a897-331bcaddcd8e tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-9d56e209-96ae-460b-a9ea-b08244e7a317-delete_volume" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:41 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-fef03284-b379-498a-a897-331bcaddcd8e tempest-ProjectMemberTests-1695234881 None] Lock "cinder-9d56e209-96ae-460b-a9ea-b08244e7a317-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:41 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-fef03284-b379-498a-a897-331bcaddcd8e tempest-ProjectMemberTests-1695234881 None] Acquiring lock "cinder-quobyte-9d56e209-96ae-460b-a9ea-b08244e7a317" by "delete_volume" {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:41 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-fef03284-b379-498a-a897-331bcaddcd8e tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-9d56e209-96ae-460b-a9ea-b08244e7a317" acquired by "delete_volume" :: waited 0.022s {{(pid=89090) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:41 devstack cinder-volume[89090]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0c6685-c920-4d19-9d2f-5fba7df7e457]: (4, 'qcow2') {{(pid=90769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fef03284-b379-498a-a897-331bcaddcd8e tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:41 devstack sudo[109047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317 Jul 31 11:01:41 devstack sudo[109047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:41 devstack sudo[109047]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fef03284-b379-498a-a897-331bcaddcd8e tempest-ProjectMemberTests-1695234881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317" returned: 0 in 0.378s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:41 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fef03284-b379-498a-a897-331bcaddcd8e tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:41 devstack sudo[109052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317 Jul 31 11:01:41 devstack sudo[109052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:42 devstack sudo[109052]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fef03284-b379-498a-a897-331bcaddcd8e tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901/volume-9d56e209-96ae-460b-a9ea-b08244e7a317" returned: 0 in 0.272s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:42 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-fef03284-b379-498a-a897-331bcaddcd8e tempest-ProjectMemberTests-1695234881 None] Lock "cinder-quobyte-9d56e209-96ae-460b-a9ea-b08244e7a317" released by "delete_volume" :: held 0.718s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:42 devstack cinder-volume[89090]: DEBUG cinder.quota [None req-fef03284-b379-498a-a897-331bcaddcd8e tempest-ProjectMemberTests-1695234881 None] Created reservations ['afddc0e3-e127-4651-9809-3499ad39112a', '105273e5-b040-441d-ad27-126143ce1dfb', '71f24093-ff1c-4878-bca1-7c722fbbb990', 'ad651a82-7ca9-4e1e-99c4-6f09127ae07e'] {{(pid=89090) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:01:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-fef03284-b379-498a-a897-331bcaddcd8e tempest-ProjectMemberTests-1695234881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-fef03284-b379-498a-a897-331bcaddcd8e tempest-ProjectMemberTests-1695234881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:42 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-fef03284-b379-498a-a897-331bcaddcd8e tempest-ProjectMemberTests-1695234881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:01:42 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-fef03284-b379-498a-a897-331bcaddcd8e tempest-ProjectMemberTests-1695234881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:01:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-fef03284-b379-498a-a897-331bcaddcd8e tempest-ProjectMemberTests-1695234881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fef03284-b379-498a-a897-331bcaddcd8e tempest-ProjectMemberTests-1695234881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:42 devstack sudo[109055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 11:01:42 devstack sudo[109055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:42 devstack sudo[109055]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:42 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-fef03284-b379-498a-a897-331bcaddcd8e tempest-ProjectMemberTests-1695234881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.296s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:42 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-fef03284-b379-498a-a897-331bcaddcd8e tempest-ProjectMemberTests-1695234881 None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:01:42 devstack cinder-volume[89090]: INFO cinder.volume.manager [None req-fef03284-b379-498a-a897-331bcaddcd8e tempest-ProjectMemberTests-1695234881 None] Deleted volume successfully. Jul 31 11:01:42 devstack cinder-volume[89090]: DEBUG cinder.coordination [None req-fef03284-b379-498a-a897-331bcaddcd8e tempest-ProjectMemberTests-1695234881 None] Lock "cinder-9d56e209-96ae-460b-a9ea-b08244e7a317-delete_volume" released by "delete_volume" :: held 1.235s {{(pid=89090) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:45 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:01:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c': None} {{(pid=89090) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 11:01:45 devstack cinder-volume[89090]: DEBUG cinder.volume.drivers.quobyte [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c578ff2a-aed2-4b8e-8067-4e0daeedfa2c'] {{(pid=89090) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 11:01:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.lockutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89090) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:45 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:46 devstack sudo[109059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901 Jul 31 11:01:46 devstack sudo[109059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:46 devstack sudo[109059]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:46 devstack cinder-volume[89090]: DEBUG oslo_concurrency.processutils [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c2f788a30f28990e84b7650d29640901" returned: 0 in 0.256s {{(pid=89090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:46 devstack cinder-volume[89090]: DEBUG cinder.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Notifying Schedulers of capabilities ... {{(pid=89090) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:01:46 devstack cinder-volume[89090]: DEBUG oslo_service.periodic_task [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] Running periodic task VolumeManager._thread_info {{(pid=89090) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:01:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread count: 28 {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 11:01:46 devstack cinder-volume[89090]: DEBUG cinder.volume.manager [None req-379cd336-b4b3-40ef-b914-258dd20b5ca3 None None] thread info: [<_MainThread(MainThread, started 134005426110592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89090) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 11:01:52 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=93,cinder:UPDATE=119,cinder:INSERT=26,cinder:DELETE=11 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:01:52 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=91,cinder:UPDATE=112,cinder:INSERT=38,cinder:DELETE=8 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:02:09 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:SELECT=1 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:02:09 devstack cinder-volume[89090]: DEBUG dbcounter [-] [89090] Writing DB stats cinder:UPDATE=1 {{(pid=89090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}